Buying Bitcoin: KYC vs. Non-KYC - Is Privacy Worth the Price?

I've been dollar-cost averaging (DCA) Bitcoin for a while now, using a Dutch-registered exchange where I had to undergo full identification. The tax authorities can easily track all my transactions, so I'm wondering if it truly adds value to purchase Bitcoin through a 'non-KYC' exchange? Generally, the fees are considerably higher compared to my current exchange.

Additionally, should I consider the added privacy and security of a 'non-KYC' exchange even if it means paying higher fees? Is it worth the trade-off in terms of anonymity and reducing the risk of my financial information being exposed? Any insights or experiences with this would be greatly appreciated!