I've been in the cryptocurrency space a very, very long time now.
Honestly, what really bugged me was the rise of poorly implemented/thought out KYC/AML solutions during the ICO gold rush. New investors/new players in the crypto market were (and are) effectively strong-armed into handing over their identity documents to unknown and unaccountable third parties in many cases, some of which were (and are!) scammers.
The other thing was how the ICO gold rush promised hundreds of fascinating usecases, and most of them have gone... Nowhere. The majority of the utility tokens I saw people hype over were dead in the water after 6 months, with all the capital nicely gone. So much fraud.
There are many other things, but a lot of it is basically just how scammy the space got, which really gave it a bad name and seriously fucked potential mainstream adoption up a bit. Like, we still don't have a realistic ePoS/wallet solution that just works...