I think coordinated govt crackdown could drive cryptocurrencies underground, with a big reset on price. Not a permanent 'solution' though. I'm sure other attacks are possible too. But this is a new invention and you can't kill an idea who's time has come.
Reading your first sentence, are you saying SegWit will hurt Bitcoin?