It's silly how privacy detractors try to associate so-and-so terrible group with any software that simply lets people talk without corporate or government surveillance, as if the concept of a private conversation is a strange and suspicious thing now.
I think in principle most people agree that it's appropriate under some limited circumstances for authorities to listen in to private conversations, given well-founded suspicion of illegal activities taking place, so digital tools making that outright impossible do pose a problem most people find a bit uncomfortable, whether or not they feel the benefits outweigh the downsides.