Last time we organized society away from billionaires we got the new deal and the longest most egalitarian period of economic expansion in US history.
Despite the attractive purity of this worldview, modern technology and prosperity has only been possible because of the wide spread of reason, empathy, cooperation, and mutual respect on a global scale. Greed and consolidation of wealth are a much more ancient tactic that has in fact been tried many times over, usually to utter ruin. The only reason billionaires thrive so much right now is because we are all thriving much more than ever before in history, and the only reason THAT has happened is because we finally arrived at decent societal compromises and universal guarantees. It was meaningful sharing of power and respect for each others' ideas and differences that enabled all of this - the core tenets of democracy, for one. And yes, it was and still is 'socialist' ideas like building shared infrastructure and societal safety nets that establishes and actively enables the environment in which capitalism is able to succeed.
Stop trying to distill things down to a one-dimensional, teenage view of the world. It's much more complex and beautiful than that.
I concur that voters are extremely bad, but when the billionaires become oligarchs, they are exactly the dictators and technocrats you warn against. The voters are nominally in charge but they have enormous power to influence the voters. And one of the tools of that influence is their self mythology of being skilled more than lucky.
Are you thinking more of Narendra Modi or Donald Trump when you you say that? Democracy tends to be more of the one-dimensional teenage view of the world; ye olde voters do not do well when presented with complex ideas. They don't have the time or interest.