The sphere isn't difficult to build. It's impossible to build.
It's unstable without active stabilisation. The stabilisation has to be perfect because otherwise you get massive distorting spherequakes propagating through it, which will make it a very uncomfortable ride for a short time and will soon tear it apart.
A perfect spherical stabilising solution with components and sensors that are light minutes - or possibly light hours - from each other is impossible because of the signalling delays.
Ringworlds have the same problem. Even if the ring is made of infinitely strong unobtanium, it won't stay in a useful orbit for long enough to be built, never mind inhabited.
Swarms have more potential, because you can build them with sparse shells and move things around to handle instabilities. But you still need massive computational effort to keep swarm units from colliding with each other, possibly at very high speed.
None of this matters, because the limiting factor for civs is collective intelligence, not energy.
We already have access to far more energy than we could possibly use on earth for any technology that's actually buildable. But we're not using it because we don't have the species IQ to make the right choices.