A Dyson sphere around a black hole

They only suck in stuff that gets too close relative to their mass. They aren't magical. If you have a planet and turn it into a black hole with the same mass - anybody on orbit around that planet will continue on their orbits like nothing changed.

For a meteor it makes no difference if gravity is coming from a planet or a black hole of the same mass. The only difference is that once you get very close - the gravity changes much quicker (because black hole is much smaller and denser than a planet) so you will be ripped apart.