I guess the flip side of this is that you look like a fucking dork.
I think that will fade. I don't know if you remember how mocked the airpods were when they first came out ("They look like q-tips"). All it'll take is a few celebrities spotted using one and they'll turn cool in no time.
You're not wrong, but I think there's at least a couple of orders of magnitude of awkwardness between the Airpods and the the Vision Pro that will have to be overcome, before the VP becomes mainstream.