Relativty: An open-source VR headset for $200

From the GitHub this is only capable of 3DoF tracking, which puts it in the same category as the defunct Oculus Go headset, or Google Cardboard. 6DoF is really the bare minimum to qualify as proper VR nowadays.

For the uninitiated 3DoF means the headset only tracks the rotation of your head, not your heads absolute position as you move around, while 6DoF tracking does both. 6DoF is also much harder to implement.

Never understood why my GCardboard couldn’t do that, my phone sure has a bunch of accelerometers and giros. Sure higher and other techs can track better but isn’t it enough for a basic sense of mouvement? For most of the applications I won’t more than a few meter anyway.

Probably some have tried and I’ll be curious to know what prevent it.

The problem with accelerometers and gyros is they drift badly if you try to derive absolute positioning from them alone. They need to be fused with some other form of tracking to anchor them in absolute space, which in the case of the Quest and Vision Pro is done with multiple outward-facing cameras fed into a SLAM algorithm.

Maybe Cardboard could have attempted to use the phones camera for SLAM, but a single lens would only have got them so far. Dedicated VR headsets have at least four cameras pointing in different directions, which are sometimes augmented by IR projectors and/or LiDAR.

Most phones have a couple cameras nowadays… I think the Pro iPhones (some, at least) even have some sort of lidar system that seems like it ought to be helpful? Anyway, it is a shame, I guess the market must not have been there.

Most phones use a rolling shutter, so doing machine vision for low-latency motion/pose is difficult or unfeasible on a mobile cpu.

Best regards =3

Surely use the accelerometers for real-time/low latency, only use the cameras to correct for drift?

Not that I've tried for VR, but I did already create AR demos 5-6 years ago.