Splatt3R: Zero-Shot Gaussian Splatting from Uncalibrated Image Pairs

The mirror in the example with the washing machine is amazing. Obviously the model doesn’t understand that it’s a mirror so renders it as if it were a window with volume behind the wall. But it does it so realistically that it produces the same effect as a mirror when viewed from different angles. This feels like something out of a sci-fi detective movie.

Ha, reminds me of Duke Nukem mirrors which are essentially the same thing, looking through a window to mirrored geometry

Damn, I'm lookin' good.

I think most video game mirrors use basically the same technique.

Would love to see it try to handle a scene where the real volume behind the mirror were also available then. :9

I wish they would just link to prerendered output from the examples. I can never get output from demos on huggingface successfully , I assume due to load throttling when projects get attention?

Nowadays, reflections can be done through raytracing, with perhaps a blur/smudge to hide low ray counts for performance.