←back to thread

Splatt3R: Zero-Shot Gaussian Splatting from Uncalibrated Image Pairs

(splatt3r.active.vision)
145 points jasondavies | 1 comments | 27 Aug 24 10:23 UTC | HN request time: 0.203s | source
Show context
S0y ◴[27 Aug 24 15:10 UTC] No.41368437[source]▶
This is really awesome. A question for someone who knows more about this: How much harder would it be to make this work using any number of photos? I'm assuming this is the end goal for a model like this.

Imagine being able to create an accurate enough 3D rendering of any interior with just a bunch of snapshots anyone can take with their phone.

replies(2): >>41368608 #>>41368627 #
1. Arkanum ◴[27 Aug 24 15:27 UTC] No.41368627[source]▶
Probably not much harder, but you wouldn't get the same massive jump in quality that you get going from 1 image to 2. NeRF/Gaussian Splatting in general is what you're describing, but from the looks of it, this just does it in a single forward pass rather than optimising the gaussian/network weights.