←back to thread

Show HN: Real-Time Gaussian Splatting

(github.com)
142 points markisus | 1 comments | 15 May 25 13:26 UTC | HN request time: 0.205s | source

LiveSplat is a system for turning RGBD camera streams into Gaussian splat scenes in real-time. The system works by passing all the RGBD frames into a feed forward neural net that outputs the current scene as Gaussian splats. These splats are then rendered in real-time. I've put together a demo video at the link above.
Show context
sreekotay ◴[15 May 25 13:38 UTC] No.43994970[source]▶
This is realtime capture/display? Presumable (at this stage) for local viewing? Is that right?
replies(1): >>43995010 #
1. markisus ◴[15 May 25 13:42 UTC] No.43995010[source]▶
Yes realtime capture and display. Locality is not required. You can send the source RGBD video streams over IP and in fact I have that component working in the larger codebase that this was split off from. For that use case, you need to do some sort of compression. The RGB stream compression is a pretty solved problem, but the depth channel needs special consideration since "perceptual loss" in the depth space is not a well researched area.