←back to thread

Eye Contact Correction: Redirecting the eyes to look at the camera

(www.sievedata.com)
164 points thunderbong | 2 comments | 16 Oct 24 01:37 UTC | HN request time: 0s | source
Show context
xnx ◴[16 Oct 24 03:16 UTC] No.41855264[source]▶
Nvidia has free Broadcast software with an eye contact feature: https://www.nvidia.com/en-us/geforce/news/jan-2023-nvidia-br...

It's from January 2023, so I don't know if they've improved it further since then.

The video conferencing software providers have been way to slow to put whoever is speaking top-center (near where the camera typically is).

replies(3): >>41855389 #>>41855544 #>>41864389 #
zamadatix ◴[16 Oct 24 04:15 UTC] No.41855544[source]▶
They also release it as an SDK these days so you can use it from tools like OBS https://www.nvidia.com/en-us/geforce/broadcasting/broadcast-...
replies(2): >>41855561 #>>41855695 #
1. mvoodarla ◴[16 Oct 24 04:18 UTC] No.41855561[source]▶
Original dev here. That's right, NVIDIA has a version available which we reference in our blog.

https://www.sievedata.com/blog/eye-contact-correction-gaze-c...

Newer models have come out that allow the same thing to be done and control even more than the eyes.

See here: https://github.com/KwaiVGI/LivePortrait/blob/main/assets/doc...

For web-conferencing, local use is great so NVIDIA's tools are what we recommend in that case.

replies(1): >>41856479 #
2. eisenman ◴[16 Oct 24 07:27 UTC] No.41856479[source]▶
I appreciated using the Nvidia Tools for remapping webcam eye-contact until I was reviewing a recording and noticed that it changed my eye color. But it’s been a bit. Perhaps an undocumented feature that newer versions/models fixed.