←back to thread

The VAE Used for Stable Diffusion Is Flawed

(old.reddit.com)
268 points prashp | 1 comments | 01 Feb 24 12:25 UTC | HN request time: 0.344s | source
Show context
ants_everywhere ◴[01 Feb 24 13:44 UTC] No.39215828[source]▶
I'm curious, was this well-known by experts already? How surprising is this?

I enjoyed the write up.

replies(3): >>39215866 #>>39215887 #>>39218438 #
1. dwringer ◴[01 Feb 24 13:53 UTC] No.39215887[source]▶
If one ever tried to make edits to the latents prior to decoding them with a VAE in SD1.5 and then in SDXL, it could be seen that that local changes had somewhat unpredictable and global effects on the image in SD1.5, while in SDXL the changes have more predictable impacts to the output image and some of the different latent channels end up corresponding more directly to the resulting image channels.

Definitely a fascinating write-up. I have been curious about these differences for a while, though I had never considered this a "problem" per se.