Yann LeCun to depart Meta and launch AI startup focused on 'world models'

Interesting he isn't just working with Feifei Li if he's really interested in 'world models'.

Exactly where my mind turned. It's interesting how the AI OG's (Feifei and Cunn) think world models are the way forward.

Correct me if I'm wrong but LeCun is focused on learning from video, whereas Fei-Fei Li is doing robotic simulations. Also I think Fei-Fei Li's approach is still using transformers and not buying into JEPA.

JEPA is not an alternative to transformers, it is built out of transformers.

JEPA is trying to learn real world regularities by predicting internal perceptual representations (using a transformer).

It seems a good direction to go in, but tbh he doesn't seem to have taken it very far, and it is the transformer doing all the heavy lifting.

LeCun is not interested in generative models which predict in pixel space. He wants "energy based" models which predict in the representation space.