Yann LeCun to depart Meta and launch AI startup focused on 'world models'

Correct me if I'm wrong but LeCun is focused on learning from video, whereas Fei-Fei Li is doing robotic simulations. Also I think Fei-Fei Li's approach is still using transformers and not buying into JEPA.

JEPA is not an alternative to transformers, it is built out of transformers.

JEPA is trying to learn real world regularities by predicting internal perceptual representations (using a transformer).

It seems a good direction to go in, but tbh he doesn't seem to have taken it very far, and it is the transformer doing all the heavy lifting.