Damn, and before that, Titan from Google: https://research.google/blog/titans-miras-helping-ai-have-lo...
We are not at the end of AI :)
Also, someone claimed that NVIDA combined diffusion and autoregression, making it 6 times faster, but couldn't find a source. Big if true!
replies(1):