Apple AI team keeps going against the bitter lesson and focusing on small on-device models.
Let's see how this would turn out in longterm.
replies(5):
If they approach things this way, and transistor progress continues linearly (relative to the last few years) maybe they can make their first devices that can meet these goals in… 2-3 years?