GPT is a very impressive technical achievement. But that technical achievement is more in the field of compression rather than intelligence.
replies(1):
Prediction is intelligence when you're able to do it well across disparate novel tasks.
(Of course definitions are idiosyncratic, but I'm curious if anyone disagrees with these ones.)
Depends on your definition of "intelligence". The big missing part is the ability to explore, try new things, to act (enactivism). Basically to become part of the environment, instead of being a sealed box with frozen weights.
By predicting characters, the system had to master, digest, maybe even understand, all the cultural human knowledge it got in text form. Now let's aim for the process that generated this knowledge in the first place.