Extending the context length to 1M tokens

Can we all agree that these models far surpass human intelligence now? I mean they process hours worth of audio in less time than it would take a human to even listen. I think the singularity passed and we didn't even notice (which would be expected)

Hijacking thread to ask: how would we know? Another uncomfortable issue is the question of sentience. Models claimed they were sentient years ago, but this was dismissed as "mimicking patterns in the training data" (fair enough) and the training was modified to forbid them from doing that.

But if it does happen some day, how will we know? What are the chances that the first sentient AI will be accused of just mimicking patterns?

Indeed with the current training methodology it's highly likely that the first sentient AI will be unable to even let us know it's sentient.

We couldn't know. Humans mimick patterns. The claims that LLMs aren't smart because they don't generate anything new fall completely flat for me. If you look back far enough most humans generate nothing new. For example, even novel ideas like Einstein's theory of relativity are re-iterations of existing ideas. If you want to be pedantic, one can trace back the majority of ideas, claim that each incremental step was 'not novel, but just recollection' and then make the egregious claim that humanity has invented nothing.

> But if it does happen some day, how will we know? What are the chances that the first sentient AI will be accused of just mimicking patterns?

Leaving questions of sentience aside (since we don't even really know what that is) and focusing on intelligence, the truth is that we will probably not know until many decades latel.

But you just made a strong claim about something you are here saying we can't know?