←back to thread

Extending the context length to 1M tokens

(qwenlm.github.io)
114 points cmcconomy | 2 comments | 18 Nov 24 16:27 UTC | HN request time: 0.415s | source
Show context
anon291 ◴[18 Nov 24 17:49 UTC] No.42174879[source]▶
Can we all agree that these models far surpass human intelligence now? I mean they process hours worth of audio in less time than it would take a human to even listen. I think the singularity passed and we didn't even notice (which would be expected)
replies(11): >>42174949 #>>42174987 #>>42175002 #>>42175008 #>>42175019 #>>42175095 #>>42175118 #>>42175171 #>>42175223 #>>42175324 #>>42176838 #
1. achierius ◴[18 Nov 24 18:00 UTC] No.42175008[source]▶
In the same sense (though to greater extent) that calculators are, sure. Calculators can also far exceed human capacity to, well, calculate. LLMs are similar: spikes of capacity in various areas (bulk summarization, translation, general recall, ...) that humans could never hope to match, but not capable of beating humans at a more general range of tasks.
replies(1): >>42175037 #
2. anon291 ◴[18 Nov 24 18:02 UTC] No.42175037[source]▶
> humans could never hope to match, but not capable of beating humans at a more general range of tasks.

If we restrict ourselves only to language (LLMs are at a disadvantage because there is no common physical body we can train them on at the present moment... that will change), I think LLMs beat humans for most tasks.