Dummy's Guide to Modern LLM Sampling

Calling things modern that are updates to techniques to use technologies only invented a few years ago is borderline illiterate. Modern vs what, classical LLM sampling?

LLM are way older. The Nobel prize for it shows how they made many of the breakthroughs decades ago ChatGTP was the popular breakthrough. Even then your Smartphone keyboard has been using an LLM for a decade.

Many of these algorithms were invented in like 2019 (i.e. TFS) or even earlier (temperature)

> Calling things modern that are updates to techniques to use technologies only invented a few years ago is borderline illiterate.

If you’re going to make a criticism like that, you might want to check a dictionary first:

> modern, adj. designed and made using the most recent ideas and methods

— https://dictionary.cambridge.org/us/dictionary/english/moder...

That’s exactly what this article is describing. There’s been a lot of development in this space over the last seven years or so, and e.g. GPT 1, 2, and 3 are certainly very outdated at this point, i.e. not modern in the above sense.

Wow, so unmodern. Classic even.