Karpathy on DeepSeek-OCR paper: Are pixels better inputs to LLMs than text?

Back before transformers, or even LSTMs, we used to joke that image recognition was so far ahead of language modeling that we should just convert our text to PDF and run the pixels through a CNN.