> They haven't even translated non-English material and mixed it all in yet (that I know of)
The current performance of LLMs on non-English languages is disappointing. Feeding it more non-English material is not going guaranteed to help.
> This is big because it would hold novel data the West doesn't access. What is the 'mood' of the average Chinese farmer on Taiwan.
The average Chinese farmer does not produce textual output of that kind. It is generally not advisable to put your thoughts in writing in oppressive regimes. It could be a life-ending mistake.
> Otherwise it's hard to see how adding more text of the same thing is going to create a revolution.
The LLM gang are like the people who think they can get slimmer by eating more.
> Video will be something new. But if like "Her" it watches every Twitch stream simultaneously for a month, and is talking to a billion people for a month and still doesn't get it what else is going to happen?
Since when does Twitch carry broadcasts that have any value to humanity? Is it used to hold scientific discussions? Or for shooting shit and pushing paid products and services?