←back to thread

137 points bradt | 1 comments | | HN request time: 0.211s | source
Show context
visarga ◴[] No.45084809[source]
The content is now created in private chats with AI, probably a trillion tokens per day flow between humans and LLMs. When new AI models are made they will incorporate some experience from past usage. This dataset might be the most valuable source for training AI and solving our tasks. So in case humans decide to abandon publishing, there is a new experience flywheel spinning up.
replies(3): >>45084967 #>>45085233 #>>45089835 #
_DeadFred_ ◴[] No.45089835[source]
So they will learn on the hallucinations they told to people? Sounds like a sound system.
replies(1): >>45093314 #
1. visarga ◴[] No.45093314[source]
What happens when AI helps you on a task? You usually use its outputs to do something, and if that works, you come back for further assistance. If it doesn't work, you come back to correct the model. Either way a signal from the real world gets captured in the chat logs.

When AI provides a response it is possible to judge that response in hindsight. You look at the next 20 messages or sessions from next days and judge based on what followed. The chat logs provide a way to do long range credit assignment.