←back to thread

Will We Run Out of Data? Limits of LLM Scaling Based on Human-Generated Data

(epochai.org)
56 points trott | 1 comments | 18 Jun 24 02:04 UTC | HN request time: 0.246s | source
Show context
_boffin_ ◴[18 Jun 24 06:02 UTC] No.40714494[source]▶
The amount of data that all the different government agencies has tucked away in their different file cabinets has to be magnitudes more than what's on the public internet. The amount of data in the military... i couldn't even fathom.

One data source i've been thinking about that i don't know if they've hit yet is all the different agencies local and state agencies and their private and public meetings, ordinances, discourse, etc...

replies(2): >>40715221 #>>40716466 #
1. freilanzer ◴[18 Jun 24 08:02 UTC] No.40715221[source]▶
> The amount of data that all the different government agencies has tucked away in their different file cabinets has to be magnitudes more than what's on the public internet. The amount of data in the military... i couldn't even fathom.

Definitely not when it comes to text. The internet is the largest resource. I'd like to see all books in the Vatican digitalised, if they're not already - probably not though.