←back to thread

Anthropic agrees to pay $1.5B to settle lawsuit with book authors

(www.nytimes.com)
989 points acomjean | 1 comments | 05 Sep 25 19:52 UTC | HN request time: 0.206s | source
Show context
bhaktatejas922 ◴[05 Sep 25 21:51 UTC] No.45144071[source]▶
This weirdly seems like its the best mechanism to buy this much data.

Imagine going to 500k publishers to buy it individually. 3k per book is way cheaper. The copyright system is turning into a data marketplace in front of our eyes

replies(2): >>45144124 #>>45144332 #
1. daemonologist ◴[05 Sep 25 22:20 UTC] No.45144332[source]▶
I suspect you could acquire and scan every readily purchasable book for much less than $3k each. Scanhouse for instance charges $0.15 per page for regular unbound (disassembled) books, plus $0.25 for supervised OCR, plus another dollar if the formatting is especially complex; this comes out to maybe $200-300 for a typical book. Acquiring, shipping, and disposing of them all would of course cost more, but not thousands more.

The main cost of doing this would be the time - even if you bought up all the available scanning capacity it would probably take months. In the meantime your competition who just torrented everything would have more high-quality training data than you. There are probably also a fair number of books in libgen which are out of print and difficult to find used.