←back to thread

AI scrapers request commented scripts

(cryptography.dog)
255 points ColinWright | 3 comments | 31 Oct 25 15:44 UTC | HN request time: 0.862s | source
Show context
bakql ◴[31 Oct 25 18:41 UTC] No.45775259[source]▶
>These were scrapers, and they were most likely trying to non-consensually collect content for training LLMs.

"Non-consensually", as if you had to ask for permission to perform a GET request to an open HTTP server.

Yes, I know about weev. That was a travesty.

replies(15): >>45775283 #>>45775392 #>>45775754 #>>45775912 #>>45775998 #>>45776008 #>>45776055 #>>45776210 #>>45776222 #>>45776270 #>>45776765 #>>45776932 #>>45777727 #>>45777934 #>>45778166 #
1. j2kun ◴[31 Oct 25 21:31 UTC] No.45776932[source]▶
You should not have to ask for permission, but you should have to honestly set your user-agent. (In my opinion, this should be the law and it should be enforced)
replies(1): >>45785793 #
2. gkbrk ◴[01 Nov 25 21:58 UTC] No.45785793[source]▶
> In my opinion, this should be the law and it should be enforced

You think people should go to prison if they go to their browser settings and change their user agent?

replies(1): >>45787932 #
3. aendruk ◴[02 Nov 25 04:56 UTC] No.45787932[source]▶
Corporation, fined