←back to thread

AI companies cause most of traffic on forums

(pod.geraspora.de)
770 points ta988 | 7 comments | 30 Dec 24 14:37 UTC | HN request time: 0.212s | source | bottom
Show context
johng ◴[30 Dec 24 14:40 UTC] No.42549646[source]▶
If they ignore robots.txt there should be some kind of recourse :(
replies(5): >>42550889 #>>42550903 #>>42550975 #>>42551033 #>>42551045 #
1. stainablesteel ◴[30 Dec 24 16:54 UTC] No.42551045[source]▶
court ruling a few years ago said it's legal to scrape web pages, you don't need to be respectful of these for any purely legal reasons

however this doesn't stop the website from doing what they can to stop scraping attempts, or using a service to do that for them

replies(1): >>42551101 #
2. yodsanklai ◴[30 Dec 24 17:00 UTC] No.42551101[source]▶
> court ruling

Isn't this country dependent though?

replies(3): >>42551373 #>>42551880 #>>42552146 #
3. lonelyParens ◴[30 Dec 24 17:26 UTC] No.42551373[source]▶
don't you know everyone on the internet is American
4. stainablesteel ◴[30 Dec 24 18:10 UTC] No.42551880[source]▶
yes! good point, you may be able to skirt around rules with a VPN if you're imposed by any
5. Aeolun ◴[30 Dec 24 18:35 UTC] No.42552146[source]▶
Enforcement is not. What does the US care for what an EU court says about the legality of the OpenAI scraper.
replies(2): >>42552543 #>>42553340 #
6. yodsanklai ◴[30 Dec 24 19:23 UTC] No.42552543{3}[source]▶
I understand there's a balance of power, but I was under the impression that US tech companies were taking EU regulations seriously.
7. okanat ◴[30 Dec 24 20:49 UTC] No.42553340{3}[source]▶
They can charge the company continuously growing amounts in the EU and even ban a complete IP block if they don't fix their behavior.