←back to thread

AI companies cause most of traffic on forums

(pod.geraspora.de)
770 points ta988 | 1 comments | 30 Dec 24 14:37 UTC | HN request time: 0.001s | source
Show context
johng ◴[30 Dec 24 14:40 UTC] No.42549646[source]▶
If they ignore robots.txt there should be some kind of recourse :(
replies(5): >>42550889 #>>42550903 #>>42550975 #>>42551033 #>>42551045 #
stainablesteel ◴[30 Dec 24 16:54 UTC] No.42551045[source]▶
court ruling a few years ago said it's legal to scrape web pages, you don't need to be respectful of these for any purely legal reasons

however this doesn't stop the website from doing what they can to stop scraping attempts, or using a service to do that for them

replies(1): >>42551101 #
yodsanklai ◴[30 Dec 24 17:00 UTC] No.42551101[source]▶
> court ruling

Isn't this country dependent though?

replies(3): >>42551373 #>>42551880 #>>42552146 #
Aeolun ◴[30 Dec 24 18:35 UTC] No.42552146[source]▶
Enforcement is not. What does the US care for what an EU court says about the legality of the OpenAI scraper.
replies(2): >>42552543 #>>42553340 #
1. yodsanklai ◴[30 Dec 24 19:23 UTC] No.42552543[source]▶
I understand there's a balance of power, but I was under the impression that US tech companies were taking EU regulations seriously.