←back to thread

AI companies cause most of traffic on forums

(pod.geraspora.de)
770 points ta988 | 1 comments | 30 Dec 24 14:37 UTC | HN request time: 0s | source
Show context
johng ◴[30 Dec 24 14:40 UTC] No.42549646[source]▶
If they ignore robots.txt there should be some kind of recourse :(
replies(5): >>42550889 #>>42550903 #>>42550975 #>>42551033 #>>42551045 #
stainablesteel ◴[30 Dec 24 16:54 UTC] No.42551045[source]▶
court ruling a few years ago said it's legal to scrape web pages, you don't need to be respectful of these for any purely legal reasons

however this doesn't stop the website from doing what they can to stop scraping attempts, or using a service to do that for them

replies(1): >>42551101 #
yodsanklai ◴[30 Dec 24 17:00 UTC] No.42551101[source]▶
> court ruling

Isn't this country dependent though?

replies(3): >>42551373 #>>42551880 #>>42552146 #
1. stainablesteel ◴[30 Dec 24 18:10 UTC] No.42551880[source]▶
yes! good point, you may be able to skirt around rules with a VPN if you're imposed by any