←back to thread

AI web crawlers are destroying websites in their never-ending content hunger

(www.theregister.com)
211 points CrankyBear | 3 comments | 02 Sep 25 16:24 UTC | HN request time: 0s | source
Show context
verdverm ◴[02 Sep 25 17:32 UTC] No.45106317[source]▶
At the same time, a lot of HN push back for new solutions like Signed Agents by CF

https://news.ycombinator.com/item?id=45066258

replies(1): >>45106383 #
fruitworks ◴[02 Sep 25 17:36 UTC] No.45106383[source]▶
Because it's a bad solution. The core problem is that the internet is vulnerable to DDoS attacks and the web has no native sybil resistance mechanism.

Cloudflare's solution to every problem is to allow them to control more of the internet. What happens when they have enough control to do whatever they want? They could charge any price they want.

replies(2): >>45106470 #>>45106563 #
1. add-sub-mul-div ◴[02 Sep 25 17:42 UTC] No.45106470[source]▶
I'm more afraid of the orgs that are gaining enough control of knowledge, cognition, and creativity that they'll be able to charge any price for them once they've trained us out of practicing them ourselves.
replies(1): >>45106548 #
2. fruitworks ◴[02 Sep 25 17:46 UTC] No.45106548[source]▶
There Is No Moat
replies(1): >>45107233 #
3. wongarsu ◴[02 Sep 25 18:38 UTC] No.45107233[source]▶
Until crawling without being on people's whitelist becomes sufficiently difficult