←back to thread

Nepenthes is a tarpit to catch AI web crawlers

(zadzmo.org)
646 points blendergeek | 1 comments | 16 Jan 25 13:57 UTC | HN request time: 0.211s | source
Show context
hubraumhugo ◴[16 Jan 25 20:02 UTC] No.42730154[source]▶
The arms race between AI bots and bot-protection is only going to get worse, leading to increasing infra costs while negatively impacting the UX and performance (captchas, rate limiting, etc.).

What's a reasonable way forward to deal with more bots than humans on the internet?

replies(4): >>42730177 #>>42730252 #>>42730433 #>>42743430 #
1. tremon ◴[17 Jan 25 21:25 UTC] No.42743430[source]▶
For me, this would finally be a good use case for bitcoin or similar digital transactions. Let the client provide either proof-of-work or proof-of-payment. If we can make the proof of work match the browsing speed of an average human, anything accessing more pages than that will need to provide payment instead.