←back to thread

Nepenthes is a tarpit to catch AI web crawlers

(zadzmo.org)
714 points blendergeek | 1 comments | 16 Jan 25 13:57 UTC | HN request time: 0.207s | source
1. griomnib ◴[16 Jan 25 23:43 UTC] No.42732402[source]▶
A simpler approach I’m considering is just sending 100 garbage HTTP requests for each garbage HTTP request they send me. You could just have a cron job parse the user agents from access logs once an hour and blast the bastards.