←back to thread

646 points blendergeek | 1 comments | | HN request time: 0.28s | source
1. yapyap ◴[] No.42741789[source]
very nice, I remember seeing a writeup on someone that had basically done the same thing as a coding test or something of the like (before LLM crawlers) was catching / getting harassed by LLMs ignoring the robots.txt to scrape his website. on accident of course since he had made his website before the times of LLM scraping