←back to thread

Blocking LLM crawlers without JavaScript

(www.owl.is)
198 points todsacerdoti | 1 comments | 15 Nov 25 23:30 UTC | HN request time: 0.208s | source
Show context
bakigul ◴[16 Nov 25 10:59 UTC] No.45944142[source]▶
Why do people want to block LLM crawlers? Everyone wants to be visible in GPT, Claude, and others, don’t they?
replies(6): >>45944209 #>>45944222 #>>45944288 #>>45944466 #>>45946287 #>>45947378 #
1. aiven ◴[16 Nov 25 11:13 UTC] No.45944209[source]▶
- If LLM knows about your content, people don't really need to visit your site - LLM crawlers can be pretty aggressive and eat up a lot of traffic - Google will not suggest its misleading "summaries" from its search for your site - Some people just hate LLMs that much ¯\_(ツ)_/¯