←back to thread

Blocking LLM crawlers without JavaScript

(www.owl.is)
198 points todsacerdoti | 3 comments | 15 Nov 25 23:30 UTC | HN request time: 0.604s | source
1. superkuh ◴[16 Nov 25 01:50 UTC] No.45942050[source]▶
I thought this was cool because it worked even in my old browser. So cool I went to add their RSS feed to my feed reader. But then my feed reader got blocked by the system. So now it doesn't seem so cool.

If the site author reads this: make an exception for https://www.owl.is/blogg/index.xml

This is a common mistake and the author is in good company. Science.org once blocked all of their hosted blogs' feeds for 3 months when they deployed a default cloudflare setup across all their sites.

replies(1): >>45943679 #
2. gizzlon ◴[16 Nov 25 08:54 UTC] No.45943679[source]▶
Is this a mistake by the author or a bug in the feed reader? I guess it followed a link it shouldn't have?
replies(1): >>45954100 #
3. superkuh ◴[17 Nov 25 14:53 UTC] No.45954100[source]▶
A mistake by the author. I tried 3 feed readers, including one I wrote myself. None of them were following links. They just don't support cookies. There is more to the web than just browsers.