←back to thread

Using Cloudflare on your website could be blocking RSS users

(openrss.org)
556 points campuscodi | 2 comments | 16 Oct 24 22:46 UTC | HN request time: 0.498s | source
Show context
whs ◴[17 Oct 24 08:35 UTC] No.41867572[source]▶
My company runs a tech news website. We offer RSS feed as any Drupal website would, which content farm just scrape our RSS feed to rehost our content in full. This is usually fine for us - the content is CC-licensed and they do post the correct source. But they run thousands of different WordPress instances on the same IP and they individually fetch the feed.

In the end we had to use Cloudflare to rate limit the RSS endpoint.

replies(2): >>41868962 #>>41869978 #
1. yjftsjthsd-h ◴[17 Oct 24 14:25 UTC] No.41869978[source]▶
> In the end we had to use Cloudflare to rate limit the RSS endpoint.

Isn't the correct solution to use CF to cache RSS endpoints aggressively?

replies(1): >>41877249 #
2. whs ◴[18 Oct 24 07:56 UTC] No.41877249[source]▶
We do both, but the enterprise plan isn't as unlimited as the self service plans so we need to limit them as well. (It's not a large site but the Cloudflare contract is for every affiliated companies - it is funny when we serve news of ongoing Cloudflare outages on Cloudflare Enterprise)