←back to thread

597 points classichasclass | 1 comments | | HN request time: 0s | source
Show context
that_lurker ◴[] No.45011319[source]
Why not just block the User Agent?
replies(4): >>45011848 #>>45012056 #>>45012119 #>>45013130 #
arewethereyeta ◴[] No.45013130[source]
Because it's the single most falsifiable piece of information you would find on ANY "how to scrape for dummies" article out there. They all start with changing your UA.
replies(1): >>45017778 #
1. ryantgtg ◴[] No.45017778[source]
Sure, but the article is about a bot that expressly identifies itself in the user agent and its user agent name contains a sentence suggesting you block its ip if you don’t like it. Since it uses at least 74 ips, blocking its user agent seems like a fine idea.