←back to thread

770 points ta988 | 1 comments | | HN request time: 0s | source
Show context
mentalgear ◴[] No.42551541[source]
Note-worthy from the article (as some commentators suggested blocking them).

"If you try to rate-limit them, they’ll just switch to other IPs all the time. If you try to block them by User Agent string, they’ll just switch to a non-bot UA string (no, really). This is literally a DDoS on the entire internet."

replies(5): >>42551717 #>>42551976 #>>42552122 #>>42552700 #>>42552885 #
loeg ◴[] No.42552122[source]
I'd kind of like to see that claim substantiated a little more. Is it all crawlers that switch to a non-bot UA, or how are they determining it's the same bot? What non-bot UA do they claim?
replies(3): >>42552172 #>>42552177 #>>42555570 #
alphan0n ◴[] No.42555570[source]
I would take anything the author said with a grain of salt. They straight up lied about the configuration of the robots.txt file.

https://news.ycombinator.com/item?id=42551628

replies(2): >>42563001 #>>42567297 #
mplewis ◴[] No.42563001[source]
What is causing you to be so unnecessarily aggressive?
replies(1): >>42563372 #
alphan0n ◴[] No.42563372{3}[source]
Liars should be called out, necessarily. Intellectual dishonesty is cancer. I could be more aggressive if it were something that really mattered.
replies(1): >>42563585 #
nkrisc ◴[] No.42563585{4}[source]
Lying requires intent to deceive. How have you determined their intent?
replies(2): >>42563774 #>>42563827 #
n144q ◴[] No.42563774{5}[source]
> Lying requires intent to deceive

Since when do we ask people to guess other people's intent when they have better things to show, which is called evidence?

Surely we should talk about things with substantiated matter?

replies(1): >>42565949 #
1. nkrisc ◴[] No.42565949{6}[source]
Because there’s a meaningful difference between being wrong and lying.

There’s evidence the statement was false, no evidence it was a lie.