←back to thread

Curl-impersonate: Special build of curl that can impersonate the major browsers

(github.com)
545 points mmh0000 | 3 comments | 03 Apr 25 15:24 UTC | HN request time: 0.002s | source
Show context
davidsojevic ◴[03 Apr 25 23:26 UTC] No.43576680[source]▶
There's a fork of this that has some great improvements over to the top of the original and it is also actively maintained: https://github.com/lexiforest/curl-impersonate

There's also Python bindings for the fork for anyone who uses Python: https://github.com/lexiforest/curl_cffi

replies(3): >>43578994 #>>43580445 #>>43583614 #
nyanpasu64 ◴[04 Apr 25 06:37 UTC] No.43578994[source]▶
I suppose it does make sense that a "make curl look like a browser" program would get sponsored by "bypass bot detection" services...
replies(1): >>43581862 #
ImHereToVote ◴[04 Apr 25 13:14 UTC] No.43581862[source]▶
Easy. Just make a small fragment shader to produce a token in your client. No bot is going to waste GPU resources to compile your shader.
replies(4): >>43582452 #>>43583572 #>>43584954 #>>43601084 #
gruez ◴[04 Apr 25 16:48 UTC] No.43584954[source]▶
Can't they use a software renderer like swiftshader? You don't need to pass in an actual gpu through virtio or whatever.
replies(1): >>43586275 #
ImHereToVote ◴[04 Apr 25 18:46 UTC] No.43586275[source]▶
Maybe you can call a WebGL extension that isn't supported. Or better yet have a couple of overdraws of quads. Their bot will handle it, but it will throttle their CPU like gangbusters.
replies(1): >>43587091 #
gruez ◴[04 Apr 25 20:04 UTC] No.43587091[source]▶
Sounds like a PoW system with extra steps?
replies(1): >>43591457 #
ImHereToVote ◴[05 Apr 25 06:50 UTC] No.43591457[source]▶
It's exactly a PoW system, but with fewer steps. Most bots can't run GPU workloads. Some do, and that's fine.
replies(1): >>43612125 #
1. salawat ◴[07 Apr 25 14:44 UTC] No.43612125[source]▶
My hardware is not yours to galavant in, and your fitzing around in my digital home for your server's sake just lays bare you are being self-referentially inconsistent. You value the sanctity of your hardware, not mine.

You may not realize it, but you're sounding exactly like part of the problem here.

replies(2): >>43613248 #>>43615082 #
2. ImHereToVote ◴[07 Apr 25 16:31 UTC] No.43613248[source]▶
I don't think running a fragment to calculate one blit operation isn't doing anything to the "sanctity of your machine". Believe me, Chrome abuses your GPU much more than that. Turn off JavaScript if it bothers you so much. You won't be missed.
3. ◴[07 Apr 25 19:39 UTC] No.43615082[source]▶