lwthiker
Joined 4 years ago
Karma
408
Submissions
11
Member since
Feb 11
[email protected]
View on Hacker NewsRecent submissions
Comment · 4 years ago
curl-impersonate[1] is a curl fork that I maintain and which lets you fetch sites while impersonating a browser. Unfortunately, the practice of TLS and HTTP fingerprinting of web clients has become extremely common in the past ~1 year, which means a regular curl request will often return some JS challenge and not the real content. curl-impersonate helps with that.
Comment · 4 years ago
For a while now I can't even access WhatsApp Web [1] through Firefox. It gets stuck on the loading page and keeps refreshing itself forever. I have to resort to Chrome whenever I need WhatsApp on my laptop.
Comment · 4 years ago
I think they have different plans and configurations for their anti-bot service [1]. I'm not sure though because I'm not using their services.
Comment · 4 years ago
They don't block you completely, just present you with a JS challenge that delays your access to the site. A browser, even if behind a MITM proxy, would be able to solve this challenge.
Comment · 4 years ago
I hope to do so in the future, for now the implementation is extremely hacky so I doubt it can get accepted into curl.
Comment · 4 years ago
I will try to impersonate Chrome next, However, I suspect this is going to be more challenging. Chrome uses BoringSSL, which curl does not support. So it means either enforcing curl to compile with BoringSSL or modifying NSS to look like BoringSSL.
Comment · 4 years ago
Thanks for the suggestion, I had no idea ESR was a thing. I've just added support for Firefox ESR 91 (it was pretty similar and required adding one cipher to the cipher list and changing the user agent).