Nearly 90% of our AI crawler traffic is from ByteDance h haproxy.com 95 jcat123 2 years ago 43 comments
HAProxy Enterprise 2.9 adds UDP, high performance WAF and Bot Management h haproxy.com 7 jcat123 2 years ago 1 comments
It is not. We rely on more than User Agents because they are too often faked, so it is not just marketing. There are other signals we see that confirm whether the request came from a "legitimate" AI scraper, or a different scraper with the same user agent.