A web scraper's guide to understanding the placement of anti-bot systems.| substack.thewebscraping.club
What's a proxy, how many different types are available and how they work?| substack.thewebscraping.club
I’m co-founder of Data Boutique and RE Analytics, and since 2009 we’ve been at the forefront of web scraping, helping some of the world’s largest companies with sustainable and reliable access to critical web data.| substack.thewebscraping.club
HTTP/2 fingerprinting is a method by which web servers can identify which client is sending the request to them1. It can identify the browser type and version, for instance, or whether a script is used. The method relies on the internals of the HTTP/2 protocol which are less widely known that those of its simpler predecessor HTTP/1.1. In this post I will first give a short description of the HTTP/2 protocol, then provide details on how a web server can use the protocol’s various parameters ...| lwt hiker