How to Scrape YouTube in 2025
Learn how to scrape YouTube, channel, video, and comment data using Python directly in JSON.| ScrapFly Blog
Learn how to scrape YouTube, channel, video, and comment data using Python directly in JSON.| ScrapFly Blog
Learn how to access Google Scholar data without an official API. Explore alternatives and the best methods for scientific data automation.| ScrapFly Blog
Introduction to web scraping with Python and BeautifulSoup - popular HTML parsing library used in scraping. How to find text in scraped web data.| ScrapFly Blog
In this article we explore proxy rotation. How does it affect web scraping success and blocking rates and how can we smartly distribute our traffic through a pool of proxies for the best results.| ScrapFly Blog
Introduction to xpath in the context of web-scraping. How to extract data from HTML documents using xpath, best practices and available tools.| ScrapFly Blog
Introduction to using CSS selectors to parse web-scraped content. Best practices, available tools and common challenges by interactive examples.| ScrapFly Blog
Selenium and Python tutorial for web scraping dynamic, javascript powered websites using a headless Chrome webdriver. Real life example project.| ScrapFly Blog
Puppeteer and nodejs tutorial (javascript) for web scraping dynamic web pages and web apps. Tips and tricks, best practices and example project.| ScrapFly Blog
Playwright is the new, big browser automation toolkit - can it be used for web scraping? In this introduction article, we'll take a look how can we use Playwright and Python to scrape dynamic websites.| ScrapFly Blog
Introduction to proxy usage in web scraping. What types of proxies are there? How to evaluate proxy providers and avoid common issues.| ScrapFly Blog
Tutorial on how to avoid web scraper blocking. What is javascript and TLS (JA3) fingerprinting and what role request headers play in blocking.| ScrapFly Blog
Tutorial for web scraping X.com (Twitter) post and user data using Python, playwright and background request capture technique. Tweet scraping.| ScrapFly Blog
Hands on tutorial on scraping Realtor.com using Python. How to scrape property information, pricing and track real-time updates and changes.| ScrapFly Blog
Tutorial on how to scrape instagram.com user and post data using pure Python. How to scrape instagram without loging in or being blocked.| ScrapFly Blog
In this scrapeguide we're taking a look at Etsy.com - a popular e-commerce market for hand crafted and vintage items. We'll be using Python and HTML parsing to scrape search and product data.| ScrapFly Blog
Cloudflare offers one of the most popular anti scraping service, so in this article we'll take a look how it works and how to bypass it.| ScrapFly Blog
How IP addresses are used in web scraping blocking. Understanding IP metadata and fingerprinting techniques to avoid web scraper blocks.| ScrapFly Blog
Learn how to scrape dynamic web pages with Scrapy Selenium and how to use it for waiting for elements, clicking buttons and scrolling.| ScrapFly Blog
Tutorial on scraping dynamic web pages with Scrapy Splash. Learn installation, navigation and step-by-step guide for using Scrapy Splash.| ScrapFly Blog
How to parse XML using CSS selectors, XPath and language native tools in Python, Php, javascript and other languages. Complete XML parsing guide.| ScrapFly Blog
How to bypass CAPTCHA by improving and securing connection details. How to avoid catpcha web web scraping and what are different captcha types.| ScrapFly Blog
Tutorial on how to scrape G2.com using Python. Scrape reviews, company data, search pages, product data and alternatives without being blocked.| ScrapFly Blog
Introduction to web honeypots, their types and functions and how they are used to identify and block web scrapers and bots and how to avoid them.| ScrapFly Blog
In this article we'll be taking a look at several ways to hide IP addresses: proxies, tor networks, vpns and other techniques.| ScrapFly Blog
We're taking yet another look at real estate websites. This time we're going down under! Realtestate.com.au is the biggest real estate portal in Australia and let's take a look at how to scrape it.| ScrapFly Blog
Tutorial for cookies in web scraping. What are they and how to take advantage of cookie process to authenticate or set website preferences.| ScrapFly Blog
Tutorial on web scraping hidden APIs. How dynamic websites load content through background request and how to see it and replicate it in Python.| ScrapFly Blog
A guide on using User-Agent headers for web scraping. How to set and rotate user agent headers in web scraping to avoid web scraping blocking.| ScrapFly Blog
Web scraping project for scraping e-commerce data and observing market trends using visualization graphs and plots for free.| ScrapFly Blog
Complete cheatsheet for all CSS selector functions for HTML parsing with real-life interactive examples and detailed explanations.| ScrapFly Blog
