(Part 2 now available: Automated Scraping with GPT-4, Part 2) Like most people I know, I’ve been watching the pace of improvements to LLMs like ChatGPT and GPT-4 with a mix of awe and trepidation. I’ve been wanting a small project to get to explore the APIs better, and recently decided I’d try to see if I could use it to automate web scraping. For context, I’ve written a lot of web scrapers. For the better part of thirteen years, I ran Open States, a project that scraped state legisla...
