Last year, Robb Knight figured out how Perplexity, an artificial intelligence search engine, was evading instructions not to crawl particular sites. Knight learned that Perplexity’s engine would use an unlisted user agent to scrape summaries of pages on websites where Perplexity was blocked. In my testing, I found the summaries were outdated by hours-to-days, indicating […]| pxlnv.com
Notes to my future self about AI, the web, and what it means to keep making things.| jasonsantamaria.com
We Compared Eight AI Search Engines. They’re All Bad at Citing News.| Columbia Journalism Review
To help preserve a safe Internet for content creators, we’ve just launched a brand new “easy button” to block all AI bots. It’s available for all customers, including those on our free tier.| The Cloudflare Blog
As AI displaces search, AI-optimized content will displace SEO. Here's how.| Fermyon • Experience the next wave of cloud computing.
The AI regulator’s toolbox: A list of concrete AI governance practices| adamjones.me
In the last year, the number of websites specifically restricting OpenAI and other AI scraper bots has gone through the roof.| 404 Media
After reading an excellent blog post last week, followed by some news stories, I decided to have a play around with Perplexity.AI to see whether I could reproduce what was reported. However, I got a l| www.bentasker.co.uk
