Login
From:
The Cloudflare Blog
(Uncensored)
subscribe
Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives
https://blog.cloudflare.com/perplexity-is-using-stealth-undeclared-crawlers-to-evade-website-no-crawl-directives/
links
backlinks
Tagged with:
security
ai
networking
bots
generative ai
threat intelligence
ai bots
bot management
cloudforce one
Perplexity is repeatedly modifying their user agent and changing IPs and ASNs to hide their crawling activity, in direct conflict with explicit no-crawl preferences expressed by websites.
Roast topics
Find topics
Find it!
