Login
From:
Netlify Developers
(Uncensored)
subscribe
Block AI bots from crawling your Netlify site
https://developers.netlify.com/videos/block-ai-bots-from-crawling-your-netlify-site
links
backlinks
Roast topics
Find topics
Find it!
Learn how to tell AI bots not to crawl some or all of your website's data by adding a robots.txt file. And to cover those pesky bots that don't respect the robot rules, use a Netlify Edge Function to target user agent strings.
