Common Crawl - Blog - Common Crawl Foundation Opt-Out Registry
Publishers have been sending Common Crawl legal opt-out requests. In the interest of transparency and to better serve our ecosystem, we are publishing the full opt-out list for every legal request we have received.| commoncrawl.org
