Official news on crawling and indexing sites for the Google index| Official Google Webmaster Central Blog
See whether Google can process your robots.txt filesThe robots.txt report shows which robots.txt files Google found for the top 20 hosts on your site, the last time they were crawled, and any warnings| support.google.com
Official news on crawling and indexing sites for the Google index| Official Google Webmaster Central Blog