You can check if a web crawler really is Googlebot (or another Google user agent). Follow these steps to verify that Googlebot is the crawler.| Google for Developers
A sitemap provides information that helps Google more intelligently crawl your site. Discover how a sitemap works and determine if you need one.| Google for Developers
Explore video best practices, including video structured data, to help increase the likelihood that your video will be displayed in search results.| Google for Developers
Robots.txt is used to manage crawler traffic. Explore this robots.txt introduction guide to learn what robot.txt files are and how to use them.| Google for Developers
Google supports several sitemap formats. Follow this guide to learn about formats, how to build a sitemap, and how to submit a sitemap to Google.| Google for Developers
