Googlebot is the generic name of the web crawler used by Google Search. Discover what Googlebot is, how it accesses your site, and how to block Googlebot.| Google for Developers
Google crawlers discover and scan websites. This overview will help you understand the common Google crawlers including the Googlebot user agent.| Google for Developers