In this Help Centre, you can find content for both Merchant Center Next and the classic Merchant Center experience. Look for the logo at the top of each article to make sure that you're using the article for the Merchant Center version that applies to you. 

About the Google StoreBot crawler

A custom icon for Merchant Center Classic article header.

The Google StoreBot is a search-engine-based program that automatically 'crawls' through web pages to gather and analyse data. Google uses crawlers that go through product pages and checkout processes using machine learning algorithms to fill in forms with information such as delivery addresses, and help compile other information on price, delivery, payments and more.

On this page

How does Google access your site?

The Google StoreBot crawls through certain types of pages, including, but not limited to, product details pages, basket pages and checkout pages. If you notice a user in your weblogs identified as 'StoreBot-Google', or a user with the first name 'Google' and the last name 'StoreBot' advancing through your checkout process without making a purchase, this is probably the crawler.

What information does Google extract?

The crawler tries to go through your entire checkout flow, from the product details page, to the basket page and into the checkout page. It catalogues all relevant data from this process, including:

  • Shipping price
  • Product price
  • Delivery and tax prices
  • Online and local availability
  • Validity of coupons
  • Delivery time
  • Delivery countries
  • Logistics
  • Payment methods
  • Secure address or payment
  • Shopping framework
  • Affiliate domains
  • Contact information
  • Meta information

How does Google use the information?

The information that Google StoreBot gathers is used to enhance the user experience and increase the number of relevant customers who visit your page from Google. It allows Google to verify information that you share through Merchant Center, and helps you keep your data more accurate and up to date.

What if you need to correct or remove information extracted by the crawler?

You can provide more accurate information by adding structured data to your pages as well as to Merchant Center, which takes precedence over what is extracted by the crawler. Allowing the crawler access to your pages is highly encouraged, but if you don't have a Google Merchant Center account and have a reason to prevent StoreBot-Google from crawling your data, you have a number of options.

Related link

Was this helpful?

How can we improve it?
Clear search
Close search
Google apps
Main menu
Search Help Centre