Search Images Maps Play YouTube News Gmail Drive More »
Sign in

Health

Index status

The Index Status page provides stats about how many of your URLs Google was able to crawl and/or index. More information about how Google crawls and indexes the web.

View the Index Status page:

  1. On the Webmaster Tools home page, click the site you want.
  2. On the Dashboard, click Health, and then click Index Status.

The Basic tab displays the following data:

  • Total indexed: The total number of URLs currently in Google's index. These URLs are available to appear in search results, along with other URLs Google may discover by other means. This number will change over time, as new pages are added and indexed, and old pages are removed. The number of indexed URLs is almost always significantly smaller than the number of crawled URLs, because it does not include URLs that have been identified as duplicates or non-canonical, or less useful, or that contain a meta noindex tag.

To see basic data plus additional useful information, click Advanced. Click the checkbox next to the data you want, and then click Update. The following additional data is available:

  • Ever crawled: The cumulative total of URLs on your site that Google has ever crawled. Not all crawled URLs get indexed, and Google may discover some URLs by other means such as inbound links from other sites. This number should increase over time as new pages are added to your site.
  • Blocked by robots: The total number of URLs that Google cannot crawl because they are disallowed in your robots.txt file.

How to use this data

  • A steady increase in the number of crawled and indexed pages indicates that Google can regularly access your content, and that your site is being indexed.
  • If you see a sudden drop in the number of indexed pages, it may mean that your server is down or overloaded, or that Google is having trouble accessing your content.
  • A high number of duplicate pages could mean that your site has problems with canonicalization, duplicate content, or automatically generated pages, or that it has been hacked. In many cases, Google will send you a message when we detect problems with your site, so make sure to set your notification preferences.
  • Try comparing data:
    • To see the percentage of your site that’s accessible to Google, compare the number of crawled pages with the number of pages blocked by robots.txt.
    • Sudden spikes or dips that appear in several charts can indicate problems with site configuration, redirects, or security.

Filters affecting Google search results

In some cases, Google may apply filters while building search results, and these filters can affect which results are shown. Filters include removal of pages due to legal reasons or by webmaster request, results from websites that we think are currently unavailable ("down"), and results removed due to manual spam action.

Since these applied filters are usually due to temporary urgent issues, or are requested by mistake, Google may in some cases retain the pages in our index for a period of time to help websites recover quickly after the issue is fixed (for example, after the site becomes available again). Because of this the data we show in Index Status may not be fully reflected in our search results.

updated 02/07/2013