Index Status report

The Index Status report provides data about the URLs that Google tried to index in the current property for the the past year. More information about how Google crawls and indexes the web.

 

Open the Index Status report

What's in the Index Status report

The basic view of the data shows only the total indexed value. The advanced view shows additional data.

  • Total indexed URLs in your site
    Shows the total URLs available to appear in search results, along with other URLs Google might discover by other means. This number changes over time as you add and remove pages. The number of indexed URLs is almost always significantly smaller than the number of crawled URLs, because Total indexed excludes URLs identified as duplicatesnon-canonical, or those that contain a meta noindex tag.
     
  • URLs blocked by robots.txt
    The total number of URLs disallowed from crawling by your robots.txt file. If your site is very big, you might want to hide other data so that the graph is scaled to a readable range. 
     
  • URLs removed
    The number of URLs you have removed with the URL removal tool.  Again, this value should be quite low in comparison to the other URLs in this report, so it's easier to view this selection by itself rather than in comparison with other URLs.

How to use the Index Status report

  • Look for a steady rise in the graph. A steady increase in the number of crawled and indexed pages indicates that Google can regularly access your content, and that your site is being indexed.
     
  • Check into sudden drops. If you see a sudden drop in the number of indexed pages, it might mean that your server is down or overloaded, or that Google is having trouble accessing your content.
     
  • Make note of unusually high index volume for your site. A high number of URLs could mean that your site has problems with canonicalization, duplicate content, or automatically generated pages, or that it has been hacked. In many cases, Google will send you a message when we detect problems with your site, so make sure to set your notification preferences.
     
  • Review sudden changes. Spikes or dips that appear in several charts can indicate problems with site configuration, redirects, or security.

Your site's index status and its Google Search results

Sometimes the data we show in Index Status is not fully reflected in Google Search results. In some cases, Google may apply filters while building search results, and these filters can affect which results are shown in search. Filters include removal of pages due to legal reasons or by webmaster request, results from websites that we think are currently unavailable, and results removed due to manual spam action.

Since these filters are usually applied due to temporary urgent issues, or are requested by mistake, Google may in some cases retain the pages in our index for a period of time to help websites recover quickly after the issue is fixed (for example, after the site becomes available again). 

Was this article helpful?