Index URLs in a Sitemap

If you regularly update your Sitemaps to include links to new content, you can ask Google to periodically access your Sitemaps to discover and crawl new links.

Before requesting indexing of URLs in a Sitemap, check the following:

  • To submit a Sitemap for a site, you must be a verified owner of that site. If you don't already have a Webmaster Tools account, add your site to Google Webmaster Tools. You should do this using the same Google Account you use for Custom Search. Alternatively, another site owner can add you as an owner. Make sure to add and verify all your sites, including subdomains. You should do this using the same Google Account you use for Custom Search. Alternatively, another site owner can add you as an owner.
  • Create an XML Sitemap listing the pages you want Google to index on demand. In its simplest form, a Sitemap is a list of URLs on your site, although you can also use Sitemaps to give search engines additional information about your content. You must be a verified owner of all the sites and URLs listed in your Sitemap. You can submit multiple Sitemaps using Webmaster Tools, but all the URLs you want indexed immediately must be listed in a single Sitemap. Create a Sitemap.
  • Upload your Sitemap to your server and submit it using Webmaster Tools. You can also submit using robots.txt and ping, but submitting using Webmaster Tools gives you access to Google diagnostic data, which can be very useful in troubleshooting problems.

Request indexing of URLs in a Sitemap:

  1. On the Control Panel, on the left-hand menu, click Indexing.
  2. Click URLs in a Sitemap.
  3. In the text box, select the Sitemap you want to use.

    If you haven’t submitted a Sitemap yet, select New Sitemap, and then type the URL to your Sitemap location. Custom Search will retrieve and verify your Sitemap.

  4. Click Index Now.

You should start to see these pages included in your custom search results within a few hours; all the pages from the Sitemap should be available in to your custom search engine within 24 hours, provided that the number of pages is within your indexing quota. If your URLs aren’t indexed, see possible reasons why.

If your Sitemap contains more pages than your quota allows, Google will prioritize the pages according to the information in your Sitemap. More information about setting the priority of URLs..

Updating your Sitemap

In order to include new pages or change the pages you've selected for on-demand indexing, you need to either upload a new Sitemap or update your existing Sitemap, and then request indexing again.