Allow access through your robots.txt file

To allow Google access your content, make sure that your robots.txt file allows user-agents "Googlebot", "AdsBot-Google", and "Googlebot-Image" to crawl your site. You can do this by adding the following lines to your robots.txt file:

User-agent: Googlebot
Disallow:

User-agent: AdsBot-Google
Disallow:

User-agent: Googlebot-Image
Disallow:

Learn more about the Robot Exclusion Protocol.

Was this helpful?
How can we improve it?