If you would like to grant our crawler access to your pages, you can do so without granting permission to any other bots. Simply add the following two lines of text to the top of your robots.txt file:
User-agent: Mediapartners-Google
Disallow:
This change will allow our crawler to index the content of your site and provide you with the most relevant Google ads for that content.