Welcome to AdSense Help Center. Due to the holiday season our support is currently unavailable from 17th December to 4th January. We encourage you to visit our Help Center and community forums for additional resources. We apologize for any inconvenience this may cause and appreciate your patience during this time.

/adsense/community?hl=en
/adsense/community?hl=en
3/26/15
Original Poster
Dr.Goodspeed

AdSense ads and DoubleClick links are blocked from being crawled

Hi,
 
My webmatertools shows some blocked resources when i check the blocked resourses, i am supprised becasue Googlebot can not crawl these two urls
 
http://pagead2.googlesyndication.com/pagead/show_ads.js
 
http://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js
 
Google's own urls "HOW". yes i am using adsense. When i fetch the page without ads its shows complete status. But when i fetch and render the page than its shows partial status and above two links are blocked. But when i check the robots.txt file its allowing the above urls.
 
My rebots.txt file include:
 
User-agent: *
Disallow:
 
i am using wordpress with sahifa themes. Plz help me what i do now.
Community content may not be verified or up-to-date. Learn more.
All Replies (7)
galeksic
3/26/15
galeksic
We shouldn't be surprised - fetch is OK, but we don't like tools which render our ads and we can consider "partial" status as "success" if show_ads.js and adsbygoogle.js are the only blocked resources.

(Pasting my answer from similar discussion.)

If "Fetch and render" would be allowed to access adsbygoogle.js, we would probably get one invalid impression every time when we use "Fetch and render". And I think that is not what we want.

Note that occasionally, blocked resources reside on other domains, which you might not be able to control. If important page content is missing due a blocked resource on another site, you might want to contact the resource owner to allow Google to access that resource. 

In this case, we don't need to contact the owner of pagead2.googlesyndication.com, because the blocked resource is important, but we don't want it to be fetched and rendered by bot. (It is an AdSense advertisement.)

blocked error in fetch and render
3/27/15
Original Poster
Dr.Goodspeed
Thanx galeksic for reply. Your point is valid but still have the question. Blocked resources pages are increased on every crawl please suggest anything how to unblock these resources. Thank you.
galeksic
3/27/15
galeksic
If show_ads.js and adsbygoogle.js are the only blocked resources that is fine, and we can't "unblock" them.

That is not a problem - they are just reported as "blocked", because Webmaster Tools client is actually blocked from pagead2.googlesyndication.com.
Akshat M
7/29/15
Akshat M
galeksic
7/29/15
galeksic
Same as above  (for show_ads.js and adsbygoogle.js) - it is correctly blocked:


And it is correctly reported as "blocked resource for Googlebot" in your Webmaster Tools Console.

If https://static.doubleclick.net/instream/ad_status.js is the only problem on your "Fetch and render" page, then you don't have any problem.
Akshat M
7/29/15
Akshat M
After a Cache Clear, the ad_status.js disappeared and is not appearing anymore.. Maybe because I had used this Domain for Verification of Adsense Account and do not currently have any codes on adsense.But, there is Persistent Issue:Sometimes, the Fetch & Render Yields Result as "Complete" but on the Other Occassions as "Partial" and then further mentions the Resources which could not be loaded with Error of "Temporarily Unreachable"Can you help me enlighten on why/how to resolve these Issues as No IP's are Blocked and Load Time is Good Enough.Since these are Temporary Unreachable Issues and Nothing Related to Robots.txt - Should I be worried on grounds of the New Warning from Google on "Googlebot cannot access CSS and JS files"Note: All CSS and JS Files are unblocked post receipt of mail from Google
galeksic
7/29/15
galeksic
In my understanding, Webmaster Central forum is the very right place for such question:
Were these replies helpful?
How can we improve them?
 
This question is locked and replying has been disabled. Still have questions? Ask the Help Community.

Badges

Some community members might have badges that indicate their identity or level of participation in a community.

 
Google Employee — Google product team members and community managers
 
Community Specialist — Google partners who help ensure the quality of community content
 
Platinum Product Expert — Community members with advanced product knowledge who help other Google users and Product Experts
 
Gold Product Expert — Community members with in-depth product knowledge who help other Google users by answering questions
 
Silver Product Expert — Community members with intermediate product knowledge who help other Google users by answering questions
 
Product Expert Alumni — Former Product Experts who are no longer members of the program
Community content may not be verified or up-to-date. Learn more.

Levels

Member levels indicate a user's level of participation in a forum. The greater the participation, the higher the level. Everyone starts at level 1 and can rise to level 10. These activities can increase your level in a forum:

  • Post an answer.
  • Having your answer selected as the best answer.
  • Having your post rated as helpful.
  • Vote up a post.
  • Correctly mark a topic or post as abuse.

Having a post marked and removed as abuse will slow a user's advance in levels.

View profile in forum?

To view this member's profile, you need to leave the current Help page.

Report abuse in forum?

This comment originated in the Google Product Forum. To report abuse, you need to leave the current Help page.

Reply in forum?

This comment originated in the Google Product Forum. To reply, you need to leave the current Help page.

false
Search
Clear search
Close search
Google apps
Main menu
Search Help Center
true
157
false