Google appears to have stopped indexing blogspot.com new post as of 20 Oct3 Recommended Answers
My site's URL (web address) is: spanishfootballsports.blogspot.com
Description (including timeline of any changes made):
Google robot appear to have stopped indexing new posts on my blogspot BLOG as of 20 Oct. Until then it was almost immediate
Webmaster tool has a NDS timeout notice . But server is blogger ie Google . Is the problem there?
Last Cache : 19 Oct
Any replies guys? Totally buffled . I think its a google / blogger server problem that I hope will be fixed
Me too started facing this issue since 19-Oct-2010(Midnight IST) and I did extensive research on this and posted my findings in the thread.
Thread Link: http://www.google.com/support/forum/p/Webmasters/thread?tid=1ed8a63ec69d8257&hl=en
My major finding is that it is Blogger's internal bot that is failing to index the pages instantly not the Google Bot. If you wait for 1 or 2 days your pages will be indexed by Google Bot, but still your posts will not appear in the Goolge Blog Search API they will appear only in Google Web Search. As a result even Google bot indexes your new posts, still your new posts will not attract much traffic because they are not available for the Blogger Search API.
As per my experience Blogger Works this way.
1). When you start a new blog your pages will not be indexed by either Blogger Bot or Google Bot
2). After reaching certain posts/visits Blogger starts indexing your pages.
3). Once Blogger starts Indexing your blog all your subsequent new posts will be indexed instantly i.e. in less than 2 mins.
HOWEVER SINCE 19-OCT-2010 BLOGGER STOPPED INDEXING NEW POSTS OF THOUSANDS OF POPULAR BLOGS.
AT THE SAME TIME BLOGGER IS INDEXING THOUSANDS OF BLOGS WITHOUT ANY ISSUES AND THIS IS MAKING US CRAZY AND DONT KNOW WHY GOOGLE HAS TARGETED ONLY US NOT ALL. WE ARE NOT VIOLATING ANY TOC.
4). When the Blogger indexes your new posts instantly they will be available in the Blogger Index.
5). When you search in Google home page it will actually look into the Indexes created by Google Bot,Youtube Bot,Blogger Bot etc and fetches the results.
6). Normally many bloggers when they find their new posts instantly in Google Web search they assume that Google Bot indexed their new posts. This is wrong the new posts are actually indexed by Blogger internal Bot.
7). If Blogger Bot fails(This never happend with any blog in the past and started happening since 19-OCT-2010) to index your pages the Goolge Bot will still index your pages with out any issues. But depending on your blog's populatity it might take few hours to few weeks to be indexed by Google Bot.
8). The major advantage of the pages indexed by Blogger internal bot is that the posts will be available for both Google Web Search and Blogger Search API and this will acutally increase your traffic 10 fold.
Since 19-Oct-2010, I have posted 50 posts and none were got indexed by the Blogger internal bot, however due to the popularity of my blog the Google bot visits my blog every hour and indexes few posts. Like this out of 50 posts 47 are indexed by now, but still I am not getting significant traffic as these new posts are not available for the Blogger Search API.
Another strange thing that I have observed is that when Goolge Bot index your new blog posts it will not catche your pages assuming that Blogger has already catched the page. When new posts appear in the Google Search they do show the cathce link but when I click on it, it will say below message.
Your search - cache:DchG6HBba9MJ:blogposturl:serach key words - did not match any documents.
I have verified all my 47 pages indexed by Google bot and for all of them the Catche link is available but the Catche page is missing. I guess this is because it is assuming that Blogger has already stored the page but since the blogger failed to index our pages the Catche pages are not available. In the last couple of days the same issue was reported in many threads and they even provided the links to their posts. I could see that some of their pages are indexed by Google Bot after they reported the issue, but the Catche page is not available for these pages as well and also these pages are not appearing in the Blogger Search API results.
Also I did time line search using "Last 24hours" option in Google using the search string "anykeyword site:blogspot.com" and verified many blogs and found that there are many blogs affected by this issue, but not all.
Those who want to verify weather your posts are indexed by Blogger internal Bot or not they can visit the AJAX PLAYGROUND at http://code.google.com/apis/ajax/playground/?exp=search
and see weather your new posts are being fetched by the Blogger Search API.
I think in the next few days this forum will be flooded with similar issues as many bloggers will notice their traffic reaching ground zero and only Google Employees can answer why Blogger Stopped indexing the posts instantly since 19-Oct-2010 for many blogs.
Please let me know how can we inform this issue to the Google Employees.
Now I have two new blog articles that have yet to be indexed for today at http://www.azrainman.com/
I am thinking they are bogged down, which I hope is the case and not another bug,
Still occuring . Have another Blogspot BLOG & new posts there are not being indexed.
It "smells" like a Google problem.
Any Google rep available to confirm?
I realize that the glitch we saw last week seems to have chosesn a pretty confusing time, but from what I can tell this technical crawling / indexing issue is resolved.
In general, it is very valuable for us and the other experts here to be able to look at sites directly, at specific queries and specific pages within your sites. If you are seeing changes in ranking that you are having difficulties with, I would strongly suggest providing as much information as possible. The folks posting here will try to find the weak points of your sites and bring them to your attention: I realize that’s sometimes hard to listen to, but in the end, improving your site, weeding out the weak points or working to improve those parts is important. I see a lot of neat sites listed here, and I hear a lot of enthusiastic webmasters posting about issues they’re seeing here; directing that energy towards improving those sites is certain to make the sites even stronger and better than before.
With that, I’ll close this thread about this particular technical crawling/indexing issue from last week. There are a few other general issue threads, if you wish to post about changes in ranking (which are not related to this crawling/indexing issue) in a more general sense, feel free to discuss them there -- I’ll try to keep up there as well.
Thanks for all your feedback so far, it's been very valuable! Please keep it coming in the other threads :).
Some community members might have badges that indicate their identity or level of participation in a community.
Member levels indicate a user's level of participation in a forum. The greater the participation, the higher the level. Everyone starts at level 1 and can rise to level 10. These activities can increase your level in a forum:
- Post an answer.
- Having your answer selected as the best answer.
- Having your post rated as helpful.
- Vote up a post.
- Correctly mark a topic or post as abuse.
Having a post marked and removed as abuse will slow a user's advance in levels.
View profile in forum?
To view this member's profile, you need to leave the current Help page.
Report abuse in forum?
This comment originated in the Google Product Forum. To report abuse, you need to leave the current Help page.
Reply in forum?
This comment originated in the Google Product Forum. To reply, you need to leave the current Help page.