/webmasters/community?hl=en
This content is likely not relevant anymore. Try searching or browse recent questions.
Google can't index my website anymore. Out of the blue.
1
Our website worked fine for a long time and was visible on Google for years now - last being indexed end of May. However, suddenly it is no longer indexable.

I do not have a robots.txt, no security plugins, and no sitemap - because we never needed one. 
It doesnt 

This is the error which comes up: 
URL is not on Google
This page is not in the index, but not because of an error. See the details below to learn why it wasn't indexed. 

Also, the website isn't accessible on the mobile Friendly google test page - Mobile-Friendly Test - Google Search Console

The website comes up just fine on Bing and other search engines - but no idea why its so on Google.

Following another post, I tried talking to our webhost and asking them to remove IPs from blacklists/add to whitelists any google bot IPs. They said they've done it, but I still cannot access the website either from the Live test on GSC or from the Mobile-Friendly test.

The only change was an addition of TXT record for email authentication via DMARC - I donot know if this will even affect indexing.

After the error, I went and added another TXT record as proof of ownership for Google search console. Other than this there have been no changes  I am aware of.  I've reverted this back to as it was before, waited for DNS records to refresh - and the problem still remains.

Please help.
Details
Pinned
Locked
Latest Update Latest Updates (0)
Relevant Answer Relevant Answers (0)
All Replies (7)
Relevant Answer
 Can you please check your website URL in Live test of URL Inspection tool https://support.google.com/webmasters/answer/9012289?hl=en
And also please share the screenshots in detail.
SO it will be easy to recognize the issues
marked this as an answer
Relevant Answer
@HugoMe - You're right in that 404 errors aren't coming out properly - I'm getting 500 errors instead. I added a robots.txt, but it is still not working. Working with bluehost to try and see if I can fix the 500 instead of 404 problem

@Padmavathi - Tried URL inspector already - it says the last crawl was on May 27th. However, when I do a live test, it says " URL is not on Google
This page is not in the index, but not because of an error. See the details below to learn why it wasn't indexed."

---
URL will be indexed only if certain conditions are met
DiscoveryNot checked in live tests
Not checked in live tests
Crawl
Time
N/A
Crawled as
N/A
Crawl allowed?
N/A
Page fetch
N/A
Indexing allowed?
info
N/A
Indexing
User-declared canonical
N/A
Google-selected canonical
Only determined after indexing
marked this as an answer
Relevant Answer
HI
When I check the mobile friendly test now it can reach your site
Before when robots.txt was returning a status 500 it couldn't

Can you try a live test in the url inspection now 
If it shows available then you might to  try to request indexing
marked this as an answer
Relevant Answer
> Working with bluehost to try and see if I can fix the 500 instead of 404 problem
Great.
marked this as an answer
Relevant Answer
Thanks HugoMe - I believe the issue was either with robots.txt or something was up with Google which changed. The mobile test site started working only a few hours after I implemented the robots.txt addition - which is strange. Once that worked, GSC live test worked as well. 

I put in a request for indexing, and the next morning (today) our site is back on Google.

Nevertheless, I'm glad it all worked out fine. Thanks again for your help. 

PS: Meanwhile I still haven't sorted out why 500 errors keep coming up in place of 404 errors on my website. Will hack away at this slowly now.
marked this as an answer
Relevant Answer
It might have taken a while before Google reads the new robots.txt. Google caches it so t doesn't read the version on your site every time.
So a few hours delay might be normal.

But the reason of not indexing was definitly the status 500

> PS: Meanwhile I still haven't sorted out why 500 errors keep coming up in place of 404 errors on my website. Will hack away at this slowly now.
It seems there was a php file that return the error. But fom here ist is difficult to debug.
marked this as an answer
This question is locked and replying has been disabled.
Discard post? You will lose what you have written so far.
Write a reply
10 characters required
Failed to attach file, click here to try again.
Discard post?
You will lose what you have written so far.
Personal information found

We found the following personal information in your message:

This information will be visible to anyone who visits or subscribes to notifications for this post. Are you sure you want to continue?

A problem occurred. Please try again.
Create Reply
Edit Reply
This will remove the reply from the Answers section.
Notifications are off
Your notifications are currently off and you won't receive subscription updates. To turn them on, go to Notifications preferences on your Profile page.
Report abuse
Google takes abuse of its services very seriously. We're committed to dealing with such abuse according to the laws in your country of residence. When you submit a report, we'll investigate it and take the appropriate action. We'll get back to you only if we require additional details or have more information to share.

Go to the Legal Help page to request content changes for legal reasons.

Reported post for abuse
Unable to send report.
Report post
What type of post are you reporting?
Google takes abuse of its services very seriously. We're committed to dealing with such abuse according to the laws in your country of residence. When you submit a report, we'll investigate it and take the appropriate action. We'll get back to you only if we require additional details or have more information to share.

Go to the Legal Help page to request content changes for legal reasons.

Reported post for abuse
Unable to send report.
This reply is no longer available.
/webmasters/threads
//accounts.google.com/ServiceLogin
You'll receive email notifications for new posts at
Unable to delete question.
Unable to update vote.
Unable to update subscription.
You have been unsubscribed
Deleted
Unable to delete reply.
Removed from Answers
Removed from Updates
Marked as Recommended Answer
Marked as Update
Removed recommendation
Undo
Unable to update reply.
Unable to update vote.
Thank you. Your response was recorded.
Unable to undo vote.
Thank you. This reply will now display in the answers section.
Link copied
Locked
Unlocked
Unable to lock
Unable to unlock
Pinned
Unpinned
Unable to pin
Unable to unpin
Marked
Unmarked
Unable to mark
Reported as off topic
Known Issue
Fixed
Marked Fixed
Unmarked Fixed
Unable to mark fixed
Unable to unmark fixed
/profile/0
false
Search
Clear search
Close search
Google apps
Main menu
Search Help Center
true
83844
false