/webmasters/community?hl=en
This content is likely not relevant anymore. Try searching or browse recent questions.
-
URL Inspection: URL is not available to Google, How to Fix?? 1 Recommended Answer 8 Replies 28 Upvotes
1 Recommended Answer
$0 Recommended Answers
Hello,

My site was kept no-indexed using robots.txt tool for a few months (5 - 6 months), since the site was under construction

Yesterday i submitted the site to Google also the sitemap, [it is a WordPress site]

Google could successfully index homepage, but could not index the internal posts and pages

While i requested for indexing using URL Inspection tool, i got following error



But the site is fully up online, even i use CDN for faster resource delivery

I did not block search engines anymore and site is fully live online

I understand it will take some time to get this thing resolved, but can't understand how many time it will take for Google bot to include the urls in search directory

A few days are okay to wait, but it would be really so lengthy if I have to wait for months

If anybody has any idea about fixing this issue, I appreciate to explain in this forum thread

Regards
Rashad
All Replies (8)
-
That is not going to work, my site shows 100% uptime from different locations given on the image below


Either googlebot still facing issue to retrieve the pages as the site was locked more than 6 months during that time Google bot might be trying to access the website several times or my server provides any 500 errors, which i don't know but i have to check that out or contact hosting provider,

I think still Googlebot can not fetch the fresh version of the website as the site is no longer kept locked and no longer blocked  in robots.txt

it may the failurity of Googlebot to index the fresh version of site faster

So, do you suggest anything in this regard?

Rashad
marked this as an answer
When Googel tried to fetch the page on 28th August, the server returned an error. It did not return the page. 
 
 
You need to diagnose WHY it did that. 
 
It might just be a transient issue. Or it might be something about the page in question. 
 
Or it might be something that the server only returns to Gogelbto. (either by IP or User-Agent header) 
 
 
 
 
 
marked this as an answer
-
Thank you for the consultative reply

One thing i can show you,

Since i have submitted the site to Google 3 days ago

Still i see Google can't retrieve the site when my site is now actively running



Can you suggest anything in this case?

Rashad
marked this as an answer
Stop looking at the search console. It will NOT help you. 
 
 
Diagnose the hosting server. 
 
the 500 status CAME from your server. 
 
Either config issue, temporally overload, or maybe application eroror. 
marked this as an answer
-
Many thanks barryhunter

It was DNS issue, since i pointed A record to Stackpath anycast DNS in order to reduce DDOS attack

And the site's directory does not have a robots.txt file,

Now my hosting assistant created this and i requested google to fetch the new version of robots.txt

I believe it will resolve the problem

Thanks again
marked this as an answer
Hello
URL is not available to Google on live test
Page fetch
Failed: Not found (404)
Indexing
Indexing allowed?                  N/A
User-declared canonical       N/A
how can solve it ?
marked this as an answer
Hi
I got the same error like the other, 
I pointed A record ro Digital Ocean and I got the 404 not found on Robotx .tct as well 
And also Live site test give 404 

hAVE ANY SOLUTİONS ?
marked this as an answer
This question is locked and replying has been disabled.
Discard post? You will lose what you have written so far.
Write a reply
10 characters required
Failed to attach file, click here to try again.
Discard post?
You will lose what you have written so far.
Personal information found

We found the following personal information in your message:

This information will be visible to anyone who visits or subscribes to notifications for this post. Are you sure you want to continue?

A problem occurred. Please try again.
Create Reply
Edit Reply
Delete post?
This will remove the reply from the Answers section.
Notifications are off
Your notifications are currently off and you won't receive subscription updates. To turn them on, go to Notifications preferences on your Profile page.
Report abuse
Google takes abuse of its services very seriously. We're committed to dealing with such abuse according to the laws in your country of residence. When you submit a report, we'll investigate it and take the appropriate action. We'll get back to you only if we require additional details or have more information to share.

Go to the Legal Help page to request content changes for legal reasons.

Reported post for abuse
Unable to send report.
Report post
What type of post are you reporting?
Google takes abuse of its services very seriously. We're committed to dealing with such abuse according to the laws in your country of residence. When you submit a report, we'll investigate it and take the appropriate action. We'll get back to you only if we require additional details or have more information to share.

Go to the Legal Help page to request content changes for legal reasons.

Reported post for abuse
Unable to send report.
This reply is no longer available.
/webmasters/threads
//accounts.google.com/ServiceLogin
You'll receive email notifications for new posts at
Unable to delete question.
Unable to update vote.
Unable to update subscription.
You have been unsubscribed
Deleted
Unable to delete reply.
Removed from Answers
Marked as Recommended Answer
Removed recommendation
Undo
Unable to update reply.
Unable to update vote.
Thank you. Your response was recorded.
Unable to undo vote.
Thank you. This reply will now display in the answers section.
Link copied
Locked
Unlocked
Unable to lock
Unable to unlock
Pinned
Unpinned
Unable to pin
Unable to unpin
Marked
Unmarked
Unable to mark
Reported as off topic
/webmasters/profile/0?hl=en