Oct 29, 2020
What IP addresses are used by Google bots? Can we get a list of it?
We are adding a region selection pop up on the landing page for the user to select the region before they are allowed to browse the site. Region selection is mandatory and users will not be allowed to browse the site until a region is selected.
Due to this, we foresee an issue with the bots crawling our website(https://www.westpharma.com/). We would like to get your inputs on how the Google bot crawling will be affected because of this pop-up and how we can handle this.
Due to this, we foresee an issue with the bots crawling our website(https://www.westpharma.com/). We would like to get your inputs on how the Google bot crawling will be affected because of this pop-up and how we can handle this.
Do you have a fixed set of IPs or user agent names that we can use to bypass the pop-up?
Could you also provide your suggestions on the steps that we need to take so that bot crawling is not blocked on our site once the region selection popup is implemented.
Community content may not be verified or up-to-date. Learn more.
All Replies