Review technical index guidelines
Google News uses a computer algorithm to automatically crawl news websites. To help our system determine which of your webpages are articles, make sure your site follows our technical guidelines.
Here are some common areas where publishers encounter technical issues:
- Article URLs: Make sure your article URLs are unique and permanent.
- Article format: Our crawler cannot crawl PDFs or other non-HTML formats.
- Robots.txt or metatags: To include your content in Google News, our user-agents Googlebot and Googlebot-news must be able to crawl and index your site.
- Multimedia content: We cannot include audio files or multimedia content. However, we can sometimes crawl supplementary text on pages with this type of content, including some videos from YouTube.