Google Feedfetcher is a specialized web crawler operated by Google. Its primary function is to fetch RSS and Atom feeds when users add them to Google services, such as Google News and the now-discontinued Google Reader. Unlike general-purpose web crawlers that index web pages for search engines, Feedfetcher specifically requests feed content on behalf of users who have subscribed to those feeds. The bot identifies itself with the user agent 'feedfetcher-google' and respects robots.txt directives. Feedfetcher does not follow links or index web pages; it only retrieves the feed content as requested by users. This ensures that feed publishers can monitor and control how their content is accessed by Google services.
rate-limited-proxy-66-249-89-34.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-66-249-89-33.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-66-249-89-35.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-74-125-218-138.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-66-249-92-168.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-66-249-92-163.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-209-85-238-74.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-66-249-92-164.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-66-249-92-165.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-74-125-216-3.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-74-125-216-2.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-74-125-150-33.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-74-125-150-34.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-72-14-199-205.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-72-14-199-204.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-72-14-199-202.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-72-14-199-201.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-66-249-90-172.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-66-249-90-173.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-74-125-216-4.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-66-249-87-201.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-66-249-87-202.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-72-14-199-97.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-74-125-150-65.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
rate-limited-proxy-74-125-217-165.google.com
FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)