Friendly Crawler is a web bot that identifies itself with the user agent string 'friendlycrawler'. While not as widely recognized as major search engine bots, it is used for crawling and indexing web content. Its purpose is likely to gather website data for a search engine, data aggregation service, or similar application. The bot generally respects robots.txt directives, indicating an intent to crawl ethically. Due to its straightforward identifier, it is considered a non-malicious, legitimate crawler, though its operator may not be widely known.
ec2-50-112-18-76.us-west-2.compute.amazonaws.com
FriendlyCrawler/Nutch-1.20-SNAPSHOT
ec2-54-149-150-39.us-west-2.compute.amazonaws.com
FriendlyCrawler/Nutch-1.20-SNAPSHOT
ec2-52-13-41-86.us-west-2.compute.amazonaws.com
FriendlyCrawler/Nutch-1.20-SNAPSHOT
ec2-34-213-85-121.us-west-2.compute.amazonaws.com
FriendlyCrawler/Nutch-1.20-SNAPSHOT
ec2-52-89-76-211.us-west-2.compute.amazonaws.com
FriendlyCrawler/Nutch-1.20-SNAPSHOT
ec2-52-27-224-193.us-west-2.compute.amazonaws.com
FriendlyCrawler/Nutch-1.20-SNAPSHOT
ec2-34-218-76-67.us-west-2.compute.amazonaws.com
FriendlyCrawler/Nutch-1.20-SNAPSHOT
ec2-52-40-53-134.us-west-2.compute.amazonaws.com
FriendlyCrawler/Nutch-1.20-SNAPSHOT
ec2-50-112-25-37.us-west-2.compute.amazonaws.com
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/605.1.16 (KHTML, like Gecko; compatible; Friendly_Crawler/2.0) Chrome/120.0.6099.217 Safari/605.1.15/Nutch-1.20-SNAPSHOT
ec2-35-87-202-76.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-35-88-25-22.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-34-219-219-197.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-34-216-87-161.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-54-202-243-105.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-52-27-116-80.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-35-93-113-142.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-35-94-223-153.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-54-200-205-218.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-35-87-104-27.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-54-212-210-67.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-34-221-70-42.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-52-12-124-198.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-54-188-215-102.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-35-88-239-107.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT
ec2-34-220-190-120.us-west-2.compute.amazonaws.com
Friendly_Crawler/Nutch-1.20-SNAPSHOT