Mail.Ru Bot is the official web crawler of Mail.Ru, one of Russia's largest internet companies. The bot systematically browses the web to gather and index content for Mail.Ru's search engine, ensuring that its users have access to up-to-date and relevant search results. In addition to search indexing, the bot may also be used to support other Mail.Ru services, such as news aggregation and content discovery. Like other search engine crawlers, Mail.Ru Bot adheres to the robots.txt protocol, allowing website administrators to control its access to their sites. Its user agent string typically includes 'mail.ru_bot' or similar identifiers, making it recognizable in web server logs.
fetcher-img3-4.p.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +https://help.mail.ru/webmaster/indexing/robots)
fetcher-img3-3.p.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +https://help.mail.ru/webmaster/indexing/robots)
fetcher-img3-1.p.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +https://help.mail.ru/webmaster/indexing/robots)
fetcher-img3-7.p.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +https://help.mail.ru/webmaster/indexing/robots)
fetcher4-2.go.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots)
fetcher4-8.go.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots)
fetcher4-5.go.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots)
fetcher4-3.go.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots)
fetcher-img3-8.p.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +https://help.mail.ru/webmaster/indexing/robots)
fetcher-img3-2.p.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +https://help.mail.ru/webmaster/indexing/robots)
fetcher4-7.go.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots)
fetcher4-1.go.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots)
fetcher4-4.go.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots)
fetcher4-6.go.mail.ru
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots)
