Googlebot is the primary web crawler deployed by Google to discover, fetch, and index web content for inclusion in Google Search results. When Googlebot visits a website, it often accesses resources and stores cached versions of web pages using the googleusercontent.com domain. This domain is also used to serve cached copies of web pages to users via Google services, such as the 'Cached' link in search results. Googlebot operates by systematically browsing the web, following links, and respecting site owners' robots.txt directives. Its activities are essential for keeping Google's search index up to date and relevant. The use of googleusercontent.com helps separate Google's crawling and caching infrastructure from its main search and advertising services, enhancing security and performance.
242.190.83.34.bc.googleusercontent.com
Expand
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
211.150.193.35.bc.googleusercontent.com
Expand
DuckDuckBot-Https/1.1; (+https://duckduckgo.com/duckduckbot)
70.23.243.35.bc.googleusercontent.com
Expand
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/112.0.0.0 Safari/537.36 AppEngine-Google; (+http://code.google.com/appengine; appid: s~virustotalcloud)
64.23.243.35.bc.googleusercontent.com
Expand
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/112.0.0.0 Safari/537.36 AppEngine-Google; (+http://code.google.com/appengine; appid: s~virustotalcloud)
71.23.243.35.bc.googleusercontent.com
Expand
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/112.0.0.0 Safari/537.36 AppEngine-Google; (+http://code.google.com/appengine; appid: s~virustotalcloud)
168.203.178.107.gae.googleusercontent.com
Expand
Mozilla/5.0 (compatible; Google-Apps-Script; beanserver; +https://script.google.com; id: UAEmdDd9fpfWGCGbpL-Vgr5Fsb9ELfqwSfaQ)
236.23.243.35.bc.googleusercontent.com
Expand
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/112.0.0.0 Safari/537.36 AppEngine-Google; (+http://code.google.com/appengine; appid: s~virustotalcloud)
237.23.243.35.bc.googleusercontent.com
Expand
Mozilla/5.0 (Android 13; Mobile; rv:109.0) Gecko/112.0 Firefox/112.0 AppEngine-Google; (+http://code.google.com/appengine; appid: s~virustotalcloud)
235.23.243.35.bc.googleusercontent.com
Expand
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/112.0.0.0 Safari/537.36 AppEngine-Google; (+http://code.google.com/appengine; appid: s~virustotalcloud)
70.44.96.34.bc.googleusercontent.com
Expand
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
143.190.138.34.bc.googleusercontent.com
Expand
Mozilla/5.0 (Windows NT 6.3;compatible; Leikibot/1.0; +http://www.leiki.com)
21.175.85.34.bc.googleusercontent.com
Expand
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
69.203.178.107.gae.googleusercontent.com
Expand
Mozilla/5.0 (compatible; Google-Apps-Script; beanserver; +https://script.google.com; id: UAEmdDd-5vWB1TTVwyH4g_Lsuge9wIxEyGjo)
129.22.138.34.bc.googleusercontent.com
Expand
Mozilla/5.0 (Windows NT 6.3;compatible; Leikibot/1.0; +http://www.leiki.com)
135.22.138.34.bc.googleusercontent.com
Expand
Mozilla/5.0 (Windows NT 6.3;compatible; Leikibot/1.0; +http://www.leiki.com)
176.102.116.34.bc.googleusercontent.com
Expand
ddg_android/5.173.1 (com.duckduckgo.mobile.android; Android API 33)
132.190.138.34.bc.googleusercontent.com
Expand
Mozilla/5.0 (Windows NT 6.3;compatible; Leikibot/1.0; +http://www.leiki.com)
139.22.138.34.bc.googleusercontent.com
Expand
Mozilla/5.0 (Windows NT 6.3;compatible; Leikibot/1.0; +http://www.leiki.com)
131.22.138.34.bc.googleusercontent.com
Expand
Mozilla/5.0 (Windows NT 6.3;compatible; Leikibot/1.0; +http://www.leiki.com)
136.190.138.34.bc.googleusercontent.com
Expand
Mozilla/5.0 (Windows NT 6.3;compatible; Leikibot/1.0; +http://www.leiki.com)
153.76.169.34.bc.googleusercontent.com
Expand
robots-bulk-crawler/0.7
128.134.227.35.bc.googleusercontent.com
Expand
robots-bulk-crawler/0.8
163.133.83.34.bc.googleusercontent.com
Expand
robots-bulk-crawler/0.9.1
117.53.53.34.bc.googleusercontent.com
Expand
robots-bulk-crawler/1.0
224.44.96.34.bc.googleusercontent.com
Expand
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)