Google
Example user agent
(Windows NT 10.0; Googlebot Googlebot-Image/1.0 msnbot-media/1.1 facebookexternalhit/1.1 Trident/7.0) Maxthon/4.4.5.3000 Firefox/38MSNBot
Example user agent
msnbot-UDiscovery/2.0b (+http://search.msn.com/msnbot.htm)Yahoo
Example user agent
YahooMobile/1.0 (mail; 3.0.5.1311380); (Linux; U; Android 4.0.3; htc_runnymede Build/ICE_CREAM_SANDWICH_MR1);Exabot
Example user agent
Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); +http://www.exabot.com/go/robot)Baiduspider
Example user agent
BaiDuSpiderBaiduspider
Example user agent
'Mozilla/5.0 (compatible; Baiduspider/2.0; +ht'Google
Example user agent
Googlebot/Nutch-1.7Google
Example user agent
Googlebot-Mobile (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)Yahoo
Example user agent
Y!J-BRJ/YATS crawler (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)MSNBot
Example user agent
msnbot/1.1 (+http://search.msn.com/msnbot.htm)Google
Example user agent
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) ASProxy/5.5b5Yahoo
Example user agent
Mozilla/5.0 (Linux; U; Android 4.1.2; ja-jp; N-03E Build/A7202901) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30 YJApp-ANDROID jp.co.yahoo.android.yjtop/2.4.29AdsBot-Google
Example user agent
AdsBot-Google (+http://www.google.com/adsbot.html)Bing
Example user agent
Mozilla/5.0 (compatible; bingbot/2.0 http://www.bing.com/bingbot.htm)MSNBot
Example user agent
msnbot-NewsBlogs/2.0b (+http://search.msn.com/msnbot.htm)Google
Example user agent
Googlebot/2.1 (http://www.googlebot.com/bot.html)Baiduspider
Example user agent
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/searchYahoo
Example user agent
Mozilla/5.0 (Yahoo-Test/4.0 mailto:vertical-crawl-support@yahoo-inc.com)Yahoo
Example user agent
YahooMobile/1.0 (im; 1.8.4.15957); (Linux; U; Android 4.0.4; AllviewAX2 Build/Unknown);Yahoo
Example user agent
YahooMobileMessenger/1.0 (Android Messenger; 1.8.4) (t0lteskt; samsung; SHV-E250S; 4.1.2/JZO54K)Ezooms
Example user agent
Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)Baiduspider
Example user agent
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50215; baiduspider)Bing
Example user agent
Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; http://www.bing.com/bingbot.htm)Google
Example user agent
Mozilla/5.0 (Windows; Mozilla 4.0(compatible; Googlebot/5.0; http://www.google.com/googlebot); en-US;)MJ12bot
Example user agent
Mozilla/5.0 (compatible; MJ12bot/v1.4.3; http://www.majestic12.co.uk/bot.php?+)Yahoo
Example user agent
YahooMobile/1.0 (im; 1.8.4.15957); (Linux; U; Android 4.2.2; ADM1010FP Build/Unknown);TweetmemeBot
Example user agent
Mozilla/5.0 (compatible; TweetmemeBot/2.11; +http://tweetmeme.com/)Yahoo
Example user agent
YahooMobile/1.0 (mail; 3.0.5.1311380); (Linux; U; Android 4.0.3; htc_primou Build/ICE_CREAM_SANDWICH_MR1);Yahoo
Example user agent
Yahoo!/9184 (iPhone; iOS 7.0.4; Scale/2.00)Google
Example user agent
SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)Yahoo
Example user agent
YahooMobileMessenger/1.0 (Android Mail; 1.3.10) (SCH-I405; samsung; SCH-I405; 2.3.5/GINGERBREAD)Facebot
Example user agent
Facebot/1.0Baiduspider
Example user agent
Mozilla/5.0 (compatible; Baiduspider-cpro; +http://www.baidu.com/search/spider.html)Google
Example user agent
Googlebot (gocrawl v0.4)Baiduspider
Example user agent
Baiduspider+(+http://www.baidu.com/search/spider_jp.html)MSNBot
Example user agent
msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)Google
Example user agent
Googlebot/1.3Yahoo
Example user agent
Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)Bing
Example user agent
Mozilla/5.0 (compatible;bingbot/2.0;+http://www.bing.com/bingbot.htm)Yahoo
Example user agent
Yahoo Pipes 2.0Baiduspider
Example user agent
BaiduspiderTweetmemeBot
Example user agent
Mozilla/5.0 (TweetmemeBot/4.0; +http://datasift.com/bot.html) Gecko/20100101 Firefox/31.0TurnitinBot
Example user agent
TurnitinBot/1.5 (http://www.turnitin.com/robot/crawlerinfo.html)Lycos
Example user agent
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; LYCOSA;+http://lycosa.se)Yahoo
Example user agent
YahooMobile/1.0 (im; 1.8.4.15957); (Linux; U; Android 4.0.4; ALLVIEW Build/Unknown);Lycos
Example user agent
Lycos_Spider_(modspider)Baiduspider
Example user agent
Baiduspider+(+http://www.baidu.jp/spider/)MJ12bot
Example user agent
Mozilla/5.0 (compatible; MJ12bot/v1.4.0; http://www.majestic12.co.uk/bot.php?+)Facebook
Example user agent
facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)Yahoo
Example user agent
Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html)Yahoo
Example user agent
YahooMobileMail/1.0 (Android Mail; 1.3.10) (supersonic;HTC;PC36100;2.3.5/GRJ90)Google
Example user agent
Googlebot-News (2.3.3, ruby 1.9.3 (2013-11-22))Yahoo
Example user agent
YahooMobileMessenger/1.0 (Android Messenger; 1.8.4) (jfltetmo; samsung; SGH-M919; 4.4.2/KOT49H)Exabot
Example user agent
Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)Yahoo
Example user agent
Y!J-BSC/1.0 crawler (http://help.yahoo.co.jp/help/jp/blog-search/)Google
Example user agent
Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)Yahoo
Example user agent
YahooMobile/1.0 (im; 1.8.4.15957); (Linux; U; Android 2.3.6; ONE_TOUCH_991D_ALDE Build/GINGERBREAD_MR1);Bing
Example user agent
Mozilla/5.0 (compatible; bingbot/2.0; )"Yahoo
Example user agent
Yahoo:LinkExpander:SlingstoneYahoo
Example user agent
Y!J-BRP/YFSBJ crawler (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html; YahooFeedSeekerBetaJp/2.0; users 0; views 80)Yahoo
Example user agent
Yahoo-MMCrawler/3.x (mm dash crawler at trd dot overture dot com)Yahoo
Example user agent
YahooMobileMail/1.0 (Android Mail; 3.0.5) (runnymede;HTC;Sensation XL with Beats Audio;4.0.3/IML74K)MSNBot
Example user agent
Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X; en-us) AppleWebKit/534+ (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 MsnBot-Media /1.0bia_archiver
Example user agent
ia_archiver/8.7 (Windows NT 5.0; )Yahoo
Example user agent
YahooCacheSystemYahoo
Example user agent
Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)MSNBot
Example user agent
msnbot/1.1 ( http://search.msn.com/msnbot.htm)Yahoo
Example user agent
YahooMobileMessenger/1.0 (Android Mail; 1.4.6) (jaspervzw; samsung; SCH-I200; 4.0.4/IMM76D)MSNBot
Example user agent
"msnbot-NewsBlogs/2.0b (+http://search.msn.com/msnbot.htm)Yahoo
Example user agent
CrawlConvera0.1 (CrawlConvera@yahoo.com)Yahoo
Example user agent
Mozilla/5.0 (compatible; Finderbots finder bot; +http://wiki.github.com/bixo/bixo/bixocrawler; bixo-dev@yahoogroups.com)Yahoo
Example user agent
YahooMobileMessenger/1.0 (Android Messenger; 1.4) (SGH-I897; samsung; SAMSUNG-SGH-I897; 2.2/FROYO)Yahoo
Example user agent
YahooMobile/1.0 (Yahoo! Search; 3.1.3) (Apple; iPhone; iPhone OS/7.1.2); YHOO_Search_App/3.1.3Yahoo
Example user agent
YahooMobileWeather/1.0 (Android Weather; 1.2) (ME173X; asus; ME173X; 4.2.2/JDQ39)Yahoo
Example user agent
Mozilla/5.0 (Linux; U; Android 4.1.2; ja-jp; SBM200SH Build/S1006) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30 YJApp-ANDROID jp.co.yahoo.android.yjtop/2.4.10Yahoo
Example user agent
Mozilla/5.0 (DTV; TSBNetTV/T32013713.0203.7DD; TVwithVideoPlayer; like Gecko) NetFront/4.1 DTVNetBrowser/2.2 (000039;T32013713;0203;7DD) InettvBrowser/2.2 (000039;T32013713;0203;7DD) YahooDTV/2.0 (Video=0x03;Audio=0x01;Screen=0x01;Device=0x00;Remote=0x10)Yahoo
Example user agent
YahooMobileMessenger/1.0 (J2ME Messenger; 1.0.0) (6693; HTC; Droid; Android OS/3.0) UNTRUSTED/1.0MSNBot
Example user agent
Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) MsnBot-Media /1.0bYahoo
Example user agent
YahooSeeker/1.0 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/shop/merchant/)Google
Example user agent
Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)Twitter
Example user agent
TelegramBot (like TwitterBot)Yahoo
Example user agent
YahooMobileMessenger/1.0 (Android Mail; 1.3.9) (SGH-I997; samsung; SAMSUNG-SGH-I997; 2.2.1/FROYO)YandexBot
Example user agent
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)MSNBot
Example user agent
msnbot/2.0b (+http://search.msn.com/msnbot.htm)._Google
Example user agent
Googlebot v2.1 (+http://www.google.com/bot.html) (http://www.openwebspider.org/)ia_archiver
Example user agent
ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)Yahoo
Example user agent
Mozilla/5.0 (compatible; BIXOCRAWLER; +http://wiki.github.com/bixo/bixo/bixocrawler; bixo-dev@yahoogroups.com)Yahoo
Example user agent
YahooMobile/1.0 (mail; 1.4.5.12736); (Linux; U; Android 2.2.1; htc_buzz Build/FROYO);Yahoo
Example user agent
YahooJMobileApp/1.1 (Android emg; 1.3.4) (samsung; SC-02E; samsung; SC-02E; 4.1.1/JRO03C)Google
Example user agent
Googlebot/2.1 ( http://www.googlebot.com/bot.html)Baiduspider
Example user agent
Mozilla/5.0+(compatible;+Baiduspider/2.0;++http://www.baidu.com/search/spider.html)Bing
Example user agent
Mozilla/5.0 (compatible; bingbot/2.0 +http://www.bing.com/bingbot.htm)Yahoo
Example user agent
Mozilla/5.0 (DTV; TSBNetTV/T33010302.0203.3DD; like Gecko) NetFront/3.4 DTVNetBrowser/2.2 (000039;T33010302;0203;3DD) InettvBrowser/2.2 (000039;T33010302;0203;3DD) YahooDTV/1.1 (Video=0x03;Audio=0x01;Screen=0x01;Device=0x00;Remote=0x10)Google
Example user agent
Googlebot-Image/1.0Yahoo
Example user agent
LG-C1500 UP.Browser/6.2.3 (GUI) MMP/1.0 (compatible;YahooSeeker/M1A1-R2D2; http://help.yahoo.com/help/us/ysearch/crawling/crawling-01.html)Google
Example user agent
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; Google Page Speed Insights) Chrome/27.0.1453 Safari/537.36 GoogleBot/2.1MSNBot
Example user agent
MSNBot/Nutch-1.5.1Yahoo
Example user agent
DefaultCrawlTest/0.6 (Ram Crawl Test; devarajaswami at yahoo dot com)Google
Example user agent
Googlebot/2.1(+http://www.googlebot.com/bot.html)Google
Example user agent
Mozilla/5.0 (compatible;acapbot/0.1.;treat like Googlebot)Yahoo
Example user agent
YahooMobile/1.0 (im; 1.8.3.13903); (Linux; U; Android 2.3.5; ZTE_BP_GER Build/GINGERBREAD_MR1);Baiduspider
Example user agent
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)Twikle
Example user agent
Twikle/1.0 , http://twikle.com , contact@twikle.comBaiduspider
Example user agent
Baiduspider+(+http://www.baidu.com/search/spider.htm)Yahoo
Example user agent
YahooMobileMessenger/1.0 (Nokia-mobile messenger; 1.0.0.0) (1234; Nokia; WP; WP OS/7.1)AdsBot-Google
Example user agent
AdsBot-Google ( http://www.google.com/adsbot.html)Yahoo
Example user agent
Y!J-BRJ/YATS crawler (http://listing.yahoo.co.jp/support/faq/int/other/other_001.html)MSNBot
Example user agent
msnbot/2.0 (+http://search.msn.com/msnbot.htm)Google
Example user agent
Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)Yahoo
Example user agent
Mozilla/5.0 (iPhone; Y!J-BRY/YATSH crawler; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)Yahoo
Example user agent
Yahoo-VerticalCrawler-FormerWebCrawler/3.9 crawler at trd dot overture dot com; http://www.alltheweb.com/help/webmaster/crawlerYahoo
Example user agent
Mozilla/5.0 (DTV; TSBNetTV/T3B014613.0203.6DD; TVwithVideoPlayer; like Gecko) NetFront/4.1 DTVNetBrowser/2.2 (000039;T3B014613;0203;6DD) InettvBrowser/2.2 (000039;T3B014613;0203;6DD) YahooDTV/2.0 (Video=0x03;Audio=0x01;Screen=0x01;Device=0x00;Remote=0x10)Wotbox
Example user agent
Wotbox/2.01 (+http://www.wotbox.com/bot/)Google
Example user agent
(Windows NT 10.0; Googlebot Googlebot-Image/1.0 msnbot-media/1.1 facebookexternalhit/1.1 Trident/7.0) Maxthon/4.0WBSearchBot
Example user agent
Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)Baiduspider
Example user agent
Baiduspider ( http://www.baidu.com/search/spider.htm)Yahoo
Example user agent
Y!J-ASR/0.1 crawler (http://www.yahoo-help.jp/app/answers/detail/p/595/a_id/42716/)Facebot
Example user agent
FacebotYahoo
Example user agent
Y!J-BRO/YFSJ crawler (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html; YahooFeedSeekerJp/2.0)Google
Example user agent
Googlebot-NewsYahoo
Example user agent
Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) NOT Firefox/3.5Yahoo
Example user agent
Mozilla/5.0 (Linux; U; Android 4.2.2; ja-jp; SO-02E Build/10.3.1.B.1.1) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30 YJApp-ANDROID jp.co.yahoo.android.yjtop/2.4.29MSNBot
Example user agent
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.13) Gecko/20101203 Firefox/3.6.13 (.NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; msnbot/2.1) Jakarta Commons-HttpClient/3.0-rc3 PHPCrawl GStreamer souphttpsrc libsoup/2.27.4 PycURL/7.19.0 XML-RPC for PHP 2.2.1 GoogleFriendConnect/1.0 HTMLParser/1.6 gPodder/0.15.2 ( http://gpodder.org/) anw webtool LoadControl/1.3 WinHttp urlgrabber/3.1.0Yahoo
Example user agent
Mozilla/5.0 (Yahoo-MMCrawler/4.0; mailto:vertical-crawl-support@yahoo-inc.com)Yahoo
Example user agent
YahooMobile/1.0 (mail; 1.3.8.9816); (Linux; U; Android 2.3.4; htc_glacier Build/GINGERBREAD_MR1);Yahoo
Example user agent
YahooCacheSystem; YahooWebServiceClientAhrefsBot
Example user agent
AhrefsBot.Feeds v0.1; http://ahrefs.com/Yahoo
Example user agent
Mozilla/5.0 (Linux; U; Android 4.2.2; ja-jp; DM015K Build/102.0.1a10) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30 YJApp-ANDROID jp.co.yahoo.android.yjtop/2.4.30Baiduspider
Example user agent
baiduspider-mobile-gateUnwindFetchor
Example user agent
UnwindFetchor/1.0 (+http://www.gnip.com/)Bing
Example user agent
Mozilla/5.0 (compatible; bingbot/2.1; +http://www.bing.com/bingbot.htm)Google
Example user agent
Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML, like Gecko) Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)Google
Example user agent
Locubot (compatible; Googlebot; msnbot)Yahoo
Example user agent
Mozilla/5.0 (Linux; U; Android 4.0.4; ja-jp; SO-04D Build/7.0.D.1.130) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30 YJApp-ANDROID jp.co.yahoo.android.ybrowser/1.4.0Google Keyword Suggestion
Example user agent
Mozilla/5.0 (X11; U; Linux x86_64; en-US) AppleWebKit/534.16 (KHTML, like Gecko, Google Keyword Suggestion) Chrome/10.0.648.127 Safari/534.16Baiduspider
Example user agent
Baiduspider-image+(+http://www.baidu.com/search/spider.htm)exabot
Example user agent
Mozilla/5.0 (compatible; Alexabot/1.0; +http://www.alexa.com/help/certifyscan; certifyscan@alexa.com)MSNBot
Example user agent
msnbot/0.9 (+http://search.msn.com/msnbot.htm)Yahoo
Example user agent
YahooMobileMessenger/1.0 (Android Mail; 1.3.2) (hwu8730; HUAWEI; T-Mobile myTouch Q; 2.3.6/HuaweiU8730)Yahoo
Example user agent
YahooMobile/1.0 (Yahoo! Search; 3.1.2) (Apple; iPod touch; iPhone OS/7.1.1); YHOO_Search_App/3.1.2Yahoo
Example user agent
Mozilla/5.0 (DTV; TSBNetTV/T38014006.0203.0DD; TVwithVideoPlayer; like Gecko) NetFront/4.1 DTVNetBrowser/2.2 (000039;T38014006;0203;0DD) InettvBrowser/2.2 (000039;T38014006;0203;0DD) YahooDTV/2.0 (Video=0x03;Audio=0x01;Screen=0x01;Device=0x00;Remote=0x10)MSNBot
Example user agent
msnbot/2.1Yahoo
Example user agent
Mozilla/5.0 (compatible; Yahoo Link Preview; https://help.yahoo.com/kb/mail/yahoo-link-preview-SLN23615.html)MSNBot
Example user agent
msnbot/2.0b ( http://search.msn.com/msnbot.htm)Wotbox
Example user agent
Wotbox/0.7-alpha (bot@wotbox.com; http://www.wotbox.com)Yahoo
Example user agent
Mozilla/5.0 (Linux; U; Android 2.3.3; ja-jp; sdk Build/GRI34; Y!J-BRZ/YATSHA crawler; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html) AppleWebKit/533.1 (KHTML, like Gecko) Version/4.0 Mobile Safari/533.1Wotbox
Example user agent
Wotbox/2.01 ( http://www.wotbox.com/bot/)Yahoo
Example user agent
YahooMobile/1.0 (im; 1.8.3.13903); (Linux; U; Android 2.3.5; htc_bliss Build/GINGERBREAD_MR1);Google
Example user agent
Mozilla (Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html))TweetmemeBot
Example user agent
Mozilla/5.0 (compatible; TweetmemeBot/3.0; +http://tweetmeme.com/)MSNBot
Example user agent
msnbot-media/2.0b (+http://search.msn.com/msnbot.htm)Yahoo
Example user agent
Mozilla/5.0 (Yahoo-Test/4.0 ysm-keystone-crawl-support@yahoo-inc.com)MSNBot
Example user agent
msnbot-media/1.0 ( http://search.msn.com/msnbot.htm)Yahoo
Example user agent
Mozilla/5.0 (compatible; pub-crawler; +http://wiki.github.com/bixo/bixo/bixocrawler; bixo-dev@yahoogroups.com)Yahoo
Example user agent
YahooMobileMessenger/1.0 (Android Messenger; 1.5.1) (SCH-I500; Samsung; SCH-I500; 2.3.5/GINGERBREAD)MJ12bot
Example user agent
Mozilla/5.0 (compatible; MJ12bot/v1.4.4; http://www.majestic12.co.uk/bot.php?+)Yahoo
Example user agent
Mozilla/5.0 (linux; u; android 4.1.1; ja-jp; sgpt12 build/tjs0166) applewebkit/534.30 (khtml, like gecko) version/4.0 safari/534.30 yjapp-android jp.co.yahoo.android.yjtop/2.1.8Yahoo
Example user agent
YahooMobileMessenger/1.0 (Android Messenger; 1.6.0) (SGH-T959; Samsung; SGH-T959; 2.1-update1/ECLAIR)Google
Example user agent
googlebotYahoo
Example user agent
YahooMobileMessenger/1.0 (Android Mail; 1.4.0) (vivow; HTC; ADR6350; 2.3.4/GRJ22)YandexImages
Example user agent
Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)Yahoo
Example user agent
Mozilla/5.0 (DTV; TSBNetTV/TXXXXXXXXX.0203.ADD; like Gecko) NetFront/3.4 DTVNetBrowser/2.2 (000039;TXXXXXXXXX;0203;ADD) InettvBrowser/2.2 (000039;TXXXXXXXXX;0203;ADD) YahooDTV/1.1 (Video=0x03;Audio=0x01;Screen=0x01;Device=0x00;Remote=0x10)AhrefsBot
Example user agent
Mozilla/5.0 (compatible; AhrefsBot/3.1; +http://ahrefs.com/robot/Yahoo
Example user agent
YahooMobileMessenger/1.0 (Android Mail; 1.3.4) (mecha; HTC; ADR6400L; 2.2.1/FRG83D)PaperLiBot
Example user agent
Mozilla/5.0 (compatible; PaperLiBot/2.1; http://support.paper.li/entries/20023257-what-is-paper-li)MSNBot
Example user agent
MSNBOT/0.1 (http://search.msn.com/msnbot.htm)Google
Example user agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; Google Web Preview Analytics) Chrome/27.0.1453 Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)Facebook
Example user agent
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)Yahoo
Example user agent
YahooMobile/1.0 (mail; 2.6.6.1310803); (Linux; U; Android 4.0.3; htc_shooteru Build/ICE_CREAM_SANDWICH_MR1);Yahoo
Example user agent
YahooMobileMail/1.0 (Android Mail; 1.3.6) (speedy;HTC;PG06100;2.2/FRF91)Pingdom
Example user agent
Pingdom.com_bot_version_1.4_(http://www.pingdom.com)Bing
Example user agent
Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)Yahoo
Example user agent
Mozilla/5.0 (DTV; TSBNetTV/T35013A0C.0203.ADD; TVwithVideoPlayer; like Gecko) NetFront/4.1 DTVNetBrowser/2.2 (000039;T35013A0C;0203;ADD) InettvBrowser/2.2 (000039;T35013A0C;0203;ADD) YahooDTV/2.0 (Video=0x03;Audio=0x01;Screen=0x01;Device=0x00;Remote=0x10)Yahoo
Example user agent
Y!J-BRO/YFSJ crawler (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html; YahooFeedSeekerJp/2.0; users 0; views 248)Google
Example user agent
mozilla/5.0 (iphone; cpu iphone os 8_3 like mac os x) applewebkit/600.1.4 (khtml, like gecko) version/8.0 mobile/12f70 safari/600.1.4 (compatible; googlebot/2.1; +http://www.google.com/bot.html)AdsBot-Google
Example user agent
AdsBot-GoogleYahoo
Example user agent
YahooMobileMessenger/1.0 (Android Messenger; 1.8.4) (hwu8815; HUAWEI; HUAWEI U8815; 4.0.3/HuaweiU8815C02B952)AhrefsBot
Example user agent
Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)Google
Example user agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Safari/537.36AdsBot-Google
Example user agent
AdsBot-Google-Mobile (+http://www.google.com/mobile/adsbot.html) Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36YandexBot
Example user agent
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots),gzip(gfe) AppEngine-Google; (+http://code.google.com/appengine; appid: twitter-mirror),gzip(gfe),gzip(gfe),gzip(gfe)Yahoo
Example user agent
YahooJMobileApp/1.1 (Android yjwidget; 3.0.2.2) (samsung; d2dcm; samsung; SC-06D; 4.1.2/JZO54K)Google
Example user agent
DoCoMo//2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)MSNBot
Example user agent
\x22Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) MsnBot-Media /1.0b\x22Google
Example user agent
Googlebot/2.1 (+http://www.googlebot.com/bot.html)MSNBot
Example user agent
msnbot/0.11 ( http://search.msn.com/msnbot.htm)Google
Example user agent
Googlebot/2.2Google
Example user agent
KDDI-CA34 UP.Browser/6.2.0.10.2.2(GUI)MMP/2.0 (compatible; KDDI-Googlebot-Mobile/2.1; http://www.google.com/bot.html)Google
Example user agent
Googlebot/2.1 (+http://www.google.com/bot.html)Yahoo
Example user agent
Mozilla/5.0 (iPhone; CPU iPhone OS 7_1 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)AdsBot-Google
Example user agent
AdsBot-Google-Mobile (+http://www.google.com/mobile/adsbot.html) Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile SafariMSNBot
Example user agent
adidxbot/2.0 (+http://search.msn.com/msnbot.htm)Google
Example user agent
DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)Baiduspider
Example user agent
Baiduspider-image ( http://www.baidu.com/search/spider.htm)Facebook
Example user agent
facebookexternalhit/1.1Facebook
Example user agent
facebookexternalhit/1.1 (+http(s)://www.facebook.com/externalhit_uatext.php)Bing
Example user agent
bingbotYahoo
Example user agent
Yahoo-Newscrawler/3.9 (news-search-crawler at yahoo-inc dot com)Yahoo
Example user agent
Y!J-BRW/1.0 crawler (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)Baiduspider
Example user agent
Baiduspider-testbranchYahoo
Example user agent
YahooMobileMessenger/1.0 (Android Messenger; 1.8.3) (apexqtmo; samsung; SGH-T699; 4.0.4/IMM76D)Google
Example user agent
Googlebot-Video/1.0MSNBot
Example user agent
msnbot/2.0b v1394720947.6703Ezooms
Example user agent
Mozilla/5.0 (compatible; Ezooms/1.0; help@moz.com)Google
Example user agent
Mozilla/5.0 (iPhone; CPU iPhone OS 6_0_1 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko; Google Page Speed Insights) Version/6.0 Mobile/10A525 Safari/8536.25 GoogleBot/2.1Google
Example user agent
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)Yahoo
Example user agent
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurpTurnitinBot
Example user agent
TurnitinBot/3.0 (http://www.turnitin.com/robot/crawlerinfo.html)Yahoo
Example user agent
YahooMobile/1.0 (im; 1.8.4.15957); (Linux; U; Android 4.2.2; ARCHOS 79XE Build/Unknown);Yahoo
Example user agent
YahooMobileMessenger/1.0 (Android Mail; 1.4.5) (SCH-I510; samsung; SCH-I510; 2.3.6/GINGERBREAD)Pingdom
Example user agent
Pingdom.com_bot_version_1.4_(http://www.pingdom.com/)AhrefsBot
Example user agent
Mozilla/5.0 (compatible; AhrefsBot/4.0; +http://ahrefs.com/robot/)Bing
Example user agent
Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)Google
Example user agent
Googlebot-richsnippetsYahoo
Example user agent
YahooMobileMessenger/1.0 (Android Mail; 1.3.10) (SGH-T499; Samsung; SGH-T499; 2.2.2/FROYO)Yahoo
Example user agent
YahooMobile/1.0 (mail; 1.3.10.10337); (Linux; U; Android 2.3.3; htc_supersonic Build/GINGERBREAD_MR1);Yahoo
Example user agent
YahooMobileMessenger/1.0 (Android Mail; 1.4.4) (lexikon; HTC; ADR6325; 2.2/FRF91)Google
Example user agent
GooglebotYahoo
Example user agent
YahooJMobileApp/1.1 (Android yjtop; 2.0.1) (samsung; SC-02C; samsung; SC-02C; 2.3.3/GINGERBREAD)Yahoo
Example user agent
Mozilla/5.0 (compatible; Yahoo! Slurp/3.0 ; http://help.yahoo.com/help/us/ysearch/slurp)AhrefsBot
Example user agent
Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/) AppEngine-Google; (+http://code.google.com/appengine; appid: s~proxyfile1-hrd)Exabot
Example user agent
Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails)Google
Example user agent
Mozilla/5.0 AppleWebKit/537.4 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Safari/537.4MSNBot
Example user agent
msnbot/2.0b (+http://search.msn.com/msnbot.htm)Yahoo
Example user agent
WebIndexer/1-dev (Web Indexer; mailto://webindexerv1@yahoo.com; webindexerv1@yahoo.com)Yahoo
Example user agent
Y!J-BRI/0.0.1 crawler ( http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html )Yahoo
Example user agent
YahooMobileMessenger/1.0 (Android Messenger; 1.8.3) (SHW-M340K; samsung; SHW-M340K; 2.3.6/GINGERBREAD)Yahoo
Example user agent
YahooMobileMail/1.0 (Android Mail; 1.3.9) (inc;HTC;ADR6300;2.3.4/GRJ22)Yahoo
Example user agent
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)Twitter
Example user agent
Twitterbot/1.0Yahoo
Example user agent
YahooJMobileApp/1.1 (Android yfinkeyguardwidget; 1.1.0) (SBM; SBM203SH; SHARP; SBM203SH; 4.1.2/S0022)Yahoo
Example user agent
Mozilla/5.0 (compatible; Yahoo!; U; Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) Mozilla/5.0 ()
Comparison created
2016-05-17 06:49:52 | by
ThaDafinser