Detected bot names

• 008 1x detected

  Example user agent
  Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html) Gecko/2008032620

• 360Spider 15x detected

  Example user agent
  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; MDDR; .NET4.0C; .NET4.0E; .NET CLR 1.1.4322; Tablet PC 2.0); 360Spider

• 80Legs 2x detected

  Example user agent
  Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html) Gecko/2008032620

• abot 1x detected

  Example user agent
  abot/0.1 (abot; http://www.abot.com; abot@abot.com)

• Aboundex 2x detected

  Example user agent
  Aboundex/0.3 (http://www.aboundex.com/crawler/)

• Aboundexbot 2x detected

  Example user agent
  Aboundex/0.3 (http://www.aboundex.com/crawler/)

• Acoon 1x detected

  Example user agent
  Mozilla/5.0 (compatible; AcoonBot/4.11.1; +http://www.acoon.de/robot.asp)

• AcoonBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; AcoonBot/4.11.1; +http://www.acoon.de/robot.asp)

• Ad Muncher 2x detected

  Example user agent
  Ad Muncher v4.93.33707/4957

• AddThis.com 2x detected

  Example user agent
  AddThis.com robot tech.support@clearspring.com

• AddThis.com robot 1x detected

  Example user agent
  AddThis.com robot tech.support@clearspring.com

• ADJUSTbot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; ADJUSTbot/2.0; +http://www.ad-just.jp/)

• ADMantX 2x detected

  Example user agent
  ADmantX Platform Semantic Analyzer - ADmantX Inc. - www.admantx.com - support@admantx.com

• ADmantX Platform Semantic Analyzer 1x detected

  Example user agent
  ADmantX Platform Semantic Analyzer - ADmantX Inc. - www.admantx.com - support@admantx.com

• AdsBot Google 2x detected

  Example user agent
  AdsBot-Google (+http://www.google.com/adsbot.html)

• AdsBot Google-Mobile 2x detected

  Example user agent
  AdsBot-Google-Mobile (+http://www.google.com/mobile/adsbot.html) Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36

• AdsBot-Google 4x detected

  Example user agent
  AdsBot-Google (+http://www.google.com/adsbot.html)

• AdSense Bot 1x detected

  Example user agent
  Mediapartners-Google

• aggregator VocusBot 1x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; aggregator VocusBot 0.4; +http://www.vocus.com/vnhs.html)

• ahref AhrefsBot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)

• aHrefs Bot 5x detected

  Example user agent
  Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/) AppEngine-Google; (+http://code.google.com/appengine; appid: s~proxyfile1-hrd)

• AhrefsBot 13x detected

  Example user agent
  Mozilla/5.0 (compatible; AhrefsBot/4.0; +http://ahrefs.com/robot/)

• akregator 2x detected

  Example user agent
  Akregator/1.2.9; librss/remnants

• Alexa 1x detected

  Example user agent
  ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)

• Alexa Crawler 1x detected

  Example user agent
  ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)

• Amfibi 1x detected

  Example user agent
  Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com)

• Amfibibot 1x detected

  Example user agent
  Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com)

• Amiga 12x detected

  Example user agent
  Mozilla/5.0 (Amiga; PowerPC AmigaOS 4.1; Odyssey Web Browser; rv:1.23) AppleWebKit/538.1 (KHTML, like Gecko) OWB/1.23 Safari/538.1

• Amorank Spider 2x detected

  Example user agent
  AmorankSpider/0.1; +http://amorank.com/webcrawler.html

• AmorankSpider 1x detected

  Example user agent
  AmorankSpider/0.1; +http://amorank.com/webcrawler.html

• Analytics SEO 1x detected

  Example user agent
  Curious George - www.analyticsseo.com/crawler

• Analytics SEO Crawler 1x detected

  Example user agent
  Curious George - www.analyticsseo.com/crawler

• Android Download Manager 3x detected

  Example user agent
  AndroidDownloadManager/4.1.1 (Linux; U; Android 4.1.1; MID0714 Build/JRO03H)

• Apache Httpd 1x detected

  Example user agent
  Apache-HttpClient/UNAVAILABLE (java 1.4)

• Apache Jakarta 1x detected

  Example user agent
  Jakarta Commons-HttpClient/3.0

• Apache Nutch 15x detected

  Example user agent
  your sipder name/Nutch-1.7

• AppEngine-Google 6x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.3; Trident/7.0; rv:11.0) like Gecko AppEngine-Google; (+http://code.google.com/appengine; appid: s~oowsxs)

• Apple iCloud 1x detected

  Example user agent
  Apple-PubSub/65.28

• Apple-PubSub 1x detected

  Example user agent
  Apple-PubSub/65.28

• Applebot 3x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1)

• Archive.org 7x detected

  Example user agent
  Mozilla/5.0 (compatible; archive.org_bot; Archive-It; +http://archive-it.org/files/site-owners.html)

• archive.org bot 7x detected

  Example user agent
  Mozilla/5.0 (compatible; archive.org_bot; Wayback Machine Live Record; +http://archive.org/details/archive.org_bot)

• archive.org_bot 4x detected

  Example user agent
  Mozilla/5.0 (compatible; archive.org_bot/3.3.0 +http://pandora.nla.gov.au/crawl.html)

• ArchiveBot 2x detected

  Example user agent
  ArchiveTeam ArchiveBot/20140807.01 (wpull 0.37a1) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.125 Safari/537.36

• archiver 1x detected

  Example user agent
  Mozilla/5.0 (compatible; special_archiver/3.2.0 +http://www.loc.gov/webarchiving/notice_to_webmasters.html)

• archiver/3.1.1 +http://www.archive.org/details/archive.org_bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; special_archiver/3.1.1 +http://www.archive.org/details/archive.org_bot)

• ArchiveTeam ArchiveBot 1x detected

  Example user agent
  ArchiveTeam ArchiveBot/20140807.01 (wpull 0.37a1) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.125 Safari/537.36

• Ask Jeeves 3x detected

  Example user agent
  Mozilla/2.0 (compatible; Ask Jeeves/Teoma)

• Backlink-Ceck.de 1x detected

  Example user agent
  Backlink-Ceck.de (+http://www.backlink-check.de/bot.html)

• Backlink-Check 1x detected

  Example user agent
  Backlink-Ceck.de (+http://www.backlink-check.de/bot.html)

• BacklinkCrawler 4x detected

  Example user agent
  BacklinkCrawler (http://www.backlinktest.com/crawler.html)

• BaiDu 6x detected

  Example user agent
  Baiduspider+(+http://www.baidu.com/search/spider_jp.html)

• Baidu Image Search 1x detected

  Example user agent
  Baiduspider-image+(+http://www.baidu.com/search/spider.htm)

• Baidu Mobile Search 1x detected

  Example user agent
  Mozilla/5.0 (Linux;u;Android 2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; +http://www.baidu.com/search/spider.html)

• Baidu Spider 11x detected

  Example user agent
  Baiduspider-image+(+http://www.baidu.com/search/spider.htm)

• Baiduspider 23x detected

  Example user agent
  Baiduspider+(+http://www.baidu.jp/spider/)

• Baiduspider-image 1x detected

  Example user agent
  Baiduspider-image+(+http://www.baidu.com/search/spider.htm)

• BazQux 1x detected

  Example user agent
  Mozilla/5.0 (compatible; BazQux/2.4; +https://bazqux.com/fetcher; 2 subscribers)

• BazQux Reader 1x detected

  Example user agent
  Mozilla/5.0 (compatible; BazQux/2.4; +https://bazqux.com/fetcher; 2 subscribers)

• Bing 17x detected

  Example user agent
  (Windows NT 10.0; Googlebot Googlebot-Image/1.0 msnbot-media/1.1 facebookexternalhit/1.1 Trident/7.0) Maxthon/4.4.5.3000 Firefox/38

• Bing Preview 6x detected

  Example user agent
  Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.2; Trident/6.0) BingPreview/1.0b

• bingbot 39x detected

  Example user agent
  Mozilla/5.0 (compatible; bingbot/2.0 +http://www.bing.com/bingbot.htm)

• BingPreview 3x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/538.14 (KHTML, like Gecko) BingPreview/1.0b

• Blekkobot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; Blekkobot; ScoutJet; +http://blekko.com/about/blekkobot)

• BLEXBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)

• BLEXBot Crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)

• Bloglovin 2x detected

  Example user agent
  Bloglovin/1.0 (http://www.bloglovin.com; 1 subscribers)

• Bloglovin Bot 1x detected

  Example user agent
  Bloglovin/1.0 (http://www.bloglovin.com; 1 subscribers)

• Blogram 1x detected

  Example user agent
  BlogramCrawler/1.0.1(+http://blogram.jp/)

• BlogramCrawler 1x detected

  Example user agent
  BlogramCrawler/1.0.1(+http://blogram.jp/)

• Blogtrottr 2x detected

  Example user agent
  Blogtrottr/2.0

• Borland Delphi 1x detected

  Example user agent
  Mozilla/3.0 (compatible; Indy Library)

• Bot 6x detected

  Example user agent
  Opera/30.0.1835.59 (X11; Linux i686; Ubuntu/14.10) Presto/2.12.388 Version/29.16 AppleWebKit/599.0+ (KHTML, like Gecko) Chrome/41.0.2272.118 Safari/537.36 FAST-WebCrawler/3.8

• Bountii Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; BountiiBot/1.1; +http://bountii.com/contact.php)

• BountiiBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; BountiiBot/1.1; +http://bountii.com/contact.php)

• Browsershots 3x detected

  Example user agent
  Browsershots

• BrowseX 1x detected

  Example user agent
  Mozilla/4.61 [en] (X11; U; ) - BrowseX (2.0.0 Windows)

• BUbiNG 2x detected

  Example user agent
  BUbiNG (+http://law.di.unimi.it/BUbiNG.html)

• BUbiNG Bot 1x detected

  Example user agent
  BUbiNG (+http://law.di.unimi.it/BUbiNG.html)

• Butterfly 3x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Butterfly/1.0; +http://labs.topsy.com/butterfly/) Gecko/2009032608 Firefox/3.0.8

• Butterfly Robot 3x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Butterfly/1.0; +http://labs.topsy.com/butterfly/) Gecko/2009032608 Firefox/3.0.8

• CareerBot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; CareerBot/1.1; +http://www.career-x.de/bot.html)

• CCBot 2x detected

  Example user agent
  CCBot/2.0 (http://commoncrawl.org/faq/)

• ccBot crawler 1x detected

  Example user agent
  CCBot/2.0 (http://commoncrawl.org/faq/)

• CiteSeerX 9x detected

  Example user agent
  Mozilla/5.0 (compatible; heritrix/3.1.2-SNAPSHOT-20130207.001528 +http://webarchiv.cz/kontakty/)

• Cliqzbot 4x detected

  Example user agent
  Cliqzbot/0.1 (+http://cliqz.com/company/cliqzbot)

• CloudFare Always Online 1x detected

  Example user agent
  Mozilla/5.0 (compatible; CloudFlare-AlwaysOnline/1.0; +http://www.cloudflare.com/always-online) AppleWebKit/534.34

• CloudFlare Always Online 1x detected

  Example user agent
  Mozilla/5.0 (compatible; CloudFlare-AlwaysOnline/1.0; +http://www.cloudflare.com/always-online) AppleWebKit/534.34

• CloudFlare AlwaysOnline 1x detected

  Example user agent
  Mozilla/5.0 (compatible; CloudFlare-AlwaysOnline/1.0; +http://www.cloudflare.com/always-online) AppleWebKit/534.34

• cloudforecastbot 1x detected

  Example user agent
  cloudforecastbot

• com robot 1x detected

  Example user agent
  AddThis.com robot tech.support@clearspring.com

• CommaFeed 2x detected

  Example user agent
  CommaFeed/1.0 (http://www.commafeed.com)

• CommonCrawl 1x detected

  Example user agent
  CCBot/2.0 (http://commoncrawl.org/faq/)

• Crawlboy 1x detected

  Example user agent
  CrawlerProcess (http://www.PowerMapper.com) /5.5.678.0

• crawler 5x detected

  Example user agent
  R6_CommentReader(www.radian6.com/crawler)

• CrawlerProcess 2x detected

  Example user agent
  Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.2; WOW64; Trident/6.0) CrawlerProcess (http://www.PowerMapper.com) /5.10.736.0

• crawlingpolicy 1x detected

  Example user agent
  HubPages V0.2.2 (http://hubpages.com/help/crawlingpolicy)

• cURL 3x detected

  Example user agent
  curl/7.14.1 (i386-portbld-freebsd4.7) libcurl/7.14.1 OpenSSL/0.9.8 zlib/1.1.3

• Data Hotel Watchdog 1x detected

  Example user agent
  Data-Hotel-Watchdog/1.1

• Dazoobot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Dazoobot/0.1; +http://dazoo.fr)

• de/bot 1x detected

  Example user agent
  Backlink-Ceck.de (+http://www.backlink-check.de/bot.html)

• Detector Crawler 1x detected

  Example user agent
  StatusCake Error Detector Crawler V0.01

• Discobot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html)

• Domain Re-Animator 1x detected

  Example user agent
  Domain Re-Animator Bot (http://domainreanimator.com) - support@domainreanimator.com

• Domain Re-Animator Bot 2x detected

  Example user agent
  Domain Re-Animator Bot (http://domainreanimator.com) - support@domainreanimator.com

• dotbot 2x detected

  Example user agent
  dotbot

• Easou Spider 2x detected

  Example user agent
  Mozilla/5.0 (iPhone; U; CPU iPhone OS 3_0 like Mac OS X; en-us; EasouSpider; +http://www.easou.com/search/spider.html)

• EasouSpider 3x detected

  Example user agent
  Mozilla/5.0 (compatible; EasouSpider; +http://www.easou.com/search/spider.html)

• EMail Exractor 1x detected

  Example user agent
  EMail Exractor

• EnaBot 1x detected

  Example user agent
  EnaBot/1.2 (http://www.enaball.com/crawler.html)

• Envolk 2x detected

  Example user agent
  envolk/1.7 (+http://www.envolk.com/envolkspiderinfo.html)

• EuripBot 1x detected

  Example user agent
  EuripBot/0.5 (+http://www.eurip.com) PreCheck

• Europe Internet Portal 1x detected

  Example user agent
  EuripBot/0.5 (+http://www.eurip.com) PreCheck

• Exabot 8x detected

  Example user agent
  Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)

• Exabot Thumbnails 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails)

• ExactSeek 1x detected

  Example user agent
  ExactSeek Crawler (nutch 1.4)/Nutch-1.4 (ExactSeek Crawler; http://www.exactseek.com)

• ExactSeek Crawler 1x detected

  Example user agent
  ExactSeek Crawler (nutch 1.4)/Nutch-1.4 (ExactSeek Crawler; http://www.exactseek.com)

• Exalead 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails)

• Ezooms 4x detected

  Example user agent
  Mozilla/5.0 (compatible; Ezooms/1.0; help@moz.com)

• Ezooms Crawler 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)

• ezooms.bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)

• Facebook 10x detected

  Example user agent
  facebookplatform/1.0 (+http://developers.facebook.com)

• Facebook External Hit 4x detected

  Example user agent
  facebookexternalhit/1.1

• FacebookBot 5x detected

  Example user agent
  (Windows NT 10.0; Googlebot Googlebot-Image/1.0 msnbot-media/1.1 facebookexternalhit/1.1 Trident/7.0) Maxthon/4.0

• FacebookExternalHit 3x detected

  Example user agent
  facebookexternalhit/1.1 (+http(s)://www.facebook.com/externalhit_uatext.php)

• Facebookscraper 2x detected

  Example user agent
  facebookscraper/1.0( http://www.facebook.com/sharescraper_help.php)

• Fake Browser 20x detected

  Example user agent
  Mozilla/5.0 (;;;) AppleWebKit/538.8 HbbTV/1.1.1 (+DL+PVR; inverto; QUANTUM - IDL9000; 1.0; 1.0;) CE-HTML/1.0 hdplusinteraktiv/1.0 (NETRANGEMMH;)

• Fake Chrome 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML like Gecko) Chrome/33.0.1750.91 Safari/537.36 OPR/20.0.1387.37 (Edition Next-Campaign 21)

• Fake Firefox 1x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.9.2.8) Firefox/3.6.8/Nutch-1.7

• Fake IE 5x detected

  Example user agent
  Mozilla/5.0 (MOT-A3300c/A3300c_03.08; U; Windows Mobile/6.1; Profile/MIDP-2.0 Configuration/CLDC-1.1; 240*400; CTC/2.0) IE/MSIE 6.0 (compatible; MSIE 6.0; Windows CE; IEMobile 8.12; MSIEMobile 6.0)

• Fake Safari 8x detected

  Example user agent
  Mozilla/5.0 (Linux; U; Android 4.1.1; en-us; Luna TAB07-920N Build/JRO03C) AppleWebKit/534.30 (KHTML like Gecko) Version/4.0 Mobile Safari/534.30

• FAST Enterprise Crawler 3x detected

  Example user agent
  FAST Enterprise Crawler/5.3.4 (crawler@fast.no)

• FAST Web Crawler 2x detected

  Example user agent
  Opera/30.0.1835.59 (X11; Linux i686; Ubuntu/14.10) Presto/2.12.388 Version/29.16 AppleWebKit/599.0+ (KHTML, like Gecko) Chrome/41.0.2272.118 Safari/537.36 FAST-WebCrawler/3.8

• FAST-WebCrawler 3x detected

  Example user agent
  FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)

• Fastladder 1x detected

  Example user agent
  Fastladder FeedFetcher/0.01 (http://fastladder.com/; 27 subscribers)

• favicon_archive 1x detected

  Example user agent
  FaviconArchiver/1.0 (+http://moblur.org/workshop/favicon_archive/)

• Feed Crawler 1x detected

  Example user agent
  www2.apserver.net ASP-Ranker Feed Crawler

• Feed Wrangler 1x detected

  Example user agent
  Feed Wrangler/1.0 (3 subscribers; feed-id=248559; http://feedwrangler.net; Allow like Gecko)

• Feedbin 2x detected

  Example user agent
  Feedbin - 9 subscribers

• FeedBurner 2x detected

  Example user agent
  FeedBurner/1.0 (http://www.FeedBurner.com)

• FeedDemon 2x detected

  Example user agent
  FeedDemon/4.5 (http://www.feeddemon.com/; Microsoft Windows)

• FeedFetcher 1x detected

  Example user agent
  livedoor FeedFetcher/0.01 (http://reader.livedoor.com/; 999 subscribers)

• Feedfetcher-Google 5x detected

  Example user agent
  Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; 375 subscribers; feed-id=15381863289700640853)

• Feedly 7x detected

  Example user agent
  FeedlyBot/1.0 (http://feedly.com)

• feedly App 1x detected

  Example user agent
  FeedlyApp/1.0 (http://www.feedly.com)

• feedly Feed Fetcher 1x detected

  Example user agent
  Feedly/1.0 (+http://www.feedly.com/fetcher.html; like FeedFetcher-Google)

• FeedlyBot 1x detected

  Example user agent
  FeedlyBot/1.0 (http://feedly.com)

• Feedspot 2x detected

  Example user agent
  Feedspot http://www.feedspot.com

• FeedValidator 2x detected

  Example user agent
  FeedValidator/1.3

• FeedWrangler 1x detected

  Example user agent
  Feed Wrangler/1.0 (3 subscribers; feed-id=248559; http://feedwrangler.net; Allow like Gecko)

• FeedZirra 1x detected

  Example user agent
  feedzirra http://github.com/pauldix/feedzirra/tree/master

• Fever 2x detected

  Example user agent
  Fever/1.38 (Feed Parser; http://feedafever.com; Allow like Gecko)

• Flamingo Search 1x detected

  Example user agent
  Flamingo_SearchEngine (+http://www.flamingosearch.com/bot)

• Flamingo_SearchEngine 1x detected

  Example user agent
  Flamingo_SearchEngine (+http://www.flamingosearch.com/bot)

• FTRF: Friendly Robot 2x detected

  Example user agent
  FTRF: Friendly robot/1.3

• Gazeta Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Linux i686; Yandex.Gazeta Bot/1.0; +http://gazeta.yandex.ru)

• General Crawlers 11x detected

  Example user agent
  SonyEricssonJ108i/R7EA Profile/MIDP-2.1 Configuration/CLDC-1.1 UNTRUSTED/1.0 UCWEB/2.0 (Java; U; MIDP-2.0; xx; SonyEricssonJ108i) U2/1.0.0 UCBrowser/9.4.0.342 U2/1.0.0 Mobile

• Generic Bot 39x detected

  Example user agent
  cloudforecastbot

• Generic Crawler 2x detected

  Example user agent
  User-Agent: Mozilla/1.0N (X11; SunOS 4.1.1 sun4c)

• Generic Ruby Crawler 1x detected

  Example user agent
  Ruby

• Genieo 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Genieo/1.0 http://www.genieo.com/webfilter.html)

• Genieo Web Filter 4x detected

  Example user agent
  Mozilla/5.0 (compatible; Genieo/1.0 http://www.genieo.com/webfilter.html)

• Gluten Free Crawler 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Gluten Free Crawler/1.0; +http://glutenfreepleasure.com/)

• Gmail Image Proxy 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 5.1; rv:11.0) Gecko Firefox/11.0 (via ggpht.com GoogleImageProxy)

• GNIP 1x detected

  Example user agent
  UnwindFetchor/1.0 (+http://www.gnip.com/)

• Gocrawl 1x detected

  Example user agent
  Googlebot (gocrawl v0.4)

• Goo 8x detected

  Example user agent
  DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://help.goo.ne.jp/help/article/1142/)

• Goo Blog Search 1x detected

  Example user agent
  gooblogsearch/2.0 (http://search.goo.ne.jp/option/use/sub4/sub4-1/)

• Goo RSS Reader 1x detected

  Example user agent
  gooRSSreader3.7 - build20090410

• Google 1x detected

  Example user agent
  Mozilla/5.0 (en-us) AppleWebKit/525.13 (KHTML, like Gecko; Google Web Preview) Version/3.1 Safari/525.13

• Google Ads Bot 4x detected

  Example user agent
  AdsBot-Google-Mobile (+http://www.google.com/mobile/adsbot.html) Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36

• Google App Engine 8x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.3; WOW64; rv:27.0) Gecko/20100101 Firefox/27.0 AppEngine-Google; (+http://code.google.com/appengine; appid: s~chengzhoukun)

• Google AppEngine 7x detected

  Example user agent
  AppEngine-Google

• Google Bot 13x detected

  Example user agent
  Mozilla/5.0 AppleWebKit/537.4 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Safari/537.4

• Google Bot Mobile 3x detected

  Example user agent
  SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

• Google FeedBurner 2x detected

  Example user agent
  FeedBurner/1.0 (http://www.FeedBurner.com)

• Google Feedfetcher 13x detected

  Example user agent
  Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; 19 subscribers; feed-id=13965549748850348809)

• Google Image Proxy 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 5.1; rv:11.0) Gecko Firefox/11.0 (via ggpht.com GoogleImageProxy)

• Google Mediapartners 4x detected

  Example user agent
  DoCoMo/2.0 SH905i(c100;TB;W24H16) (compatible; Mediapartners-Google/2.1; +http://www.google.com/bot.html)

• Google News 2x detected

  Example user agent
  Googlebot-News

• Google Page Speed 2x detected

  Example user agent
  Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; Google Page Speed Insights) Chrome/27.0.1453 Safari/537.36

• Google PageSpeed Insights 6x detected

  Example user agent
  Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_0_1 like Mac OS X; en-us) AppleWebKit/537.4 (KHTML, like Gecko; Google Page Speed Insights) Version/4.0.5 Mobile/8A306 Safari/6531.22.7

• Google Play Newsstand 1x detected

  Example user agent
  GoogleProducer; (+http://goo.gl/7y4SX)

• Google Sitemaps 1x detected

  Example user agent
  Google-Sitemaps/1.0

• Google Web Preview 8x detected

  Example user agent
  Mozilla/5.0 (Linux; U; Android 2.3.4; generic) AppleWebKit/537.4 (KHTML, like Gecko; Google Web Preview) Version/4.0 Mobile Safari/537.4

• Google Web Snippet 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; rv:6.0) Gecko/20110814 Firefox/6.0 Google (+https://developers.google.com/+/web/snippet/)

• Google Wireless Transcoder 3x detected

  Example user agent
  Mozilla/5.0 (en-us) AppleWebKit/534.14 (KHTML, like Gecko; Google Wireless Transcoder) Chrome/9.0.597 Safari/534.14

• Google-Sitemaps 1x detected

  Example user agent
  Google-Sitemaps/1.0

• Googlebot 73x detected

  Example user agent
  Mozilla/5.0 AppleWebKit/537.4 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Safari/537.4

• Googlebot Image 1x detected

  Example user agent
  Googlebot-Image/1.0

• Googlebot Mobile 6x detected

  Example user agent
  SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

• Googlebot Video 1x detected

  Example user agent
  Googlebot-Video/1.0

• Googlebot-Image 2x detected

  Example user agent
  Googlebot-Image/1.0

• Googlebot-Mobile 3x detected

  Example user agent
  DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

• Googlebot-News 4x detected

  Example user agent
  Googlebot-News (2.3.3, ruby 1.9.3 (2013-11-22))

• Googlebot-Video 2x detected

  Example user agent
  Googlebot-Video/1.0

• GooglePlusBot 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; rv:6.0) Gecko/20110814 Firefox/6.0 Google (+https://developers.google.com/+/web/snippet/)

• Grub 2x detected

  Example user agent
  grub-client-1.5.3; (grub-client-1.5.3; Crawl your own stuff with http://grub.org)

• grub-client 1x detected

  Example user agent
  grub-client-1.5.3; (grub-client-1.5.3; Crawl your own stuff with http://grub.org)

• Hatena 3x detected

  Example user agent
  Hatena Pagetitle Agent/1.0

• Hatena Antenna 2x detected

  Example user agent
  Hatena Antenna/0.5 (http://a.hatena.ne.jp/help)

• Hatena Diary 1x detected

  Example user agent
  Hatena Diary RSS Module (http://d.hatena.ne.jp/help#rssmodule)

• Hatena Pagetitle 1x detected

  Example user agent
  Hatena Pagetitle Agent/1.0

• HeartRails Capture 1x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux i686; xx; rv:1.9.2.18) Gecko/20110622 HeartRails_Capture/1.0.5 (+http://capture.heartrails.com/) Namoroka/3.6.18

• Help:Bot 1x detected

  Example user agent
  ShopWiki/1.0 ( +http://www.shopwiki.com/wiki/Help:Bot)

• Heritrix 29x detected

  Example user agent
  Mozilla/5.0 (compatible; heritrix/1.14.4 +http://www.dla-marbach.de)

• HTTPMon 2x detected

  Example user agent
  HTTPMon/1.0b (http://www.httpmon.com)

• HubPages 2x detected

  Example user agent
  HubPages V0.2.2 (http://hubpages.com/help/crawlingpolicy)

• ia_archiver 1x detected

  Example user agent
  ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)

• ICC-Crawler 3x detected

  Example user agent
  ICC-Crawler/2.0 (Mozilla-compatible; ; http://www.nict.go.jp/en/univ-com/plan/crawl.html)

• Ichiro 3x detected

  Example user agent
  ichiro/3.0 (http://help.goo.ne.jp/door/crawler.html)

• Ichiro Bot 1x detected

  Example user agent
  ichiro/3.0 (http://help.goo.ne.jp/door/crawler.html)

• Ichiro Mobile Bot 2x detected

  Example user agent
  DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://search.goo.ne.jp/option/use/sub4/sub4-1/)

• ichiro/mobile 2x detected

  Example user agent
  DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://help.goo.ne.jp/help/article/1142/)

• IIS Site Analysis 1x detected

  Example user agent
  iisbot/1.0 (+http://www.iis.net/iisbot.html)

• IIS Site Analysis Web Crawler 1x detected

  Example user agent
  iisbot/1.0 (+http://www.iis.net/iisbot.html)

• iisbot 1x detected

  Example user agent
  iisbot/1.0 (+http://www.iis.net/iisbot.html)

• Indy Library 1x detected

  Example user agent
  Mozilla/3.0 (compatible; Indy Library)

• Internet Archive 5x detected

  Example user agent
  Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)

• Internet Archive Special Archiver 2x detected

  Example user agent
  Mozilla/5.0 (compatible; special_archiver/3.2.0 +http://www.loc.gov/webarchiving/notice_to_webmasters.html)

• Jakarta Commons HttpClient 1x detected

  Example user agent
  Jakarta Commons-HttpClient/3.0

• Java 1x detected

  Example user agent
  Java/1.5.0_17

• Java Standard Library 1x detected

  Example user agent
  Java/1.5.0_17

• jig browser web 19x detected

  Example user agent
  Mozilla/4.0 (jig browser web; 1.0.4; F02A)

• Jigsaw_W3C_CSS_Validator 1x detected

  Example user agent
  Jigsaw/2.3.0 W3C_CSS_Validator_JFouffa/2.0 (See )

• kizasi-spider 1x detected

  Example user agent
  kizasi-spider/1.0 (+http://kizasi.jp/)

• Kouio 4x detected

  Example user agent
  kouio.com RSS reader

• Larbin 3x detected

  Example user agent
  larbin_2.6.3 larbin2.6.3@unspecified.mail

• Larbin web crawler 1x detected

  Example user agent
  larbin_2.6.3 larbin2.6.3@unspecified.mail

• libwww 7x detected

  Example user agent
  NCSA_Mosaic/2.7b5 (X11;Linux 2.6.7 i686) libwww/2.12 modified

• Liferea 3x detected

  Example user agent
  Liferea/1.6.4 (Linux; en_US.UTF-8; http://liferea.sf.net/)

• Linkdex Bot 7x detected

  Example user agent
  Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML, like Gecko) Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; linkdexbot-mobile/2.1; +http://www.linkdex.com/about/bots/)

• linkdexbot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; linkdexbot/2.0; +http://www.linkdex.com/about/bots/)

• Linkedin Bot 2x detected

  Example user agent
  LinkedInBot/1.0 (compatible; Mozilla/5.0; Jakarta Commons-HttpClient/3.1 +http://www.linkedin.com)

• LinkedInBot 2x detected

  Example user agent
  LinkedInBot/1.0 (compatible; Mozilla/5.0; Jakarta Commons-HttpClient/3.1 +http://www.linkedin.com)

• Livedoor 4x detected

  Example user agent
  livedoor FeedFetcher/0.01 (http://reader.livedoor.com/; 999 subscribers)

• livedoor FeedFetcher 2x detected

  Example user agent
  livedoor FeedFetcher/0.01 (http://reader.livedoor.com/; 999 subscribers)

• LTX71 2x detected

  Example user agent
  ltx71 - (http://ltx71.com/)

• ltx71 Bot 1x detected

  Example user agent
  ltx71 - (http://ltx71.com/)

• lwp 3x detected

  Example user agent
  lwp-trivial/1.41

• Magpie RSS 2x detected

  Example user agent
  MagpieRSS/0.61 (+http://magpierss.sf.net)

• Magpie-Crawler 3x detected

  Example user agent
  magpie-crawler/1.1 (U; Linux amd64; en-GB; +http://www.brandwatch.net)

• MagpieRSS 4x detected

  Example user agent
  MagpieRSS/0.72 (+http://magpierss.sf.net)

• Mail.Ru 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)

• Mail.Ru Bot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; +http://go.mail.ru/help/robots)

• Mail.RU_Bot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; +http://go.mail.ru/help/robots)

• Mapian News Bot 2x detected

  Example user agent
  "mapion-news-bot/1.0 (http://www.mapion.co.jp/news/)"

• mapion-news-bot 2x detected

  Example user agent
  mapion-news-bot/1.0 (http://www.mapion.co.jp/news/)

• Meanpath Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; meanpathbot/1.0; +http://www.meanpath.com/meanpathbot.html)

• meanpathbot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; meanpathbot/1.0; +http://www.meanpath.com/meanpathbot.html)

• Mediapartners-Google 1x detected

  Example user agent
  DoCoMo/2.0 SH905i(c100;TB;W24H16) (compatible; Mediapartners-Google/2.1; +http://www.google.com/bot.html)

• misc crawler 155x detected

  Example user agent
  Googlebot/2.1 ( http://www.googlebot.com/bot.html)

• mixi 4x detected

  Example user agent
  mixi-news-crawler/1.00 (http://mixi.jp/)

• mixi-crawler 1x detected

  Example user agent
  mixi-crawler/2.00 (http://mixi.jp/)

• mixi-news-crawler 1x detected

  Example user agent
  mixi-news-crawler/1.00 (http://mixi.jp/)

• Mixrank Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; MixrankBot; crawler@mixrank.com)

• MixrankBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; MixrankBot; crawler@mixrank.com)

• MJ12 Bot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; MJ12bot/v1.4.4; http://www.majestic12.co.uk/bot.php?+)

• MJ12bot 4x detected

  Example user agent
  Mozilla/5.0 (compatible; MJ12bot/v1.4.0; http://www.majestic12.co.uk/bot.php?+)

• MojeekBot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; MojeekBot/0.6; http://www.mojeek.com/bot.html)

• Monitor.us 2x detected

  Example user agent
  Mozilla/5.0 (compatible; www.monitor.us - free monitoring service; http://www.monitor.us)

• MSN 2x detected

  Example user agent
  MSNBot/Nutch-1.5.1

• msnbot 25x detected

  Example user agent
  msnbot/2.0b ( http://search.msn.com/msnbot.htm)

• msnbot-media 2x detected

  Example user agent
  msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)

• msnbot-NewsBlogs 1x detected

  Example user agent
  msnbot-NewsBlogs/2.0b (+http://search.msn.com/msnbot.htm)

• NalezenCzBot 2x detected

  Example user agent
  NalezenCzBot/1.0 (http://www.nalezen.cz/about-crawler)

• NameProtect 1x detected

  Example user agent
  abot/0.1 (abot; http://www.abot.com; abot@abot.com)

• Naver Yeti 4x detected

  Example user agent
  Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)

• NaverBot 2x detected

  Example user agent
  Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)

• Netcraft Survey Bot 2x detected

  Example user agent
  Mozilla/4.0 (compatible; Netcraft Web Server Survey)

• Netcraft Webserver Survey 1x detected

  Example user agent
  Mozilla/4.0 (compatible; Netcraft Web Server Survey)

• NetNewsWire 3x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_2) AppleWebKit/537.74.9 (KHTML, like Gecko) Version/6.0 NetNewsWire/4.0.0

• NetSurf 2x detected

  Example user agent
  NetSurf/3.0 (RISC OS)

• Netvibes 8x detected

  Example user agent
  Netvibes (http://www.netvibes.com/; 8 subscribers; feedID: 2244192)

• New-Sogou-Spider 1x detected

  Example user agent
  New-Sogou-Spider/1.0 (compatible; MSIE 5.5; Windows 98)

• NewsBlur 8x detected

  Example user agent
  NewsBlur Feed Fetcher - 7 subscribers - http://www.newsblur.com/site/1948420/analytics-piwik (Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_1) AppleWebKit/534.48.3 (KHTML, like Gecko) Version/5.1 Safari/534.48.3)

• NewsBlur Favicon Fetcher 3x detected

  Example user agent
  NewsBlur Page Fetcher - 7 subscribers - http://www.newsblur.com/site/3966817/analytics-piwik (Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_1) AppleWebKit/534.48.3 (KHTML, like Gecko) Version/5.1 Safari/534.48.3)

• NewsGator 2x detected

  Example user agent
  NewsGatorOnline/2.0 (http://www.newsgator.com; 2 subscribers)

• NewsGatorOnline 2x detected

  Example user agent
  NewsGatorOnline/2.0 (http://www.newsgator.com; 2 subscribers)

• niki-bot 1x detected

  Example user agent
  niki-bot

• NikiBot 1x detected

  Example user agent
  niki-bot

• nlcrawler 2x detected

  Example user agent
  nlcrawler/1.0 (+http://northernlight.com/)

• Nutch 31x detected

  Example user agent
  5acd734a-1ed3-4a17-ad9d-0b09ae7bc2d2/Nutch-1.7

• Nutch-based Bot 14x detected

  Example user agent
  emBot-GalaBuzz/Nutch-1.0 (http://emining.jp/; em@galabuzz.jp)

• OffByOne 1x detected

  Example user agent
  Mozilla/4.7 (compatible; OffByOne; Windows 2000) Webster Pro V3.4

• Omea Reader 1x detected

  Example user agent
  JetBrains Omea Reader 2.2 (http://www.jetbrains.com/omea/reader/)

• Omgili bot 1x detected

  Example user agent
  omgilibot/0.3 +http://www.omgili.com/Crawler.html

• omgilibot 1x detected

  Example user agent
  omgilibot/0.3 +http://www.omgili.com/Crawler.html

• Openindex Spider 1x detected

  Example user agent
  Mozilla/5.0 (compatible; OpenindexSpider; +http://www.openindex.io/en/webmasters/spider.html)

• OpenindexSpider 1x detected

  Example user agent
  Mozilla/5.0 (compatible; OpenindexSpider; +http://www.openindex.io/en/webmasters/spider.html)

• OpenLinkProfiler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; spbot/4.0.9; +http://OpenLinkProfiler.org/bot )

• OpenWebSpider 4x detected

  Example user agent
  OpenWebSpider v0.1.4 (http://www.openwebspider.org/)

• Orange Bot 4x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1;fr;rv:1.8.1) VoilaBotCollector BETA 0.1 (http://www.voila.com/)

• OrangeBot 4x detected

  Example user agent
  Mozilla/5.0 (compatible; OrangeBot-Collector/2.0; support.orangebot@orange.com)

• Outbrain 1x detected

  Example user agent
  Mozilla/5.0 (Java) outbrain

• Paper.li Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; PaperLiBot/2.1; http://support.paper.li/entries/20023257-what-is-paper-li)

• PaperLiBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; PaperLiBot/2.1; http://support.paper.li/entries/20023257-what-is-paper-li)

• PEAR HTTP_Request2 1x detected

  Example user agent
  HTTP_Request2/2.1.1 (http://pear.php.net/package/http_request2) PHP/5.3.10-1ubuntu3.6

• PEAR-PHP 1x detected

  Example user agent
  PEAR HTTP_Request class

• PECL HTTP 1x detected

  Example user agent
  PECL::HTTP/1.7.4 (PHP/5.4.4)

• Perl 3x detected

  Example user agent
  libwww-perl/5.835

• PHP 11x detected

  Example user agent
  PHP

• PHP Server Monitor 1x detected

  Example user agent
  Mozilla/5.0 (compatible; phpservermon/3.1.1; +http://www.phpservermonitor.org)

• Picsearch Bot 5x detected

  Example user agent
  psbot/0.1 (+http://www.picsearch.com/bot.html)

• Pingdom 2x detected

  Example user agent
  Pingdom.com_bot_version_1.4_(http://www.pingdom.com/)

• Pingdom Bot 1x detected

  Example user agent
  Pingdom.com_bot_version_1.4_(http://www.pingdom.com/)

• PingdomBot 1x detected

  Example user agent
  Pingdom.com_bot_version_1.4_(http://www.pingdom.com/)

• Pinterest 2x detected

  Example user agent
  Pinterest/0.2 (+http://www.pinterest.com/)

• PostRank 1x detected

  Example user agent
  PostRank/2.0 (postrank.com; 1 subscribers)

• PowerMapper 2x detected

  Example user agent
  Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.2; WOW64; Trident/6.0) CrawlerProcess (http://www.PowerMapper.com) /5.10.736.0

• psbot 2x detected

  Example user agent
  psbot/0.1 (+http://www.picsearch.com/bot.html)

• Python 1x detected

  Example user agent
  Python-urllib/1.16

• Python-urllib 2x detected

  Example user agent
  Python-urllib/1.16

• QuerySeekerSpider 4x detected

  Example user agent
  QuerySeekerSpider ( http://queryseeker.com/bot.html )

• R6 CommentReader 1x detected

  Example user agent
  R6_CommentReader(www.radian6.com/crawler)

• R6 FeedFetcher 1x detected

  Example user agent
  R6_FeedFetcher(www.radian6.com/crawler)

• Radian 6 2x detected

  Example user agent
  R6_CommentReader(www.radian6.com/crawler)

• Rakutenbot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Rakutenbot/1.0; +http://dynamic.rakuten.co.jp/bot.html)

• Reddit 1x detected

  Example user agent
  Mozilla/5.0 (compatible; redditbot/1.0; +http://www.reddit.com/feedback)

• Reddit Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; redditbot/1.0; +http://www.reddit.com/feedback)

• redditbot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; redditbot/1.0; +http://www.reddit.com/feedback)

• Rippers 2x detected

  Example user agent
  Mozilla/3.0 (compatible; Indy Library)

• robot 1x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/2010040121 Firefox/3.0.19

• Rogerbot 14x detected

  Example user agent
  rogerbot/1.0 (http://www.moz.com/dp/rogerbot, rogerbot-crawler@moz.com)

• ROI Hunter 2x detected

  Example user agent
  ROI Hunter; https://api-dev.roihunter.com

• RssBandit 2x detected

  Example user agent
  RssBandit/1.9.0.1002

• RssBar 2x detected

  Example user agent
  RssBar/1.29 (RssBar for unDonut 1.35)

• RSSOwl 2x detected

  Example user agent
  RSSOwl/2.2.1.201312301316 (X11; U; en)

• Ruby 1x detected

  Example user agent
  Ruby

• Safari 1x detected

  Example user agent
  NewsBlur Favicon Fetcher - 7 subscribers - http://www.newsblur.com/site/1948420/analytics-piwik (Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_1) AppleWebKit/534.48.3 (KHTML, like Gecko) Version/5.1 Safari/534.48.3)

• Safari RSS 1x detected

  Example user agent
  AppleSyndication/56.1

• salesforce radian6 2x detected

  Example user agent
  R6_CommentReader(www.radian6.com/crawler)

• Scrapy 8x detected

  Example user agent
  Scrapy/0.24.6 (+http://scrapy.org)

• Screaming Frog SEO Spider 3x detected

  Example user agent
  Screaming Frog SEO Spider/2.22

• ScreenerBot 4x detected

  Example user agent
  ScreenerBot Crawler Beta 2.0 (+http://www.ScreenerBot.com)

• Semrush Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; SemrushBot/0.97; +http://www.semrush.com/bot.html)

• SemrushBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; SemrushBot/0.97; +http://www.semrush.com/bot.html)

• Sensika Bot 1x detected

  Example user agent
  SensikaBot/x.33 (+http://sensika.com)

• SensikaBot 1x detected

  Example user agent
  SensikaBot/x.33 (+http://sensika.com)

• SEOENGBot 1x detected

  Example user agent
  SEOENGWorldBot/1.0 (+http://www.seoengine.com/seoengbot.htm)

• SEOENGWorldBot 1x detected

  Example user agent
  SEOENGWorldBot/1.0 (+http://www.seoengine.com/seoengbot.htm)

• SeoMoz rogerbot 2x detected

  Example user agent
  rogerbot/1.0 (http://www.seomoz.org/dp/rogerbot, rogerbot-crawler+shiny@seomoz.org)

• SEOprofiler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; spbot/4.0.9; +http://OpenLinkProfiler.org/bot )

• Server Density 2x detected

  Example user agent
  Server Density Service Monitoring v2

• Seznam Bot 4x detected

  Example user agent
  Mozilla/5.0 (compatible; SeznamBot/3.2; +http://fulltext.sblog.cz/)

• SeznamBot 8x detected

  Example user agent
  Mozilla/5.0 (compatible; SeznamBot/3.1-test1; +http://fulltext.sblog.cz/)

• ShopWiki 3x detected

  Example user agent
  ShopWiki/1.0 ( +http://www.shopwiki.com/wiki/Help:Bot)

• SilverReader 2x detected

  Example user agent
  SilverReader/1.0; http://silverreader.com

• SimplePie 11x detected

  Example user agent
  SimplePie/1.3-dev (Feed Parser; http://simplepie.org; Allow like Gecko) Build/20111118194710

• SISTRIX Crawler 3x detected

  Example user agent
  Mozilla/5.0 (compatible; SISTRIX Crawler; http://crawler.sistrix.net/)

• Site24x7 1x detected

  Example user agent
  Site24x7

• Site24x7 Website Monitoring 1x detected

  Example user agent
  Site24x7

• Sogou inst spider 1x detected

  Example user agent
  Sogou inst spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

• Sogou Pic Spider 2x detected

  Example user agent
  Sogou Pic Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm

• Sogou Spider 5x detected

  Example user agent
  Sogou inst spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

• Sogou Web Spider 4x detected

  Example user agent
  Sogou inst spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

• Soso Spider 1x detected

  Example user agent
  Sosospider+(+http://help.soso.com/webspider.htm)

• Soso Web Spider 1x detected

  Example user agent
  Sosospider+(+http://help.soso.com/webspider.htm)

• Sosospider 2x detected

  Example user agent
  Sosospider+(+http://help.soso.com/webspider.htm)

• spbot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; spbot/4.0.9; +http://OpenLinkProfiler.org/bot )

• spider 1x detected

  Example user agent
  Mozilla/5.0 (Linux;u;Android 2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; +http://www.baidu.com/search/spider.html)

• Spinn3r 2x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/2010040121 Firefox/3.0.19

• Spinn3r RSS Aggregator 1x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/2010040121 Firefox/3.0.19

• Sputnik Bot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; SputnikBot/2.2)

• SputnikBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; SputnikBot/2.2)

• SputnikImageBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; SputnikImageBot/2.2)

• Squid 3x detected

  Example user agent
  BREW-Applet/0x20068888 (BREW/3.1.5.20; DeviceId: 90086; Lang: zhcn) ucweb-squid

• StatusCake Error Detector 1x detected

  Example user agent
  StatusCake Error Detector Crawler V0.01

• Summify 1x detected

  Example user agent
  Summify (Summify/1.0.1; +http://summify.com)

• Superfeedr Bot 3x detected

  Example user agent
  Superfeedr bot/2.0 http://superfeedr.com - Make your feeds realtime: get in touch!

• Survey Bot 1x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.9.0.13) Gecko/2009073022 Firefox/3.5.2 (.NET CLR 3.5.30729) SurveyBot/2.3 (DomainTools)

• SurveyBot 2x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.9.0.13) Gecko/2009073022 Firefox/3.5.2 (.NET CLR 3.5.30729) SurveyBot/2.3 (DomainTools)

• TelegramBot 1x detected

  Example user agent
  TelegramBot (like TwitterBot)

• TelgramBot 1x detected

  Example user agent
  TelegramBot (like TwitterBot)

• TinEye Bot 1x detected

  Example user agent
  TinEye-bot/0.02 (see http://www.tineye.com/crawler.html)

• TinEye Crawler 1x detected

  Example user agent
  TinEye-bot/0.02 (see http://www.tineye.com/crawler.html)

• TinEye-bot 1x detected

  Example user agent
  TinEye-bot/0.02 (see http://www.tineye.com/crawler.html)

• Tiny Tiny RSS 6x detected

  Example user agent
  Tiny Tiny RSS/1.10 (http://tt-rss.org/)

• topsy Butterfly 2x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Butterfly/1.0; +http://labs.topsy.com/butterfly/) Gecko/2009032608 Firefox/3.0.8

• TurnitinBot 3x detected

  Example user agent
  TurnitinBot/3.0 (http://www.turnitin.com/robot/crawlerinfo.html)

• TweetedTimes Bot 5x detected

  Example user agent
  Mozilla/5.0 (compatible; TweetedTimes Bot/1.0; +http://tweetedtimes.com)

• Tweetmeme Bot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; TweetmemeBot/3.0; +http://tweetmeme.com/)

• TweetmemeBot 4x detected

  Example user agent
  Mozilla/5.0 (compatible; TweetmemeBot/3.0; +http://tweetmeme.com/)

• Twisted PageGetter 2x detected

  Example user agent
  Twisted PageGetter

• twitter 1x detected

  Example user agent
  Twitterbot/1.0

• Twitterbot 5x detected

  Example user agent
  Twitterbot/1.0

• Typhoeus 1x detected

  Example user agent
  Typhoeus - https://github.com/typhoeus/typhoeus

• Uptime Robot 1x detected

  Example user agent
  Mozilla/5.0+(compatible; UptimeRobot/2.0; http://www.uptimerobot.com/)

• UptimeRobot 1x detected

  Example user agent
  Mozilla/5.0+(compatible; UptimeRobot/2.0; http://www.uptimerobot.com/)

• URLAppendBot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; URLAppendBot/1.0; +http://www.profound.net/urlappendbot.html)

• Visual Site Mapper Crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; VSMCrawler; http://www.visualsitemapper.com/crawler/)

• VocusBot 1x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; aggregator VocusBot 0.4; +http://www.vocus.com/vnhs.html)

• VoilaBot 6x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1;fr;rv:1.8.1) VoilaBotCollector BETA 0.1 (http://www.voila.com/)

• VSMCrawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; VSMCrawler; http://www.visualsitemapper.com/crawler/)

• W3C CSS Validator 2x detected

  Example user agent
  Jigsaw/2.3.0 W3C_CSS_Validator_JFouffa/2.0 (See )

• W3C I18N Checker 2x detected

  Example user agent
  W3C_I18n-Checker/1.0 (http://validator.w3.org/services)

• W3C Internationalization Checker 1x detected

  Example user agent
  W3C_I18n-Checker/1.0 (http://validator.w3.org/services)

• W3C Link Checker 4x detected

  Example user agent
  W3C-checklink/4.81 libwww-perl/5.836

• W3C Markup Validation Service 2x detected

  Example user agent
  W3C_Validator/1.3 http://validator.w3.org/services

• W3C Markup Validator 2x detected

  Example user agent
  W3C_Validator/1.3 http://validator.w3.org/services

• W3C MobileOK Checker 2x detected

  Example user agent
  W3C-mobileOK/DDC-1.0 (see http://www.w3.org/2006/07/mobileok-ddc)

• W3C Unicorn 1x detected

  Example user agent
  W3C_Unicorn/1.0 (http://validator.w3.org/services)

• W3C Unified Validator 2x detected

  Example user agent
  W3C_Unicorn/1.0 (http://validator.w3.org/services)

• W3C_Validator 2x detected

  Example user agent
  W3C_Validator/1.767

• W3C-checklink 2x detected

  Example user agent
  W3C-checklink/4.0 [4.4] libwww-perl/5.803

• W3C-mobileOK/DDC 1x detected

  Example user agent
  W3C-mobileOK/DDC-1.0 (see http://www.w3.org/2006/07/mobileok-ddc)

• WebbCrawler 3x detected

  Example user agent
  WebbCrawler 1.0 ( http://badcheese.com/crawler.html )

• WebSitePulse 1x detected

  Example user agent
  websitepulse checker/1.1 (compatible; MSIE 5.5; Netscape 4.75; Linux)

• websitepulse checker 1x detected

  Example user agent
  websitepulse checker/1.1 (compatible; MSIE 5.5; Netscape 4.75; Linux)

• WeSEE:Search 3x detected

  Example user agent
  WeSEE:Search/0.1 (Alpha, http://www.wesee.com/en/support/bot/)

• wget 12x detected

  Example user agent
  Wget/1.15 (linux-gnu)

• Windows-RSS-Platform 1x detected

  Example user agent
  Windows-RSS-Platform/2.0 (MSIE 9.0; Windows NT 6.0)

• WordPress 6x detected

  Example user agent
  WordPress/3.2.1; http://www.painlog.jp

• Wotbox 3x detected

  Example user agent
  Wotbox/2.01 (+http://www.wotbox.com/bot/)

• WWW Mechanize 1x detected

  Example user agent
  WWW-Mechanize/1.64

• WWW-Mechanize 1x detected

  Example user agent
  WWW-Mechanize/1.64

• Y!J-AGENT 5x detected

  Example user agent
  Y!J-BRJ/YATS crawler (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)

• YaCy 2x detected

  Example user agent
  yacybot (freeworld/global; amd64 Linux 3.2.0-4-amd64; java 1.7.0_25; Europe/en) http://yacy.net/bot.html

• YaCy Bot 4x detected

  Example user agent
  yacybot (freeworld/global; x86 Windows XP 5.1; java 1.7.0_21; GMT+04:00/ru) http://yacy.net/bot.html

• yacybot 2x detected

  Example user agent
  yacybot (freeworld/global; x86 Windows XP 5.1; java 1.7.0_21; GMT+04:00/ru) http://yacy.net/bot.html

• Yahoo Ad Monitoring 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html)

• Yahoo Gemini 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html)

• Yahoo Pipes 1x detected

  Example user agent
  Yahoo Pipes 2.0

• Yahoo! Ad Monitoring 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html)

• Yahoo! Japan 12x detected

  Example user agent
  Y!J-BRJ/YATS crawler (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)

• Yahoo! Pipes 2x detected

  Example user agent
  Yahoo Pipes 2.0

• Yahoo! Slurp 19x detected

  Example user agent
  Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)

• Yahoo! Slurp China 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)

• Yandex Anti Virus 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexAntivirus/2.0; +http://yandex.com/bots)

• Yandex Blogs 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexBlogs/0.99; robot; B; +http://yandex.com/bots)

• Yandex Bot 12x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)

• Yandex Direct 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexDirect/3.0; +http://yandex.com/bots)

• Yandex Favicons 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexFavicons/1.0; +http://yandex.com/bots)

• Yandex Image Resizer 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexImageResizer/2.0; +http://yandex.com/bots)

• Yandex Images 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)

• Yandex Metrika 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexMetrika/2.0; +http://yandex.com/bots)

• Yandex News 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexNews/3.0; +http://yandex.com/bots)

• Yandex Newslinks 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexNewslinks; +http://yandex.com/bots)

• YandexAntivirus 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexAntivirus/2.0; +http://yandex.com/bots)

• YandexBlogs 2x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexBlogs/0.99; robot; B; +http://yandex.com/bots)

• YandexBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)

• YandexDirect 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexDirect/3.0; +http://yandex.com/bots)

• YandexDirect-Dyatel 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexDirect/3.0; +http://yandex.com/bots)

• YandexFavicons 2x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexFavicons/1.0; +http://yandex.com/bots)

• YandexImageResizer 2x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexImageResizer/2.0; +http://yandex.com/bots)

• YandexImages 2x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)

• YandexMetrika 2x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexMetrika/2.0; +http://yandex.com/bots)

• YandexNews 2x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexNews/3.0; +http://yandex.com/bots)

• YandexNewslinks 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexNewslinks; +http://yandex.com/bots)

• YATS crawler 2x detected

  Example user agent
  Y!J-BRJ/YATS crawler (http://listing.yahoo.co.jp/support/faq/int/other/other_001.html)

• Yeti 2x detected

  Example user agent
  Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)

• Yeti/Naverbot 2x detected

  Example user agent
  Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)

• YFSBJ crawler 1x detected

  Example user agent
  Y!J-BRP/YFSBJ crawler (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html; YahooFeedSeekerBetaJp/2.0; users 0; views 80)

• YFSJ crawler 1x detected

  Example user agent
  Y!J-BRO/YFSJ crawler (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html; YahooFeedSeekerJp/2.0; users 0; views 248)

• Youdao Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )

• YoudaoBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )

• YRSpider 2x detected

  Example user agent
  Mozilla/5.0 (compatible; YRSpider; +http://www.yunyun.com/SiteInfo.php?r=about)

• Yunyun Bot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; YYSpider; +http://www.yunyun.com/spider.html)

• YYSpider 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YYSpider; +http://www.yunyun.com/spider.html)

• Zookabot 3x detected

  Example user agent
  Zookabot/2.5;++http://zookabot.com

• ZumBot 6x detected

  Example user agent
  ZumBot/1.0 (ZUM Search; http://help.zum.com/inquiry)

About this comparison