Detected bot names - BrowscapPhp 6012

• .NET Framework CLR 1x detected

  Example user agent
  MS Web Services Client Protocol 1.0.3705.0

• 007AC9 Crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; 007ac9 Crawler; http://crawler.007ac9.net/)

• 12345 1x detected

  Example user agent
  12345

• 200PleaseBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; 200PleaseBot/1.0; +http://www.200please.com/bot)

• 360Spider 5x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.89 Safari/537.1; 360Spider

• 5Bot 1x detected

  Example user agent
  Mozilla/5.1 (compatible; +5Bot/1.0; +http://plus5files.net)

• 80Legs 4x detected

  Example user agent
  Mozilla/5.0 (compatible; 008/0.85; http://www.80legs.com/webcrawler.html) Gecko/2008032620

• A6-Indexer 2x detected

  Example user agent
  A6-Indexer

• Abonti WebSearch 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Abonti/0.92 - http://www.abonti.com)

• Aboundexbot 2x detected

  Example user agent
  Aboundex/0.3 (http://www.aboundex.com/crawler/)

• AboutUs Bot 1x detected

  Example user agent
  AboutUsBot/Harpy (Website Analysis; http://www.aboutus.org/Aboutus:Bot; help@aboutus.org)

• AboutUs Bot Johnny5 1x detected

  Example user agent
  Mozilla/5.0 (compatible; AboutUsBot Johnny5/2.0; +http://www.AboutUs.org/)

• acapbot 1x detected

  Example user agent
  Mozilla/5.0 (compatible;acapbot/0.1.;treat like Googlebot)

• Accoona Bot 2x detected

  Example user agent
  Accoona-Biz-Agent/1.1.1 crawler@accoona.com

• AccServer 1x detected

  Example user agent
  AccServer[HOGANMIDSCHOOL]/5.0.2.20(24517) 64-bit HTTP-Agent

• AcoonBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; AcoonBot/4.11.1; +http://www.acoon.de/robot.asp)

• ActiveWorlds Bot 1x detected

  Example user agent
  agent6/Nutch-1.1

• Ad Muncher 1x detected

  Example user agent
  Ad Muncher v4.93.33707/4957

• Adaxas Spider 1x detected

  Example user agent
  Adaxas Spider (http://www.adaxas.net/)

• Adbeat Bot 4x detected

  Example user agent
  Mozilla/5.0 (X11; Linux x86_64) adbeat.com/policy AppleWebKit/537.21 (KHTML, like Gecko) Firefox/34.0 Safari/537.21

• Add Catalog 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Add Catalog/2.1;)

• AddThis.com robot 1x detected

  Example user agent
  AddThis.com robot tech.support@clearspring.com

• adidxbot 1x detected

  Example user agent
  adidxbot/2.0 (+http://search.msn.com/msnbot.htm)

• ADmantX Platform Semantic Analyzer 2x detected

  Example user agent
  ADmantX Platform Semantic Analyzer - ADmantX Inc. - www.admantx.com - support@admantx.com

• AdsBot Google 3x detected

  Example user agent
  AdsBot-Google

• AdsBot Google-Mobile 2x detected

  Example user agent
  AdsBot-Google-Mobile (+http://www.google.com/mobile/adsbot.html) Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36

• AdSense Bot 2x detected

  Example user agent
  Mediapartners-Google

• AdSense Snapshot Bot 1x detected

  Example user agent
  Adsense-Snapshot-Google

• AdvBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; AdvBot/2.0; +http://advbot.net/bot.html)

• AhrefsBot 4x detected

  Example user agent
  Mozilla/5.0 (compatible; AhrefsBot/4.0; +http://ahrefs.com/robot/)

• AISearchBot 1x detected

  Example user agent
  AISearchBot (Email: aisearchbot@gmail.com; If your web site doesn't want to be crawled, please send us a email.)

• AjaxSnapBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; AjaxSnapBot; +http://ajaxsnapshots.com/bot.html)

• akregator 3x detected

  Example user agent
  Akregator/1.2.9; librss/remnants

• Alexabot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Alexabot/1.0; +http://www.alexa.com/help/certifyscan; certifyscan@alexa.com)

• Amazon CloudFront 1x detected

  Example user agent
  Amazon CloudFront

• Amfibi 1x detected

  Example user agent
  Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com)

• Amiga 12x detected

  Example user agent
  AmigaVoyager/3.2 (AmigaOS/MC680x0)

• Android Download Manager 5x detected

  Example user agent
  AndroidDownloadManager/4.1.1 (Linux; U; Android 4.1.1; MB886 Build/9.8.0Q-97_MB886_FFW-20)

• Anonymizied 1x detected

  Example user agent
  Mozilla/5.0 (Randomized by FreeSafeIP.com/upgrade-to-remove; compatible; MSIE 9.0; Windows NT 5.0WOW64) Chrome/18.0.1229.79

• Another Web Mining Tool 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Another Web Mining Tool 1.0; +none; awmt)

• AntBot 1x detected

  Example user agent
  AntBot/1.0 (http://www.ant.com)

• AOLbot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; AOLbot/4.0; +http://www.aol-soft.com/)

• Apache Synapse 1x detected

  Example user agent
  Mozilla/4.0 (compatible; Synapse)

• Apercite 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Apercite; +http://www.apercite.fr/robot/index.html)

• Apple-PubSub 1x detected

  Example user agent
  Apple-PubSub/65.28

• Applebot 3x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1; +http://www.apple.com/go/applebot)

• Apt HTTP Transport 2x detected

  Example user agent
  Debian APT-HTTP/1.3 (1.0.1ubuntu2)

• Arachnida Web Crawler 1x detected

  Example user agent
  Arachnida Web Crawler

• ArchitextSpider 1x detected

  Example user agent
  ArchitextSpider

• ArchiveBot 2x detected

  Example user agent
  ArchiveTeam ArchiveBot/20140807.01 (wpull 0.37a1) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.125 Safari/537.36

• AskPeterBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; AskPeterBot; +http://www.askpeter.de/bot.html)

• ayna-crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; ayna-crawler http://www.ayna.com)

• BabalooSpider 2x detected

  Example user agent
  BabalooSpider/1.2 (BabalooSpider; http://www.babaloo.si; spider@babaloo.si)

• BacklinkCrawler 1x detected

  Example user agent
  BacklinkCrawler (http://www.backlinktest.com/crawler.html)

• BaiDu 11x detected

  Example user agent
  Baiduspider+(+http://www.baidu.jp/spider/)

• Baidu Image Search 2x detected

  Example user agent
  Baiduspider-image ( http://www.baidu.com/search/spider.htm)

• Baidu Mobile Search 3x detected

  Example user agent
  Mozilla/5.0 (Linux;u;Android 2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; +http://www.baidu.com/search/spi_der.html)

• Baidu Union 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Baiduspider-cpro; +http://www.baidu.com/search/spider.html)

• BaiduImageSpider 1x detected

  Example user agent
  BaiduImagespider ( http://help.baidu.jp/system/05.html)

• Baiduspider 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

• bandscraper 1x detected

  Example user agent
  bandscraper

• Begun Advertising Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; BegunAdvertising/3.0; +http://begun.ru/begun/technology/indexer/)

• BigBozz - Financial Search 1x detected

  Example user agent
  BigBozz/BigBozz-2.2.1

• BingBot 8x detected

  Example user agent
  Mozilla/5.0 (compatible; bingbot/2.0 +http://www.bing.com/bingbot.htm)

• BingPreview 7x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/538.14 (KHTML, like Gecko) BingPreview/1.0b

• BitlyBot 1x detected

  Example user agent
  bitlybot

• bl.uk_lddc_bot 2x detected

  Example user agent
  Mozilla/5.0 (bl.uk_lddc_bot; Linux x86_64) PhantomJS/1.9.7 (+http://www.bl.uk/aboutus/legaldeposit/websites/websites/faqswebmaster/index.html)

• Blekkobot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Blekkobot; ScoutJet; +http://blekko.com/about/blekkobot)

• BLEXBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)

• Blog Search 1x detected

  Example user agent
  Mozilla/4.0 (compatible; Blog Search;)

• Bloglovin Bot 2x detected

  Example user agent
  Bloglovin/1.0 (http://www.bloglovin.com; 1 subscribers)

• BlogPulse 1x detected

  Example user agent
  BlogPulse (ISSpider-3.0)

• Blogshares Spiders 1x detected

  Example user agent
  Blogshares Spiders (Renewed V1.65)

• bnf.fr_bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; bnf.fr_bot; +http://www.bnf.fr/fr/outils/a.dl_web_capture_robot.html)

• BoardReader Favicon Fetcher 1x detected

  Example user agent
  BoardReader Favicon Fetcher /1.0 info@boardreader.com

• Boitho 2x detected

  Example user agent
  boitho.com-dc/0.86 ( http://www.boitho.com/dcbot.html )

• bot 2x detected

  Example user agent
  bot

• BOT for JCE 1x detected

  Example user agent
  BOT/0.1 (BOT for JCE)

• Bot Revolt 1x detected

  Example user agent
  revolt

• Bot.AraTurka.com 1x detected

  Example user agent
  Bot.AraTurka.com/0.0.1

• BOTW Spider 1x detected

  Example user agent
  Mozilla/4.0 (compatible; BOTW Spider; http://botw.org)

• Browsershots 1x detected

  Example user agent
  Browsershots

• BrowseX 1x detected

  Example user agent
  Mozilla/4.61 [en] (X11; U; ) - BrowseX (2.0.0 Windows)

• BUbiNG Bot 1x detected

  Example user agent
  BUbiNG (+http://law.di.unimi.it/BUbiNG.html)

• BuiBui-Bot 1x detected

  Example user agent
  BuiBui-Bot/1.0 (email: buibui[at]dadapro[dot]com)

• BuSecurityProject 1x detected

  Example user agent
  Mozilla,BuSecurityProject

• Butterfly 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Butterfly/1.0; +http://labs.topsy.com/butterfly/) Gecko/2009032608 Firefox/3.0.8

• Butterfly Robot 1x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Butterfly/1.0; +http://labs.topsy.com/butterfly/) Gecko/2009032608 Firefox/3.0.8

• ca-crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; ca-crawler/1.0)

• CareerBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; CareerBot/1.1; +http://www.career-x.de/bot.html)

• cars-app-browser 1x detected

  Example user agent
  cars-app-browser

• CazoodleBot 2x detected

  Example user agent
  CazoodleBot/0.1 (CazoodleBot Crawler; http://www.cazoodle.com; mqbot@cazoodle.com)

• CC Metadata Scaper 1x detected

  Example user agent
  CC Metadata Scaper http://wiki.creativecommons.org/Metadata_Scraper

• CCBot 2x detected

  Example user agent
  CCBot/2.0 (http://commoncrawl.org/faq/)

• Charlotte 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Charlotte/1.0b; charlotte@beta.spider.com)

• CheckLinks 1x detected

  Example user agent
  Checklinks/1.3 (pywikipedia robot; http://toolserver.org/~dispenser/view/Checklinks)

• CheckSite Verification Agent 1x detected

  Example user agent
  CheckSite Verification Agent (+http://www.checksite.us)

• chlooe Bot 1x detected

  Example user agent
  bot-pge.chlooe.com/1.0.0 (+http://www.chlooe.com/)

• city-map screenshot service 1x detected

  Example user agent
  city-map screenshot service

• Cliqzbot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Cliqzbot/0.1 +http://cliqz.com/company/cliqzbot)

• CloudFlare AlwaysOnline 1x detected

  Example user agent
  Mozilla/5.0 (compatible; CloudFlare-AlwaysOnline/1.0; +http://www.cloudflare.com/always-online) AppleWebKit/534.34

• CMS Crawler 1x detected

  Example user agent
  Mozilla/4.0 (CMS Crawler: http://www.cmscrawler.com)

• Coccoc bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; coccoc/1.0; +http://help.coccoc.com/)

• Comodo Spider 2x detected

  Example user agent
  Comodo Spider 1.2

• ContextAd Bot 1x detected

  Example user agent
  ContextAd Bot 1.0

• Convera 1x detected

  Example user agent
  ConveraCrawler/0.9c ( http://www.authoritativeweb.com/crawl)

• ConveraMultiMediaCrawler 1x detected

  Example user agent
  ConveraMultiMediaCrawler/0.1 ( http://www.authoritativeweb.com/crawl)

• Cookie Reports Bot 1x detected

  Example user agent
  CookieReports.com/0.1

• Crawlboy 10x detected

  Example user agent
  CrawlFire - you can disable this Robot: http://pastebin.de/25277

• CrawlConvera 1x detected

  Example user agent
  CrawlConvera0.1 (CrawlConvera@yahoo.com)

• Crawler 2x detected

  Example user agent
  Mozilla/5.0 (compatible; crawler/3.0.0 +http://www.notconfigured.com/)

• crawler4j 1x detected

  Example user agent
  crawler4j (http://code.google.com/p/crawler4j/)

• CrawlRobot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; CrawlRobot; +http://localhost/bot.php)

• Crazywebcrawler 1x detected

  Example user agent
  CRAZYWEBCRAWLER 0.9.0, http://www.crazywebcrawler.com

• cURL 5x detected

  Example user agent
  curl/7.16.0 (i386-unknown-openbsd4.1) libcurl/7.16.0 OpenSSL/0.9.7j zlib/1.2.3

• Cyberduck 1x detected

  Example user agent
  Cyberduck/4.6.4 (16610) (Windows XP/5.1) (x86)

• CyberPatrol 1x detected

  Example user agent
  CyberPatrol SiteCat Webbot (http://www.cyberpatrol.com/cyberpatrolcrawler.asp)

• Cydral Web Image Search 1x detected

  Example user agent
  CydralSpider/3.2 (Cydral Image Search; http://www.cydral.com)

• Daumoa 4x detected

  Example user agent
  Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server;) Daumoa 4.0

• DAWINCI ANTIPLAG SPIDER 1x detected

  Example user agent
  Mozilla/4.0 (compatible; DAWINCI ANTIPLAG SPIDER)

• DBot 2x detected

  Example user agent
  Mozilla/5.1 (compatible; DBot/7.0; +http://getdownload.ws)

• Diffbot 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.15 (KHTML, like Gecko; +http://www.diffbot.com) Chrome/24.0.1295.0 Safari/537.15

• Digg Bot 1x detected

  Example user agent
  Mozilla/5.0 (Digg/1.0; support@digg.com)

• Digincore Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Digincore bot; https://www.digincore.com/crawler.html for rules and instructions.

• DiscoverEd 1x detected

  Example user agent
  DiscoverEd/Nutch-1.7 (OER search crawler; http://wiki.creativecommons.org/DiscoverEd; webmaster@creativecommons.org)

• discoverybot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; discoverybot/2.0; +http://discoveryengine.com/discoverybot.html)

• DNS Group Crawler 1x detected

  Example user agent
  DNSGroup/0.1 (DNS Group Crawler; http://www.dnsgroup.com/; crawler@dnsgroup.com)

• DocWeb Link Crawler 1x detected

  Example user agent
  DocWeb Link Crawler (http://doc.php.net)

• Dolphin smalltalk http client 1x detected

  Example user agent
  Dolphin http client/10.3.0(280) (Android)

• DomainAppender Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; DomainAppender /1.0; +http://www.profound.net/domainappender)

• DomainCrawler 1x detected

  Example user agent
  DomainCrawler/2.0 (info@domaincrawler.com; http://www.domaincrawler.com/bot

• DomainsBot 1x detected

  Example user agent
  domainsbot (+http://www.domainsbot.com)

• DomainScan Server Monitoring 2x detected

  Example user agent
  Mozilla/5.0 (compatible; DomainSCAN/2.0; +http://domainscan.info/robot/)

• DomainsDB 1x detected

  Example user agent
  DomainsDB.net MetaCrawler v.0.9.7b (http://domainsdb.net/)

• DomainSigmaCrawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; DomainSigmaCrawler/0.1; +http://domainsigma.com/robot)

• Domnutch Bot 1x detected

  Example user agent
  Domnutch-Bot/Nutch-1.0 (Domnutch; http://www.Nutch.de/)

• DotBot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org)

• Download Accelerator 1x detected

  Example user agent
  masscan/1.0 (https://github.com/robertdavidgraham/masscan)

• DuckDuck Favicons Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com)

• DueDil Crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; electricmonk/3.2.0 +https://www.duedil.com/our-crawler/)

• EasouSpider 1x detected

  Example user agent
  Mozilla/5.0 (compatible; EasouSpider; +http://www.easou.com/search/spider.html)

• ECCP 1x detected

  Example user agent
  ECCP/1.0 (search@eniro.com)

• Elmer 1x detected

  Example user agent
  Elmer, the Thinglink ImageBot (http://www.thinglink.com/help/ThinglinkImageBot)

• Embedly 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Embedly/0.2; snap; +http://support.embed.ly/)

• Entireweb 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Speedy Spider; http://www.entireweb.com/about/search_tech/speedy_spider/)

• Envolk 3x detected

  Example user agent
  envolk/1.7 ( http://www.envolk.com/envolkspider.html)

• Esribot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Esribot/1.0; http://www.esrihu.hu/)

• Europe Internet Portal 1x detected

  Example user agent
  EuripBot/0.5 (+http://www.eurip.com) PreCheck

• EventMachine HttpClient 1x detected

  Example user agent
  EventMachine HttpClient

• Evernote Clip Resolver 1x detected

  Example user agent
  Evernote Clip Resolver

• EveryoneSocialBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; EveryoneSocialBot/1.0; support@everyonesocial.com http://everyonesocial.com/)

• Exabot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)

• ExactSeek Crawler 1x detected

  Example user agent
  ExactSeek Crawler/0.1

• Exalead 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails)

• Experibot 1x detected

  Example user agent
  Experibot_v1 (https://dl.dropboxusercontent.com/u/8024465/site/Info.html)

• eZ Publish Link Validator 1x detected

  Example user agent
  eZ Publish Link Validator

• Ezooms 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)

• Facebook 1x detected

  Example user agent
  facebookplatform/1.0 (+http://developers.facebook.com)

• FacebookExternalHit 3x detected

  Example user agent
  facebookexternalhit/1.1

• Facebookscraper 1x detected

  Example user agent
  facebookscraper/1.0( http://www.facebook.com/sharescraper_help.php)

• Facebot 1x detected

  Example user agent
  Facebot/1.0

• Fake Android 3x detected

  Example user agent
  Mozilla/5.0 (Linux; U; Android 2.2; fr-fr; Desire_A8181 Build/FRF91) App3leWebKit/53.1 (KHTML, like Gecko) Version/4.0 Mobile Safari/533.1

• Fake Browser 155x detected

  Example user agent
  Mozilla 5.0 (Linux; U; Android 2.3.5; zh-cn; LNV-Lenovo A790e Build GINGERBREAD) UC AppleWebKit 534.31 (KHTML, like Gecko) Mobile Safari 534.31

• Fake Chrome 13x detected

  Example user agent
  24.0.1284.0.0 (Windows NT 6.1) AppleWebKit/534.7 (KHTML, like Gecko) Chrome/24.0.1284.0.3.742.2 Safari/534.0

• Fake Firefox 8x detected

  Example user agent
  Mozilla/5.0 (Windows NT 7.0; WOW64; rv:40.0) Gecko/20100101 Firefox/40.0

• Fake IE 32x detected

  Example user agent
  Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 7.1; Trident/5.0)

• Fake Safari 21x detected

  Example user agent
  Mozilla/5.0 (Linux; U; Android 2.2.2; en-gb; DesireA8181 Build/FRG83G) AppleWebKit/533.1 (KHTML like Gecko) Version/4.0 Mobile Safari/533.1

• FAST Enterprise Crawler 3x detected

  Example user agent
  RB2B-bot v0.1 (Using Fast Enterprise Crawler 6 search@reedbusiness.com)

• FAST MetaWeb Crawler 1x detected

  Example user agent
  FAST MetaWeb Crawler (helpdesk at fastsearch dot com)

• FAST PartnerSite 1x detected

  Example user agent
  Fast PartnerSite Crawler

• FAST-WebCrawler 3x detected

  Example user agent
  FAST-WebCrawler/2.2.11 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)

• fastbot crawler 1x detected

  Example user agent
  fastbot crawler beta 4.0 (+http://www.fastbot.de)

• FeedBlitz 2x detected

  Example user agent
  FeedBlitz/1.0 (1 subscribers)

• FeedBurner 1x detected

  Example user agent
  FeedBurner/1.0 (http://www.FeedBurner.com)

• FeedDemon 2x detected

  Example user agent
  FeedDemon/4.5 (http://www.feeddemon.com/; Microsoft Windows XP)

• Feeddler RSS Reader 1x detected

  Example user agent
  FeeddlerRSS 2.4 (iPad; iPhone OS 7.1; en_GB)

• FeedFetcher 1x detected

  Example user agent
  livedoor FeedFetcher/0.01 (http://reader.livedoor.com/; 999 subscribers)

• Feedfetcher-Google 5x detected

  Example user agent
  FeedFetcher-Google; ( http://www.google.com/feedfetcher.html)

• feedly App 1x detected

  Example user agent
  FeedlyApp/1.0 (http://www.feedly.com)

• feedly Feed Fetcher 1x detected

  Example user agent
  Feedly/1.0 (+http://www.feedly.com/fetcher.html; like FeedFetcher-Google)

• FHScan Core 1x detected

  Example user agent
  Mozilla/5.0 (FHScan Core 1.1)

• Finderlein Research Crawler 1x detected

  Example user agent
  Finderlein Research Crawler 1.0

• FindLinks 1x detected

  Example user agent
  findlinks/2.6 ( http://wortschatz.uni-leipzig.de/findlinks/)

• Flatland 1x detected

  Example user agent
  flatlandbot/allspark (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot; jason@flatlandindustries.com)

• FlipboardProxy 1x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:28.0) Gecko/20100101 Firefox/28.0 (FlipboardProxy/1.1; +http://flipboard.com/browserproxy)

• focuseekbot 1x detected

  Example user agent
  Mozilla/4.0 (compatible; focuseekbot)

• Forum Poster 1x detected

  Example user agent
  Forum Poster V3

• fr-crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; fr-crawler/1.1)

• FreeWebMonitoring SiteChecker 1x detected

  Example user agent
  FreeWebMonitoring SiteChecker/0.1 (+http://www.freewebmonitoring.com)

• FyberSpider 1x detected

  Example user agent
  FyberSpider/1.3 (http://www.fybersearch.com/fyberspider.php)

• GarlikCrawler 2x detected

  Example user agent
  GarlikCrawler/1.2 (http://garlik.com/

• Genderanalyzer 1x detected

  Example user agent
  Genderanalyzer/1.0

• General Crawlers 202x detected

  Example user agent
  Mozilla/5.0 (Java; U; Pt-br; samsung-sgh-u800) UCBrowser8.4.0.159/69/352/UCWEB Mobile UNTRUSTED/1.0

• Generic Crawler 4x detected

  Example user agent
  User-Agent: igmHttp/0.1.501 (Android OS; HTCDesireHDA9191 ; 2.3.5; de_DE; 800x480) gzip

• Generic Research Crawler 5x detected

  Example user agent
  LinkStar Research Crawler (http://linkstar.com/),gzip(gfe),gzip(gfe)

• Generic Ruby Crawler 1x detected

  Example user agent
  Ruby

• Genieo Web Filter 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Genieo/1.0 http://www.genieo.com/webfilter.html

• GG PeekBot 1x detected

  Example user agent
  GG PeekBot 2.0 ( http://gg.pl/ http://info.gadu-gadu.pl/praca )

• GIDBot 1x detected

  Example user agent
  GIDBot/2.0 (+http://www.gidnetwork.com/tools/gzip-test.php)

• Gigablast Search Engine 1x detected

  Example user agent
  GigablastOpenSource/1.0

• Gigabot 2x detected

  Example user agent
  Gigabot/2.0/gigablast.com/spider.html

• GLBot 1x detected

  Example user agent
  Mozilla/5.1 (compatible; GLBot/1.0; +http://galaxydownloads.co)

• GO HttpClient 1x detected

  Example user agent
  Go 1.1 package http

• GoGuidesBot 1x detected

  Example user agent
  GoGuidesBot/0.0.1 (GoGuides Indexing Spider; http://www.goguides.org/spider.html)

• Goldfire Server 1x detected

  Example user agent
  Goldfire Server

• Gomez Site Monitor 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; WOW64; rv:13.0; GomezAgent 3.0) Gecko/20100101 Firefox/13.0.1

• gooblog 1x detected

  Example user agent
  gooblog/2.0 (http://help.goo.ne.jp/contact/)

• Google 1x detected

  Example user agent
  Mozilla/5.0 (en-us) AppleWebKit/525.13 (KHTML, like Gecko; Google Web Preview) Version/3.1 Safari/525.13

• Google Adwords DisplayAds WebRender 1x detected

  Example user agent
  Mozilla/5.0 (en-us) AppleWebKit/537.36(KHTML, like Gecko; Google-Adwords-DisplayAds-WebRender;) Chrome/27.0.1453Safari/537.36

• Google App Engine 3x detected

  Example user agent
  AppEngine-Google

• Google Bot 33x detected

  Example user agent
  Googlebot/2.1 (http://www.googlebot.com/bot.html)

• Google Bot Mobile 6x detected

  Example user agent
  Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

• Google Feedfetcher 1x detected

  Example user agent
  Mozilla/5.0 (compatible) Feedfetcher-Google;(+http://www.google.com/feedfetcher.html)

• Google HTTP Client Library for Java 2x detected

  Example user agent
  Google-HTTP-Java-Client/1.17.0-rc (gzip)

• Google Image Proxy 3x detected

  Example user agent
  Mozilla/5.0 (Windows NT 5.1; rv:11.0) Gecko Firefox/11.0 (via ggpht.com GoogleImageProxy)

• Google Keyword Suggestion 1x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux x86_64; en-US) AppleWebKit/534.16 (KHTML, like Gecko, Google Keyword Suggestion) Chrome/10.0.648.127 Safari/534.16

• Google PageSpeed Insights 4x detected

  Example user agent
  Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; Google Page Speed Insights) Chrome/27.0.1453 Safari/537.36

• Google Search Appliance 1x detected

  Example user agent
  gsa-crawler

• Google Structured-Data TestingTool 1x detected

  Example user agent
  Mozilla/5.0 (compatible; X11; Linux x86_64; Google-StructuredDataTestingTool; +http://www.google.com/webmasters/tools/richsnippets)

• Google Toolbar 1x detected

  Example user agent
  Mozilla/4.0 (compatible; GoogleToolbar 7.5.5111.1712; Windows XP 5.1; MSIE 8.0.6001.18702)

• Google Web Preview 3x detected

  Example user agent
  Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; Google Web Preview) Chrome/27.0.1453 Safari/537.36

• Google Web Snippet 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; rv:6.0) Gecko/20110814 Firefox/6.0 Google (+https://developers.google.com/+/web/snippet/)

• Google Wireless Transcoder 1x detected

  Example user agent
  Mozilla/5.0 (en-us) AppleWebKit/534.14 (KHTML, like Gecko; Google Wireless Transcoder) Chrome/9.0.597 Safari/534.14

• Google-Site-Verification 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Google-Site-Verification/1.0)

• Google-Sitemaps 1x detected

  Example user agent
  Google-Sitemaps/1.0

• Googlebot-Image 1x detected

  Example user agent
  Googlebot-Image/1.0

• Googlebot-News 2x detected

  Example user agent
  Googlebot-News (2.3.3, ruby 1.9.3 (2013-11-22))

• Googlebot-Video 1x detected

  Example user agent
  Googlebot-Video/1.0

• gosquared-thumbnailer 1x detected

  Example user agent
  gosquared-thumbnailer/1.0

• grapeFX 1x detected

  Example user agent
  Mozilla/5.0 (compatible; grapeFX/0.9; crawler@grapeshot.co.uk

• GrapeshotCrawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; +http://www.grapeshot.co.uk/crawler.php)

• GroupHigh Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; GroupHigh/1.0; +http://www.grouphigh.com/bot.html)

• grub 2x detected

  Example user agent
  Grub/2.0 (Grub.org crawler; http://www.grub.org/; bot@grub.org)

• gvfs 1x detected

  Example user agent
  gvfs/1.24.1

• Hatena Antenna 1x detected

  Example user agent
  Hatena Antenna/0.5 (http://a.hatena.ne.jp/help)

• Hatena Crawler 1x detected

  Example user agent
  Hatena::Crawler/0.01

• Heritrix 13x detected

  Example user agent
  Mozilla/5.0 (compatible; heritrix/1.14.4 +http://netarkivet.dk/webcrawler/)

• HggH Screenshot System with PhantomJS 1x detected

  Example user agent
  HggH PhantomJS Screenshoter

• HiddenMarket 1x detected

  Example user agent
  HiddenMarket-1.0-beta (www.hiddenmarket.net/crawler.php)

• hitcrawler 1x detected

  Example user agent
  hitcrawler_0.1 (ringken@gmail.com)

• hivaBot 2x detected

  Example user agent
  hivaBot(http://gorgor.ir and info@gorgor.ir)/hivaBot-0.2

• Holmes 2x detected

  Example user agent
  holmes/3.12.4 (http://morfeo.centrum.cz/bot)

• HooWWWer 1x detected

  Example user agent
  HooWWWer/2.1.0 ( http://cosco.hiit.fi/search/hoowwwer/ | mailto:crawler-infohiit.fi)

• HRCrawler 1x detected

  Example user agent
  HRCrawler/2.0 (XF86; MacOS x86_64) AppleWebKit/537.31 (KHTML, like Gecko)

• ht://Dig 1x detected

  Example user agent
  htdig/3.1.6 (romieu@bastide-medical.fr)

• http_requester 1x detected

  Example user agent
  http_requester/0.1

• httpclient 1x detected

  Example user agent
  HTTPClient/1.0 (2.4.0, ruby 1.9.3 (2013-06-27))

• HTTrack 1x detected

  Example user agent
  Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)

• HuaweiSymantecSpider 1x detected

  Example user agent
  HuaweiSymantecSpider/1.0 DSE-support@huaweisymantec.com (compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR ; http://www.huaweisymantec.com/cn/IRL/spider)

• HubSpot Webcrawler 1x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.116 Safari/537.36 HubSpot Webcrawler

• HyperCrawl 1x detected

  Example user agent
  Mozilla/5.0 (compatible; HyperCrawl/0.2; +http://www.seograph.net/bot.html)

• i1searchbot 1x detected

  Example user agent
  i1searchbot/2.0 (i1search web crawler; http://www.i1search.com; crawler@i1search.com)

• IBM Connections 1x detected

  Example user agent
  IC OpenGraph Crawler 4.5 (proprietary)

• Icarus6j 1x detected

  Example user agent
  Icarus6j - (contact: phil@icarus6.com)

• ICC-Crawler 2x detected

  Example user agent
  ICC-Crawler/2.0 (Mozilla-compatible; ; http://kc.nict.go.jp/project1/crawl.html)

• Ichiro Bot 3x detected

  Example user agent
  ichiro/1.0 (ichiro@nttr.co.jp)

• Ichiro Mobile Bot 3x detected

  Example user agent
  DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo;+http://search.goo.ne.jp/option/use/sub4/sub4-1/)

• IconSurf 1x detected

  Example user agent
  IconSurf/2.0 favicon finder (see http://iconsurf.com/robot.html)

• Iframely Bot 1x detected

  Example user agent
  Iframely/0.7.1 (+http://iframe.ly/;)

• IIS Site Analysis Web Crawler 1x detected

  Example user agent
  iisbot/1.0 (+http://www.iis.net/iisbot.html)

• Ilse 2x detected

  Example user agent
  INGRID/2.0 (http://spsearch.ilse.nl/; Startpagina dochter links spider)

• ImplisenseBot 1x detected

  Example user agent
  ImplisenseBot 1.0

• InAGist URL Resolver 1x detected

  Example user agent
  InAGist URL Resolver (http://inagist.com)

• InfegyAtlas 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Linux; InfegyAtlas/1.0; en-US; collection@infegy.com)

• Integrity 1x detected

  Example user agent
  integrity/4

• Internet Archive 9x detected

  Example user agent
  InternetArchive/0.8-dev (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)

• Internet Archive Special Archiver 3x detected

  Example user agent
  Mozilla/5.0 (compatible; special_archiver/3.2.0 +http://www.loc.gov/webarchiving/notice_to_webmasters.html)

• InternetSeer.com 1x detected

  Example user agent
  InternetSeer.com

• IPv4Scan 1x detected

  Example user agent
  IPv4Scan (+http://ipv4scan.com)

• IRLbot 1x detected

  Example user agent
  IRLbot/1.0 ( http://irl.cs.tamu.edu/crawler)

• isc header collector handlers 1x detected

  Example user agent
  isc header collector handlers@isc.sans.edu

• IstellaBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; IstellaBot/1.18.81 +http://www.tiscali.it/)

• itsscan 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Muenster University of Applied Sciences; +http://fb02itsscan.fh-muenster.de)

• iZSearch Bot 1x detected

  Example user agent
  iZSearch.com

• Jakarta Commons HttpClient 1x detected

  Example user agent
  Jakarta Commons-HttpClient/3.0

• JamesBOT 1x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 - James BOT - WebCrawler http://cognitiveseo.com/bot.html

• Java Standard Library 6x detected

  Example user agent
  Java/1.17

• Jayde Crawler 1x detected

  Example user agent
  Jayde Crawler. http://www.jayde.com

• Jeode 1x detected

  Example user agent
  Jeode/1.x.x

• jig browser web 20x detected

  Example user agent
  Mozilla/4.0 (jig browser web; 1.0.4; 001SC)

• Jigsaw_W3C_CSS_Validator 1x detected

  Example user agent
  Jigsaw/2.3.0 W3C_CSS_Validator_JFouffa/2.0 (See )

• JobBoerse Bot 1x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux Core i7-4980HQ; de; rv:32.0; compatible; Jobboerse.com; http://www.xn--jobbrse-d1a.com) Gecko/20100401 Firefox/24.0

• JobdiggerSpider 1x detected

  Example user agent
  Mozilla/5.0 (compatible; JobdiggerSpider +http://www.jobdigger.nl/spider)

• JobRoboter 1x detected

  Example user agent
  JobRoboter/1.1

• JoobleBot 1x detected

  Example user agent
  JoobleBot (compatible; http://jooble.org/jooble-bot)

• Jupdate 1x detected

  Example user agent
  jupdate

• JUST-CRAWLER 1x detected

  Example user agent
  JUST-CRAWLER( http://www.justsystems.com/jp/tech/crawler/)

• kgbody 1x detected

  Example user agent
  Mozilla/5.0 (compatible; kgbody/2.0; +http://kids.goo.ne.jp/tool/kgbody.php)

• KomodiaBot 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; Win64; x64) KomodiaBot/1.0

• Kraken 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Kraken/0.1; http://linkfluence.net/; bot@linkfluence.net)

• krakenjs 1x detected

  Example user agent
  kraken/0.6.0

• kulturarw3 1x detected

  Example user agent
  Mozilla/5.0 (compatible; kulturarw3 +http://www.kb.se/om/projekt/Svenska-webbsidor---Kulturarw3/)

• Larbin 4x detected

  Example user agent
  binlar_2.6.3 test@mgmt.mic

• lbot 2x detected

  Example user agent
  Mozilla/5.0 (lbot/2.6.4) lbot@mailme.not

• libcurl 1x detected

  Example user agent
  libcurl-agent/1.0

• libwww 9x detected

  Example user agent
  NCSA_Mosaic/2.7b5 (X11;Linux 2.6.7 i686) libwww/2.12 modified

• Liferea 3x detected

  Example user agent
  Liferea/1.10.6 (Linux; en_US.UTF8; http://liferea.sf.net/) AppleWebKit (KHTML, like Gecko)

• Lightspeed Systems Crawler 1x detected

  Example user agent
  Mozilla/4.0 (compatible; MSIE 7.0;Windows NT 5.1;.NET CLR 1.1.4322;.NET CLR 2.0.50727;.NET CLR 3.0.04506.30) Lightspeedsystems

• Lightspeed Systems RocketCrawler 1x detected

  Example user agent
  LSSRocketCrawler/1.0 LightspeedSystems

• Linkdex Bot 3x detected

  Example user agent
  Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML, like Gecko) Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; linkdexbot-mobile/2.1; +http://www.linkdex.com/about/bots/)

• LinkedInBot 3x detected

  Example user agent
  LinkedInBot/1.0 (compatible; Mozilla/5.0; Jakarta Commons-HttpClient/3.1 http://www.linkedin.com)

• LinkpadBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; LinkpadBot/1.06; +http://www.linkpad.ru)

• Links4US-Crawler 1x detected

  Example user agent
  Links4US-Crawler, ( http://links4us.com/)

• LinksCrawler 1x detected

  Example user agent
  LinksCrawler 0.1beta

• LinkStats Bot 1x detected

  Example user agent
  LinkStats Bot

• Lipperhey SEO Service 3x detected

  Example user agent
  Mozilla/5.0 (compatible; Lipperhey Spider; http://www.lipperhey.com/)

• Livelap Crawler 1x detected

  Example user agent
  LivelapBot/0.2 (http://site.livelap.com/crawler)

• LoadTimeBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; LoadTimeBot/0.9; +http://www.loadtime.net/bot.html)

• Locubot 1x detected

  Example user agent
  Locubot (compatible; Googlebot; msnbot)

• LOOQ 1x detected

  Example user agent
  LOOQ/0.1 alfa (LOOQ Crawler for european sites; http://looq.eu; root (at) looq dot eu)

• ltx71 Bot 1x detected

  Example user agent
  ltx71 - (http://ltx71.com/)

• Lucidworks Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; LucidWorks/; +; crawler at example dot com)

• lwp 3x detected

  Example user agent
  LWP::Simple/5.800

• Lycos 1x detected

  Example user agent
  Lycos_Spider_(modspider)

• m65bot 1x detected

  Example user agent
  DoCoMo/2.0 P904i( m65bot/0.1; c; http://m65.jp/bot.html )

• magpie-crawler 2x detected

  Example user agent
  magpie-crawler/1.1 (U; Linux amd64; en-GB; +http://www.brandwatch.net)

• MagpieRSS 2x detected

  Example user agent
  MagpieRSS/0.61 (+http://magpierss.sf.net)

• Mail.Ru 4x detected

  Example user agent
  Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots; +http://go.mail.ru/help/robots)

• MailChimp.com 1x detected

  Example user agent
  MailChimp.com

• MarketwireBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; MSIE 9.0; Windows NT; MarketwireBot +http://www.marketwire.com)

• masidani_bot 1x detected

  Example user agent
  masidani_bot_v0.3 (info@masidani.com)

• mbot 1x detected

  Example user agent
  mbot v.1.16

• meanpathbot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; meanpathbot/1.0; +http://www.meanpath.com/meanpathbot.html)

• MegaIndex Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +https://www.megaindex.ru/?tab=linkAnalyze)

• memoryBot 4x detected

  Example user agent
  Mozilla/5.0 (compatible; memorybot/1.20.71 +http://archivethe.net/en/index.php/about/internet_memory1 on behalf of DNB)

• MerchantCentricBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; MerchantCentricBot/1.0)

• MetaGeneratorCrawler 2x detected

  Example user agent
  MetaGeneratorCrawler/1.3.4 (www.metagenerator.info)

• metager2-verification-bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; metager2-verification-bot; +http://metager2.de/technology.php)

• MetaHeadersBot 1x detected

  Example user agent
  MetaHeadersBot (+http://www.metaheaders.com/bot.html)

• MetaInspector 1x detected

  Example user agent
  MetaInspector/3.0.0 (+https://github.com/jaimeiniesta/metainspector)

• MetaJobBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; MetaJobBot; http://www.metajob.at/crawler)

• MetaURI Bot 1x detected

  Example user agent
  MetaURI API/2.0 +metauri.com

• Microsoft Bing Mobile SocialStreams Bot 1x detected

  Example user agent
  Microsoft Bing Mobile SocialStreams Bot

• Microsoft CryptoAPI 2x detected

  Example user agent
  Microsoft-CryptoAPI/6.1

• Microsoft-WebDAV 1x detected

  Example user agent
  DavClnt

• Mignify Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; imrbot/1.10.8 +http://www.mignify.com)

• MixBot 1x detected

  Example user agent
  MixBot (+http://t.co/GSRLLKex24)

• MixrankBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; MixrankBot; crawler@mixrank.com)

• MJ12bot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; MJ12bot/v1.4.3; http://www.majestic12.co.uk/bot.php?+)

• Mnogosearch 1x detected

  Example user agent
  MnoGoSearch/3.3.15

• MojeekBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; MojeekBot/0.6; http://www.mojeek.com/bot.html)

• MonkeyCrawl 1x detected

  Example user agent
  MonkeyCrawl/0.05 (MonkeyCrawl; http://www.monkeymethods.org; )

• MonoBot 1x detected

  Example user agent
  Mozilla/5.1 (compatible; MonoBot/1.0; +http://mono.name)

• Moozilla 1x detected

  Example user agent
  Moozilla

• Moreover 1x detected

  Example user agent
  Mozilla/5.0 Moreover/5.1 (+http://www.moreover.com; webmaster@moreover.com)

• MOSBookmarks Link Checker 1x detected

  Example user agent
  Mozilla/5.0 (compatible; MOSBookmarks/v2.6-Plus; Link Checker)

• Mozdex 1x detected

  Example user agent
  mozDex/0.05-dev (mozDex; http://www.mozdex.com/bot.html; spider@mozdex.com)

• Mozilla Crawler 1x detected

  Example user agent
  Mozilla crawl/5.0 (compatible; fairshare.cc +http://fairshare.cc)

• MQbot 1x detected

  Example user agent
  MQbot http://metaquerier.cs.uiuc.edu/crawler

• MS OPD 1x detected

  Example user agent
  Microsoft Office Protocol Discovery

• MSN 3x detected

  Example user agent
  msnbot/2.0 (+http://search.msn.com/msnbot.htm)

• msnbot 6x detected

  Example user agent
  msnbot/1.1 ( http://search.msn.com/msnbot.htm)

• msnbot-media 5x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) MsnBot-Media /1.0b

• msnbot-NewsBlogs 1x detected

  Example user agent
  msnbot-NewsBlogs/2.0b (+http://search.msn.com/msnbot.htm)

• MSR-ISRCCrawler 1x detected

  Example user agent
  MSR-ISRCCrawler

• MSRBOT 1x detected

  Example user agent
  MSRBOT (http://research.microsoft.com/research/sv/msrbot)

• n4p_bot 1x detected

  Example user agent
  n4p_bot (crawler@n4p.com)

• Nagios 2x detected

  Example user agent
  check_http/v2.0 (nagios-plugins 2.0)

• NameProtect 1x detected

  Example user agent
  abot/0.1 (abot; http://www.abot.com; abot@abot.com)

• NaverBot 11x detected

  Example user agent
  Mozilla/5.0 (compatible; Yeti/1.1; +http://help.naver.com/robots/)

• nbot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; nbot/2.0)

• NerdyBot 1x detected

  Example user agent
  NerdyBot

• Netchart Adv Crawler 1x detected

  Example user agent
  Netchart Adv Crawler 1.0

• Netcraft Webserver Survey 1x detected

  Example user agent
  Mozilla/4.0 (compatible; Netcraft Web Server Survey)

• netEstate NE Crawler 2x detected

  Example user agent
  netEstate NE Crawler (+http://www.sengine.info/)

• NetLyzer FastProbe 1x detected

  Example user agent
  NetLyzer FastProbe

• NetNewsWire 3x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_2) AppleWebKit/537.74.9 (KHTML, like Gecko) Version/6.0 NetNewsWire/4.0.0

• NetSeer Crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; NetSeer crawler/2.0; +http://www.netseer.com/crawler.html; crawler@netseer.com)

• NetSurf 2x detected

  Example user agent
  NetSurf/2.0 (RISC OS; armv5l)

• Nett.io bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Nett.io bot/1.0; +http://nett.io/)

• Netvibes 2x detected

  Example user agent
  Netvibes (http://www.netvibes.com/; 8 subscribers; feedID: 2244192)

• NetzCheckBot 1x detected

  Example user agent
  NetzCheckBot/1.0 (security seal; private-krankenversicherung.de.netzcheck.com; bot@netzcheck.com)

• NewsBlur Favicon Fetcher 4x detected

  Example user agent
  NewsBlur Feed Fetcher - 7 subscribers - http://www.newsblur.com/site/1948420/analytics-piwik (Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_1) AppleWebKit/534.48.3 (KHTML, like Gecko) Version/5.1 Safari/534.48.3)

• NewsGator 2x detected

  Example user agent
  NewsGator/2.0 Bot (http://www.newsgator.com)

• NewsGator FetchLinks 1x detected

  Example user agent
  NewsGator FetchLinks extension/0.2.0 (http://graemef.com)

• NewsGatorOnline 2x detected

  Example user agent
  NewsGatorOnline/2.0 (http://www.newsgator.com; 2 subscribers)

• NikiBot 1x detected

  Example user agent
  niki-bot

• Norbert the Spider 1x detected

  Example user agent
  Norbert the Spider(Burf.com)

• Northern Light Web Search 1x detected

  Example user agent
  Mozilla/5.0 (compatible; NLCrawler/2.0.15; Linux 2.6.3-7; i686; en_US)KHTML/3.4.89 (like Gecko)

• nuSearch 3x detected

  Example user agent
  Nusearch Spider (compatible; MSIE 6.0)

• Nutch 24x detected

  Example user agent
  My Nutch Spider/Nutch-1.6

• ObjectsSearch 1x detected

  Example user agent
  ObjectsSearch/0.2 (ObjectsSearch; http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com)

• oBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; oBot/2.3.1; http://filterdb.iss.net/crawler/)

• OffByOne 1x detected

  Example user agent
  Mozilla/4.7 (compatible; OffByOne; Windows 2000) Webster Pro V3.4

• Omea Reader 1x detected

  Example user agent
  JetBrains Omea Reader 2.2 (http://www.jetbrains.com/omea/reader/)

• Open Vulnerability Assessment System 1x detected

  Example user agent
  Mozilla/4.75 [en] (X11, U; OpenVAS)

• open-webkit-sharp 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) OpenWebKitSharp

• OpenBSD ftp 1x detected

  Example user agent
  OpenBSD ftp

• OpenHoseBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; OpenHoseBot/2.1; +http://www.openhose.org/bot.html)

• OpenWebSpider 3x detected

  Example user agent
  OpenWebSpider/0.6 (http://www.openwebspider.org)

• Optimizer Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Optimizer)

• optivo NetHelper 1x detected

  Example user agent
  optivo(R) NetHelper

• Orangebot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Orangebot/2.0; support.orangebot@orange.com)

• OWASP_SECRET_BROWSER 1x detected

  Example user agent
  OWASP_SECRET_BROWSER/3.0

• Owler Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Owler/0.4; +; )

• PageFreezer 1x detected

  Example user agent
  PageFreezer (pagefreezer crawler; http://pagefreezer.com/pagefreezer-crawler/; info@pagefreezer.com)

• PagePeeker Screenshot Maker 1x detected

  Example user agent
  Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/538.1 (KHTML, like Gecko) domain.com Safari/538.1

• PagesInventory Bot 3x detected

  Example user agent
  PagesInventory (robot +http://www.pagesinventory.com)

• Paper.li Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; PaperLiBot/2.1; http://support.paper.li/entries/20023257-what-is-paper-li)

• Patwebbot 1x detected

  Example user agent
  Patwebbot (http://www.herz-power.de/technik.html)

• PDFBot 1x detected

  Example user agent
  PDFBot (crawler@pdfind.com)

• pdrlabs Bot 1x detected

  Example user agent
  Cloud mapping experiment. Contact research@pdrlabs.net

• PEAR HTTP_Request2 1x detected

  Example user agent
  HTTP_Request2/2.1.1 (http://pear.php.net/package/http_request2) PHP/5.3.10-1ubuntu3.6

• PEAR-PHP 1x detected

  Example user agent
  PEAR HTTP_Request class

• PECL HTTP 1x detected

  Example user agent
  PECL::HTTP/1.7.4 (PHP/5.4.4)

• Peeplo Screenshot Bot 1x detected

  Example user agent
  Peeplo Screenshot Bot/0.20 ( abuse at peeplo dot_com )

• Pete-Spider 1x detected

  Example user agent
  Pete-Spider/1.1

• Phantom.js bot 1x detected

  Example user agent
  Phantom.js bot

• phantomas 1x detected

  Example user agent
  phantomas/1.8.0 (PhantomJS/1.9.8; linux x64)

• Photon 1x detected

  Example user agent
  Photon/1.0

• PHP 3x detected

  Example user agent
  PHP/5.2.13

• picmole Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible;picmole/1.0 +http://www.picmole.com)

• Picsearch Bot 3x detected

  Example user agent
  psbot/0.1 (+http://www.picsearch.com/bot.html)

• Pingdom 2x detected

  Example user agent
  Pingdom.com_bot_version_1.4_(http://www.pingdom.com/)

• PiplBot 1x detected

  Example user agent
  Mozilla/5.0+(compatible;+PiplBot;++http://www.pipl.com/bot/)

• PlantyNet 1x detected

  Example user agent
  PlantyNet_WebRobot_V1.9 babo@plantynet.com

• PluckItCrawler 1x detected

  Example user agent
  PluckItCrawler/1.0 (compatible; Mozilla 4.0; MSIE 5.5; http://www.pluck.com;)

• pmoz.info ODP link checker 1x detected

  Example user agent
  Mozilla/5.0 (compatible; pmoz.info ODP link checker; +http://pmoz.info/doc/botinfo.htm)

• Pompos 1x detected

  Example user agent
  Pompos/1.2 http://pompos.iliad.fr

• Powermarks 1x detected

  Example user agent
  Mozilla/4.0 (compatible; Powermarks/3.5; Windows 95/98/2000/NT)

• Prlog 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Prlog/1.0; +http://prlog.ru/)

• profiller 1x detected

  Example user agent
  Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.21 (KHTML, like Gecko) profiller Safari/537.21

• proximic 1x detected

  Example user agent
  Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php)

• Proxy Gear Pro 1x detected

  Example user agent
  Proxy Gear Pro/2.1 (Windows; N; Windows NT 6.1; en)

• pub-crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; pub-crawler; +http://wiki.github.com/bixo/bixo/bixocrawler; bixo-dev@yahoogroups.com)

• publiclibraryarchive Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; publiclibraryarchive.org/1.0; +crawl@publiclibraryarchive.org)

• PWBot 1x detected

  Example user agent
  Mozilla/5.1 (compatible; PWBot/1.0; +http://opendownload.pw)

• PycURL 1x detected

  Example user agent
  PycURL/7.22.0

• Python 1x detected

  Example user agent
  pythonic-crawler (suzuki@tkl.iis.u-tokyo.ac.jp)

• python-requests 6x detected

  Example user agent
  python-requests/1.2.3 CPython/2.7.3 Linux/3.5.0-23-generic

• Python-urllib 3x detected

  Example user agent
  Python-urllib/1.16

• Qualidator.com Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Qualidator.com Bot 1.0;)

• QuerySeekerSpider 1x detected

  Example user agent
  QuerySeekerSpider ( http://queryseeker.com/bot.html )

• QuickFinder 1x detected

  Example user agent
  QuickFinder Crawler

• QuickiWiki Bot 1x detected

  Example user agent
  QuickiWiki/1.0 (http://www.quickiwiki.com; admin@quickiwiki.com) BasedOnNodeJs/0.10.23

• Qwantify 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Qwantify/2.0; +https://www.qwant.com/)

• R6 CommentReader 1x detected

  Example user agent
  R6_CommentReader(www.radian6.com/crawler)

• R6 FeedFetcher 2x detected

  Example user agent
  R6_FeedFetcher(www.radian6.com/crawler)

• RamblerMail Bot 1x detected

  Example user agent
  RamblerMail/6.0 (incompatible; ImageProxy/6.0)

• RankFlex 1x detected

  Example user agent
  RankFlex.com Webspider

• redbot 1x detected

  Example user agent
  RED/1 (http://redbot.org/)

• RedCarpet 2x detected

  Example user agent
  RedCarpet/1.0 (http://www.redcarpet-inc.com/robots.html)

• Reddit 1x detected

  Example user agent
  Mozilla/5.0 (compatible; redditbot/1.0; +http://www.reddit.com/feedback)

• reddit pic scraper 1x detected

  Example user agent
  Mozilla / reddit pic scraper v0.8 (bklug@tyx.net)

• Research Projects 2x detected

  Example user agent
  CMS crawler ( http://buytaert.net/crawler/)

• restify 1x detected

  Example user agent
  restify/2.6.3 (x64-darwin; v8/3.14.5.9; OpenSSL/1.0.1i) node/0.10.32

• Reverse IP Lookup 1x detected

  Example user agent
  Mozilla/5.0+(compatible; RevIP.info site analyzer v4.00; http://poweredby.revip.info)

• Riddler 2x detected

  Example user agent
  Riddler (http://riddler.io/about)

• Rippers 2x detected

  Example user agent
  Mozilla/3.01 (compatible;)

• Rival IQ Bot 1x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9) AppleWebKit/537.71 (KHTML, like Gecko) Version/7.0 Safari/537.71 (Rival IQ, rivaliq.com)

• RMSnapKit 1x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10) AppleWebKit/600.1.25 (KHTML, like Gecko) RMSnapKit/1.0

• Rogerbot 5x detected

  Example user agent
  rogerbot/1.1 (http://moz.com/help/pro/what-is-rogerbot-, rogerbot-crawler+pr1-crawler-14@moz.com)

• RSS2HTML 1x detected

  Example user agent
  FeedForAll rss2html.php v2

• RssBandit 2x detected

  Example user agent
  RssBandit/1.9.0.1002 (.NET CLR 2.0.50727.7512; WinNT 6.2.9200.0; http://www.rssbandit.org)

• RssBar 1x detected

  Example user agent
  RssBar/1.29 (RssBar for unDonut 1.35)

• RSSOwl 2x detected

  Example user agent
  RSSOwl/2.2.1.201312301316 (X11; U; en)

• Safari RSS 1x detected

  Example user agent
  AppleSyndication/56.1

• Safe-t.net Web Filtering Service 1x detected

  Example user agent
  FANGCrawl/0.01

• SafeSearch microdata crawler 1x detected

  Example user agent
  SafeSearch microdata crawler (https://safesearch.avira.com, safesearch-abuse@avira.com)

• Save n Keep Screenshot Bot 1x detected

  Example user agent
  SNK Screenshot Bot/0.20 ( abuse at savenkeep dot_com )

• ScollSpider 1x detected

  Example user agent
  ScollSpider/2.0 ( http://www.webwobot.com/ScollSpider.php)

• Scopia Crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Scopia Crawler 1.2; +http://www.scopia.co)

• ScoutJet 1x detected

  Example user agent
  Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/)

• Scrapy 4x detected

  Example user agent
  Scrapy/0.20.1 (+http://scrapy.org)

• Screaming Frog SEO Spider 6x detected

  Example user agent
  Screaming Frog SEO Spider/2.22

• ScreenerBot 1x detected

  Example user agent
  ScreenerBot Crawler Beta 2.0 (+http://www.ScreenerBot.com)

• Screenshot Bot 1x detected

  Example user agent
  pr-cy.ru Screenshot Bot

• Scrubby 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Scrubby/3.2; +http://seotools.scrubtheweb.com/webpage-analyzer.html)

• Searchteq Bot 1x detected

  Example user agent
  stq_bot (+http://www.searchteq.de)

• Second Live Client 1x detected

  Example user agent
  Mozilla/5.0 (Windows; U; ; en-US) AppleWebKit/533.3 (KHTML, like Gecko) SecondLife/3.7.23.297296 (Second Life Release; default skin) Safari/533.3

• Second Live Commerce Client 1x detected

  Example user agent
  Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0 ; .NET CLR 2.0.50215; SL Commerce Client v1.0; Tablet PC 2.0

• Securepoint Content Filter 1x detected

  Example user agent
  securepoint cf

• SeeBot 1x detected

  Example user agent
  seebot/2.0 (+http://www.seegnify.com/bot)

• Semantic Discovery 2x detected

  Example user agent
  semanticdiscovery/2.0(http://www.semanticdiscovery.com/robot.html)

• semantic-visions.com crawler 1x detected

  Example user agent
  Mozilla/5.0 (X11; compatible; semantic-visions.com crawler; HTTPClient 3.1)

• SemanticBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; SemanticBot/1.1)

• SemrushBot 4x detected

  Example user agent
  Mozilla/5.0 (compatible; SemrushBot-SA/0.97; +http://www.semrush.com/bot.html)

• SEOdiver Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; SEOdiver/1.0; +http://www.seodiver.com/bot)

• SEOkicks Robot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; SEOkicks-Robot +http://www.seokicks.de/robot.html)

• SEOprofiler 2x detected

  Example user agent
  Mozilla/5.0 (compatible; spbot/4.1.0; +http://OpenLinkProfiler.org/bot )

• SetLinks.ru Crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; SetLinks bot 1.2)

• Seznam Screenshot Generator 2x detected

  Example user agent
  Mozilla/5.0 PhantomJS (compatible; Seznam screenshot-generator 2.1; +http://fulltext.sblog.cz/screenshot/)

• SeznamBot 4x detected

  Example user agent
  SeznamBot/3.0 (+http://fulltext.sblog.cz/)

• Shim Crawler 1x detected

  Example user agent
  Shim-Crawler

• ShopWiki 1x detected

  Example user agent
  ShopWiki/1.0 ( +http://www.shopwiki.com/wiki/Help:Bot)

• ShowyouBot 1x detected

  Example user agent
  ShowyouBot (http://showyou.com/crawler)

• Shrook 2x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10) AppleWebKit/600.1.25 (KHTML, like Gecko) Shrook/434l

• SimplePie 4x detected

  Example user agent
  SimplePie/1.2.1-dev (Feed Parser; http://simplepie.org; Allow like Gecko) Build/20111015034325

• Simpy 1x detected

  Example user agent
  Simpy/1.1 (Simpy; http://www.simpy.com/?ref=bot; feedback at simpy dot com)

• Sistrix Crawler 2x detected

  Example user agent
  Sistrix

• SiteCon 2x detected

  Example user agent
  Mozilla/5.0 (Linux; U; en-gb) AppleWebKit/418.9.1 (KHTML, like Gecko) SiteCon/8.10.22

• SiteExplorer 2x detected

  Example user agent
  Mozilla/5.0 (compatible; SiteExplorer/1.0b; +http://siteexplorer.info/)

• SkypeUriPreview 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; WOW64) SkypeUriPreview Preview/0.5

• Slackbot 1x detected

  Example user agent
  Slackbot (+https://api.slack.com/robots)

• Slackbot-Link-Expanding 2x detected

  Example user agent
  Slackbot-LinkExpanding (+https://api.slack.com/robots)

• Smartsite HTTPClient 1x detected

  Example user agent
  Smartsite HTTPClient - Mozilla/4.0 (compatible; MSIE 6.0)

• SMRF URL Expander 1x detected

  Example user agent
  SMRF URL Expander

• SMTBot 3x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1) (compatible; SMTBot/1.0; +http://www.similartech.com/smtbot)

• Socialradarbot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Linux; Socialradarbot/2.0; en-US; crawler@infegy.com)

• SocialSpider-Finder 1x detected

  Example user agent
  SocialSpider-Finder/0.2

• SoftListBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; SoftListBot/2.2; +http://www.softlist.us/)

• Sogou Develop Spider 1x detected

  Example user agent
  Sogou develop spider/4.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• Sogou Head Spider 1x detected

  Example user agent
  Sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• Sogou Orion spider 1x detected

  Example user agent
  Sogou Orion spider/4.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• Sogou Pic Spider 3x detected

  Example user agent
  Sogou Pic Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm

• Sogou Push Spider 1x detected

  Example user agent
  Sogou Push Spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• Sogou Spider 1x detected

  Example user agent
  New-Sogou-Spider/1.0 (compatible; MSIE 5.5; Windows 98)

• Sogou Web Spider 3x detected

  Example user agent
  Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

• Sogou-Test-Spider 1x detected

  Example user agent
  Sogou-Test-Spider/4.0 (compatible; MSIE 5.5; Windows 98)

• Sophora Linkchecker 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Sophora Linkchecker; http://www.subshell.com)

• SophosAgent 1x detected

  Example user agent
  SophosAgent/1.0 (type= spa )

• SophosUpdateManager 1x detected

  Example user agent
  SophosUpdateManager/1.5.7.50 SDDS/2.0 (u= EO2ANA123G c= 6342da15-f351-4ab7-9656-3f5f2d50885d )

• Sosospider 1x detected

  Example user agent
  Sosospider+(+http://help.soso.com/webspider.htm)

• Spiderlytics 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Spiderlytics/1.0; +spider@spiderlytics.com)

• Spinn3r RSS Aggregator 1x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/2010040121 Firefox/3.0.19

• Sproose 1x detected

  Example user agent
  sproose/1.0beta (sproose bot; http://www.sproose.com/bot.html; crawler@sproose.com)

• Squid 3x detected

  Example user agent
  BREW-Applet/0x20068888 (BREW/3.1.5.20; DeviceId: 90197; Lang: zhcn) ucweb-squid

• Squzer 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Squzer/0.0.1; +http://www.declum.com/)

• sReleaseBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; sReleaseBot/6.1; +http://www.srelease.com/)

• sSearch Crawler 1x detected

  Example user agent
  ssearch_bot (sSearch Crawler; http://www.semantissimo.de)

• Steeler 3x detected

  Example user agent
  Steeler/3.3 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)

• Superarama.com - BOT 1x detected

  Example user agent
  Superarama.com - BOT/v.0.1

• Superfeedr Bot 2x detected

  Example user agent
  Superfeedr bot/2.0 http://superfeedr.com - Make your feeds realtime: get in touch

• SurveyBot 1x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.9.0.13) Gecko/2009073022 Firefox/3.5.2 (.NET CLR 3.5.30729) SurveyBot/2.3 (DomainTools)

• Swiss Search Engine 1x detected

  Example user agent
  search.ch/2.8 Android/4.0.3; htc_europe:HTC One V; Mozilla/5.0 (Linux; U; Android-universal)

• SynHttpClient 1x detected

  Example user agent
  SynHttpClient-Built/5759

• T-Online Browser 1x detected

  Example user agent
  T-Online Browser

• test certificate info 1x detected

  Example user agent
  test certificate info

• TestCrawler 8x detected

  Example user agent
  ldspider (BTC 2011 crawl, harth@kit.edu, http://code.google.com/p/ldspider/wiki/Robots)

• Texis Webscript 1x detected

  Example user agent
  Mozilla/4.0 (compatible; T-H-U-N-D-E-R-S-T-O-N-E)

• The Old Reader 1x detected

  Example user agent
  Mozilla/5.0 (compatible; theoldreader.com; 1 subscribers; feed-id=51413de5bd9279ea5002d75b)

• Theme Spider 1x detected

  Example user agent
  Theme Spider ( http://www.themespider.com/spider.html)

• ThumbnailAgent 1x detected

  Example user agent
  ThumbnailAgent

• Thumbor 1x detected

  Example user agent
  Thumbor/3.14.6

• thumbshots-de-bot 1x detected

  Example user agent
  thumbshots-de-bot (+http://www.thumbshots.de/)

• ThumbShotsBot 1x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux x86_64; de-DE; rv:1.9.0.19) Gecko/2010091808 ThumbShotsBot (KFSW 3.0.6-3)

• ThumbSniper 1x detected

  Example user agent
  ThumbSniper (http://thumbsniper.com)

• TinEye Bot 1x detected

  Example user agent
  TinEye-bot/0.02 (see http://www.tineye.com/crawler.html)

• Tiny Tiny RSS 2x detected

  Example user agent
  Tiny Tiny RSS/1.11.4c63934 (http://tt-rss.org/)

• TLSProber 1x detected

  Example user agent
  TLSProber/0.8

• TrendWinHttp 1x detected

  Example user agent
  TrendWinHttp/

• TurnitinBot 2x detected

  Example user agent
  TurnitinBot/1.5 (http://www.turnitin.com/robot/crawlerinfo.html)

• Tutorial Crawler 1x detected

  Example user agent
  Tutorial Crawler 1.4

• TweetedTimes Bot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; TweetedTimes Bot/1.0 (resolver); +http://tweetedtimes.com)

• TweetmemeBot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; TweetmemeBot/2.11; +http://tweetmeme.com/)

• Twingly Recon 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Twingly Recon; twingly.com)

• Twisted PageGetter 1x detected

  Example user agent
  Twisted PageGetter

• Twitterbot 1x detected

  Example user agent
  Twitterbot/1.0

• TYPO3 Linkvalidator 1x detected

  Example user agent
  Mozilla/5.0 TYPO3-linkvalidator

• Uipbot 1x detected

  Example user agent
  uipbot/1.0 (uipbot@semasio.net)

• uMBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; uMBot-LN/1.0; mailto: crawling@ubermetrics-technologies.com)

• UnisterBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; UnisterBot; crawler@unister.de)

• Unity Web Player 1x detected

  Example user agent
  UnityPlayer/4.3.2f1 (http://unity3d.com)

• Univention Corporate Server 1x detected

  Example user agent
  UCS (ESX) - 4.0-3 errata302 - 28d414cc-2dac-4c0e-a34a-734020b8af66 - 00000000-0000-0000-0000-000000000000 -

• UniversalFeedParser 1x detected

  Example user agent
  UniversalFeedParser/5.1.3 +https://code.google.com/p/feedparser/

• Updated! 1x detected

  Example user agent
  updated/0.1-alpha (updated crawler; http://www.updated.com; crawler@updated.com)

• URL Grabber 2x detected

  Example user agent
  urlgrabber/3.10 yum/3.4.3

• URLAppendBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; URLAppendBot/1.0; +http://www.profound.net/urlappendbot.html)

• URLfilterDB Crawler 1x detected

  Example user agent
  Mozilla/5.0 (URLfilterDB-crawler/1.1) ufdb/1.0

• USyd-NLP-Spider 1x detected

  Example user agent
  USyd-NLP-Spider (http://www.it.usyd.edu.au/~vinci/bot.html)

• Vagabondo 4x detected

  Example user agent
  Mozilla/4.0 (compatible; Vagabondo/2.2; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)

• Validator.nu/LV 1x detected

  Example user agent
  Validator.nu/LV http://validator.w3.org/services

• vBulletin SEO Bot 1x detected

  Example user agent
  Mozilla/4.0 (vBSEO; http://www.vbseo.com)

• viralvideochart Bot 1x detected

  Example user agent
  viralvideochart.unrulymedia.com

• visionutils 1x detected

  Example user agent
  visionutils/0.2

• vkShare 1x detected

  Example user agent
  Mozilla/5.0 (compatible; vkShare; +http://vk.com/dev/Share)

• VoilaBot 2x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com)

• VSE Link Tester 2x detected

  Example user agent
  VSE/1.0 (testcrawler@hotmail.com)

• W3C I18n Checker 1x detected

  Example user agent
  W3C_I18n-Checker/1.0 (http://validator.w3.org/services)

• W3C Unicorn 1x detected

  Example user agent
  W3C_Unicorn/1.0 (http://validator.w3.org/services)

• W3C_Validator 2x detected

  Example user agent
  W3C_Validator/1.3 http://validator.w3.org/services

• W3C-checklink 2x detected

  Example user agent
  W3C-checklink/4.0 [4.4] libwww-perl/5.803

• W3C-mobileOK/DDC 1x detected

  Example user agent
  W3C-mobileOK/DDC-1.0 (see http://www.w3.org/2006/07/mobileok-ddc)

• Wada.vn Search Bot 2x detected

  Example user agent
  Wada.vn Vietnamese Search

• WASALive Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; WASALive-Bot ; http://blog.wasalive.com/wasalive-bots/)

• Wayback Archive Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; waybackarchive.org/1.0; +spider@waybackarchive.org)

• WBSearchBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)

• WDG HTML Validator 1x detected

  Example user agent
  WDG_Validator/1.6.5

• Web Glance 2x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux; C -) AppleWebKit/527+ (KHTML, like Gecko, Safari/419.3) Webglance/0.1

• WEB.DE MailCheck 1x detected

  Example user agent
  WEB.DE MailCheck/2.4.0

• WebAlta Crawler 2x detected

  Example user agent
  WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU)

• Webbot.ru 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Webbot/0.1; http://www.webbot.ru/bot.html)

• webceo Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; online-webceo-bot/1.0; +http://online.webceo.com)

• WebIndex 1x detected

  Example user agent
  WebIndex

• WebMasterAid 1x detected

  Example user agent
  Mozilla/5.0 (compatible; WebMasterAid/1.0; +http://wmaid.com/explore/)

• WebmasterCoffee 1x detected

  Example user agent
  Mozilla/5.0 (compatible; WebmasterCoffee/0.7; +http://webmastercoffee.com/about)

• WebRingChecker 1x detected

  Example user agent
  WebRingChecker/1.71 LWP/5.79

• Website Explorer 1x detected

  Example user agent
  Website Explorer/0.9.9.9

• Website Thumbnail Generator 3x detected

  Example user agent
  Mozilla/5.0 (compatible; WebThumbnail/2.2; Website Thumbnail Generator; +http://webthumbnail.org)

• WebTarantula 1x detected

  Example user agent
  WebTarantula.com Crawler

• WebThumb 1x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.9.2.19) Gecko WebThumb/1.0

• WebZIP 1x detected

  Example user agent
  WebZIP/7.0 (http://www.spidersoft.com)

• Werbefreie Deutsche Suchmaschine 2x detected

  Example user agent
  Mozilla/5.0 (compatible; DeuSu/0.1.0; +https://deusu.de/robot.html)

• WeSEE:Ads 1x detected

  Example user agent
  WeSEE:Ads/PageBot (http://www.wesee.com/bot/)

• WeSEE:Search 2x detected

  Example user agent
  WeSEE:Search/0.1 (Alpha, http://www.wesee.com/en/support/bot/)

• wget 8x detected

  Example user agent
  Wget/1.11.4

• WhatWeb Web Scanner 2x detected

  Example user agent
  WhatWeb/0.4.8-dev

• WI Job Roboter 1x detected

  Example user agent
  Mozilla/5.0 (compatible;WI Job Roboter Spider Version 3;+http://www.webintegration.at)

• Willow Internet Crawler 1x detected

  Example user agent
  Willow Internet Crawler by Twotrees V2.1

• Windows Phone Search 3x detected

  Example user agent
  Windows Phone Search (Windows Phone OS 8.0;NOKIA;Lumia 1520;8.0;10521)

• Windows-RSS-Platform 2x detected

  Example user agent
  Windows-RSS-Platform/2.0 (MSIE 9.0; Windows NT 6.0)

• Windows-Update-Agent 2x detected

  Example user agent
  Windows-Update-Agent/7.9.9600.17729 Client-Protocol/1.21

• WinHttp 2x detected

  Example user agent
  WinHTTP

• WinkBot 1x detected

  Example user agent
  WinkBot/0.06 (Wink.com search engine web crawler; http://www.wink.com/Wink:WinkBot; winkbot@wink.com)

• WIRE 1x detected

  Example user agent
  WIRE/1.0 (Linux;i686;Bot,Robot,Spider,Crawler)

• WiseNut search engine crawler 2x detected

  Example user agent
  Mozilla/4.0 compatible ZyBorg/1.0

• WNMbot 1x detected

  Example user agent
  WNMbot/0.4.0

• WooRank 2x detected

  Example user agent
  woobot/1.1

• WordPress 5x detected

  Example user agent
  WordPress/3.8.1; http://www.samsung-blog-news.de

• woriobot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; woriobot support [at] zite [dot] com +http://zite.com)

• WorldLingo 1x detected

  Example user agent
  WebIndexer/1-dev (Web Indexer; mailto://webindexerv1@yahoo.com; webindexerv1@yahoo.com)

• worldwebheritage.org Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; worldwebheritage.org/1.0; +crawl@worldwebheritage.org)

• Wotbox 3x detected

  Example user agent
  Wotbox/2.01 ( http://www.wotbox.com/bot/)

• wsr-agent 1x detected

  Example user agent
  wsr-agent/1.0

• WWW-Mechanize 1x detected

  Example user agent
  WWW-Mechanize/1.64

• Xaldon WebSpider 1x detected

  Example user agent
  Xaldon WebSpider 2.7.b6

• Xenus Link Sleuth 3x detected

  Example user agent
  Xenu Link Sleuth/1.3.8

• Xerka 1x detected

  Example user agent
  Xerka WebBot v1.0.0 [AIDO_CREA_ab]

• XING Contenttabreceiver 1x detected

  Example user agent
  XING-contenttabreceiver/2.0

• XML Sitemaps Generator 1x detected

  Example user agent
  Mozilla/5.0 (compatible; XML Sitemaps Generator; http://www.xml-sitemaps.com) Gecko XML-Sitemaps/1.0

• XoviBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)

• XSpider 1x detected

  Example user agent
  XSpider 0.01;http://uncool.oicp.net/spider.html

• Y!J-AGENT 9x detected

  Example user agent
  Y!J-BSC/1.0 crawler (http://help.yahoo.co.jp/help/jp/blog-search/)

• YaCy Bot 2x detected

  Example user agent
  yacybot (freeworld/global; x86 Windows XP 5.1; java 1.7.0_21; GMT+04:00/ru) http://yacy.net/bot.html

• Yahoo 1x detected

  Example user agent
  YahooCacheSystem

• Yahoo Ad Monitoring 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html)

• Yahoo Link Preview 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Yahoo Link Preview; https://help.yahoo.com/kb/mail/yahoo-link-preview-SLN23615.html)

• Yahoo Mobile App 2x detected

  Example user agent
  YahooMobile/1.0 (Yahoo! Search; 3.1.2) (Apple; iPod touch; iPhone OS/7.1.1); YHOO_Search_App/3.1.2

• Yahoo Pipes 1x detected

  Example user agent
  Yahoo Pipes 2.0

• Yahoo Slingstone 1x detected

  Example user agent
  Yahoo:LinkExpander:Slingstone

• Yahoo-MMCrawler 2x detected

  Example user agent
  Mozilla/5.0 (Yahoo-MMCrawler/4.0; mailto:vertical-crawl-support@yahoo-inc.com)

• Yahoo-Test 2x detected

  Example user agent
  Mozilla/5.0 (Yahoo-Test/4.0 ysm-keystone-crawl-support@yahoo-inc.com)

• Yahoo! Slurp 7x detected

  Example user agent
  Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp

• Yahoo! Slurp China 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)

• YahooSeeker 1x detected

  Example user agent
  YahooSeeker/1.0 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/shop/merchant/)

• YahooSeeker-Mobile 1x detected

  Example user agent
  LG-C1500 UP.Browser/6.2.3 (GUI) MMP/1.0 (compatible;YahooSeeker/M1A1-R2D2; http://help.yahoo.com/help/us/ysearch/crawling/crawling-01.html)

• YandexBlogs 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexBlogs/0.99; robot; B; +http://yandex.com/bots)

• YandexBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)

• YandexDirect-Dyatel 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexDirect/3.0; +http://yandex.com/bots)

• YandexFavicons 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexFavicons/1.0; +http://yandex.com/bots)

• YandexImageResizer 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexImageResizer/2.0; +http://yandex.com/bots)

• YandexImages 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)

• YandexMetrika 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexMetrika/2.0; +http://yandex.com/bots)

• YandexNews 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexNews/3.0; +http://yandex.com/bots)

• YellowPages 1x detected

  Example user agent
  yp-crawl@attinteractive.com

• YioopBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YioopBot; +http://173.13.143.74/bot.php)

• YisouSpider 1x detected

  Example user agent
  YisouSpider

• YodaoBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )

• YodaoBot-Image 1x detected

  Example user agent
  Mozilla/5.0 (compatible;YodaoBot-Image/1.0;http://www.youdao.com/help/webmaster/spider/;)

• yoozBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; yoozBot-2.2; http://yooz.ir; info@yooz.ir)

• YoudaoBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )

• YRL_ODP_CRAWLER 1x detected

  Example user agent
  YRL_ODP_CRAWLER

• Zao-Crawler 1x detected

  Example user agent
  Zao-Crawler

• ZE.bz 1x detected

  Example user agent
  ZeBot_www.ze.bz (ze.bz@hotmail.com)

• Zend_Http_Client 1x detected

  Example user agent
  Zend_Http_Client

• Zeus 1x detected

  Example user agent
  Zeusbot/0.8.1 (Ulysseek's web-crawling robot; http://www.zeusbot.com; agent@zeusbot.com)

• ZIBB Crawler 1x detected

  Example user agent
  ZIBB Crawler (email address / WWW address)

• zitebot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; zitebot support [at] zite [dot] com +http://zite.com)

• ZmEu 1x detected

  Example user agent
  ZmEu

• Zollard Worm 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Zollard; Linux)

• Zookabot 2x detected

  Example user agent
  Zookabot/2.5;++http://zookabot.com

• ZumBot 2x detected

  Example user agent
  ZumBot/1.0 (ZUM Search; http://help.zum.com/inquiry)

About this comparison