Detected bot names - BrowscapFull 6014

• .NET Framework CLR 1x detected

  Example user agent
  MS Web Services Client Protocol 1.0.3705.0

• 007AC9 Crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; 007ac9 Crawler; http://crawler.007ac9.net/)

• 12345 1x detected

  Example user agent
  12345

• 200PleaseBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; 200PleaseBot/1.0; +http://www.200please.com/bot)

• 360Spider 5x detected

  Example user agent
  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; MDDR; .NET4.0C; .NET4.0E; .NET CLR 1.1.4322; Tablet PC 2.0); 360Spider

• 80Legs 4x detected

  Example user agent
  Mozilla/5.0 (compatible; 80bot/0.71; http://www.80legs.com/spider.html;) Gecko/2008032620

• A6-Indexer 2x detected

  Example user agent
  A6-Indexer

• Abonti WebSearch 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Abonti/0.92 - http://www.abonti.com)

• Aboundexbot 2x detected

  Example user agent
  Aboundex/0.3 (http://www.aboundex.com/crawler/)

• AboutTheDomain Bot 1x detected

  Example user agent
  aboutthedomain

• AboutUs Bot 1x detected

  Example user agent
  AboutUsBot/Harpy (Website Analysis; http://www.aboutus.org/Aboutus:Bot; help@aboutus.org)

• AboutUs Bot Johnny5 1x detected

  Example user agent
  Mozilla/5.0 (compatible; AboutUsBot Johnny5/2.0; +http://www.AboutUs.org/)

• acapbot 1x detected

  Example user agent
  Mozilla/5.0 (compatible;acapbot/0.1.;treat like Googlebot)

• Accoona Bot 1x detected

  Example user agent
  Accoona-Biz-Agent/1.1.1 crawler@accoona.com

• Accoona-AI-Agent 3x detected

  Example user agent
  Accoona-AI-Agent/1.1.2

• AccServer 1x detected

  Example user agent
  AccServer[HOGANMIDSCHOOL]/5.0.2.20(24517) 64-bit HTTP-Agent

• AcoonBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; AcoonBot/4.11.1; +http://www.acoon.de/robot.asp)

• Ad Muncher 1x detected

  Example user agent
  Ad Muncher v4.93.33707/4957

• Adaxas Spider 1x detected

  Example user agent
  Adaxas Spider (http://www.adaxas.net/)

• Adbeat Bot 4x detected

  Example user agent
  Mozilla/5.0 (X11; Linux x86_64) adbeat.com/policy AppleWebKit/537.21 (KHTML, like Gecko) Firefox/34.0 Safari/537.21

• Add Catalog 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Add Catalog/2.1;)

• AddThis.com robot 2x detected

  Example user agent
  AddThis.com (http://support.addthis.com/)

• adidxbot 1x detected

  Example user agent
  adidxbot/2.0 (+http://search.msn.com/msnbot.htm)

• ADmantX Platform Semantic Analyzer 2x detected

  Example user agent
  ADmantX Platform Semantic Analyzer US Async - ADmantX Inc. - www.admantx.com - support@admantx.com

• AdsBot Google 3x detected

  Example user agent
  AdsBot-Google (+http://www.google.com/adsbot.html)

• AdsBot Google-Mobile 2x detected

  Example user agent
  AdsBot-Google-Mobile (+http://www.google.com/mobile/adsbot.html) Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36

• AdSense Bot 2x detected

  Example user agent
  Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML, like Gecko) Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; Mediapartners-Google/2.1; +http://www.google.com/bot.html)

• AdSense Snapshot Bot 1x detected

  Example user agent
  Adsense-Snapshot-Google

• AdvBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; AdvBot/2.0; +http://advbot.net/bot.html)

• AhrefsBot 4x detected

  Example user agent
  Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/) AppEngine-Google; (+http://code.google.com/appengine; appid: s~proxyfile1-hrd)

• AISearchBot 1x detected

  Example user agent
  AISearchBot (Email: aisearchbot@gmail.com; If your web site doesn't want to be crawled, please send us a email.)

• AjaxSnapBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; AjaxSnapBot; +http://ajaxsnapshots.com/bot.html)

• akregator 3x detected

  Example user agent
  Akregator/1.2.9; librss/remnants

• Alexa Site Audit 1x detected

  Example user agent
  Mozilla/5.0 (compatible; alexa site audit/1.0; +http://www.alexa.com/help/webmasters; )

• Alexabot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Alexabot/1.0; +http://www.alexa.com/help/certifyscan; certifyscan@alexa.com)

• alyze Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; http://alyze.info)

• Amazon CloudFront 1x detected

  Example user agent
  Amazon CloudFront

• Amfibi 1x detected

  Example user agent
  Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com)

• Amiga 18x detected

  Example user agent
  Mozilla/5.0 (AmigaOS; AmigaOS 53.26 PowerPC; rv:2.0.1) Gecko/20120327 Firefox/4.0.1

• Android Download Manager 5x detected

  Example user agent
  AndroidDownloadManager

• Anonymizied 1x detected

  Example user agent
  Mozilla/5.0 (Randomized by FreeSafeIP.com/upgrade-to-remove; compatible; MSIE 9.0; Windows NT 5.0WOW64) Chrome/18.0.1229.79

• Another Web Mining Tool 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Another Web Mining Tool 1.0; +none; awmt)

• AntBot 1x detected

  Example user agent
  AntBot/1.0 (http://www.ant.com)

• AOLbot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; AOLbot/4.0; +http://www.aol-soft.com/)

• Apache Synapse 1x detected

  Example user agent
  Mozilla/4.0 (compatible; Synapse)

• Apercite 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Apercite; +http://www.apercite.fr/robot/index.html)

• Apple-PubSub 1x detected

  Example user agent
  Apple-PubSub/65.28

• Applebot 3x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1)

• Apt HTTP Transport 2x detected

  Example user agent
  Ubuntu APT-HTTP/1.3 (0.7.20.2ubuntu6)

• Arachnida Web Crawler 1x detected

  Example user agent
  Arachnida Web Crawler

• ARC Reader 1x detected

  Example user agent
  ARC Reader (http://arc.semsol.org/)

• ArchitextSpider 1x detected

  Example user agent
  ArchitextSpider

• ArchiveBot 2x detected

  Example user agent
  ArchiveTeam ArchiveBot/20141009.02 (wpull 0.1002a1) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.101 Safari/537.36

• AskPeterBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; AskPeterBot; +http://www.askpeter.de/bot.html)

• Astute Social 1x detected

  Example user agent
  Astute SRM

• Asynchronous HTTP Client 1x detected

  Example user agent
  AHC/1.0

• asynchttp 1x detected

  Example user agent
  asynchttp

• Athena Site Analyzer 1x detected

  Example user agent
  Athena Site Analyzer (bestsiteanalyzer.com)

• AuditMyPC Webmaster Tool 1x detected

  Example user agent
  AuditMyPC Webmaster Tool

• Automated Security Analyser 1x detected

  Example user agent
  asafaweb.com

• ayna-crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; ayna-crawler http://www.ayna.com)

• BabalooSpider 2x detected

  Example user agent
  BabalooSpider/1.3 (BabalooSpider; http://www.babaloo.si; spider@babaloo.si)

• BacklinkCrawler 1x detected

  Example user agent
  BacklinkCrawler (http://www.backlinktest.com/crawler.html)

• Baidu Image Search 3x detected

  Example user agent
  Baiduspider-image+(+http://www.baidu.com/search/spider.htm)

• Baidu Mobile Search 3x detected

  Example user agent
  Mozilla/5.0 (Linux;u;Android 2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; +http://www.baidu.com/search/spi_der.html)

• Baidu Union 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Baiduspider-cpro; +http://www.baidu.com/search/spider.html)

• Baiduspider 12x detected

  Example user agent
  Baiduspider+(+http://www.baidu.com/search/spider_jp.html)

• bandscraper 1x detected

  Example user agent
  bandscraper

• BCKLINKS 1x detected

  Example user agent
  BCKLINKS 1.0

• BecomeBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; BecomeBot/3.0; MSIE 6.0 compatible; +http://www.become.com/site_owners.html)

• Begun Advertising Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; BegunAdvertising/3.0; +http://begun.ru/begun/technology/indexer/)

• BigBozz - Financial Search 1x detected

  Example user agent
  BigBozz/BigBozz-2.2.1

• BingBot 8x detected

  Example user agent
  Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

• BingPreview 7x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) BingPreview/1.0b

• BitlyBot 1x detected

  Example user agent
  bitlybot

• bl.uk_lddc_bot 2x detected

  Example user agent
  Mozilla/5.0 (bl.uk_lddc_bot; Linux x86_64) PhantomJS/1.9.7 (+http://www.bl.uk/aboutus/legaldeposit/websites/websites/faqswebmaster/index.html)

• Blackboard Safeassign 1x detected

  Example user agent
  Blackboard Safeassign

• BlekkoBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Blekkobot; ScoutJet; +http://blekko.com/about/blekkobot)

• BLEXBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)

• Blog Search 1x detected

  Example user agent
  Mozilla/4.0 (compatible; Blog Search;)

• BlogLines Web 2x detected

  Example user agent
  Bloglines/3.1 (http://www.bloglines.com)

• Bloglovin Bot 2x detected

  Example user agent
  Bloglovin/1.0 (http://www.bloglovin.com; 0 subscribers)

• BlogPulse 1x detected

  Example user agent
  BlogPulse (ISSpider-3.0)

• Blogshares Spiders 1x detected

  Example user agent
  Blogshares Spiders (Renewed V1.65)

• BlueDragon 1x detected

  Example user agent
  BlueDragon

• bnf.fr Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; bnf.fr_bot; +http://www.bnf.fr/fr/outils/a.dl_web_capture_robot.html)

• BoardReader Favicon Fetcher 1x detected

  Example user agent
  BoardReader Favicon Fetcher /1.0 info@boardreader.com

• Boitho 2x detected

  Example user agent
  boitho.com-dc/0.4 ( http://www.boitho.com/dcbot.html )

• bot 2x detected

  Example user agent
  bot

• BOT for JCE 1x detected

  Example user agent
  BOT/0.1 (BOT for JCE)

• Bot Revolt 1x detected

  Example user agent
  revolt

• Bot.AraTurka.com 1x detected

  Example user agent
  Bot.AraTurka.com/0.0.1

• BOTW Spider 1x detected

  Example user agent
  Mozilla/4.0 (compatible; BOTW Spider; http://botw.org)

• BrokenLinkCheck 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 5.1) BrokenLinkCheck.com/1.1

• Browsershots 1x detected

  Example user agent
  Browsershots

• BrowseX 1x detected

  Example user agent
  Mozilla/4.61 [en] (X11; U; ) - BrowseX (2.0.0 Windows)

• BUbiNG Bot 1x detected

  Example user agent
  BUbiNG (+http://law.di.unimi.it/BUbiNG.html)

• BuiBui-Bot 1x detected

  Example user agent
  BuiBui-Bot/1.0 (email: buibui[at]dadapro[dot]com)

• BuSecurityProject 1x detected

  Example user agent
  Mozilla,BuSecurityProject

• Butterfly 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Butterfly/1.0; +http://labs.topsy.com/butterfly/) Gecko/2009032608 Firefox/3.0.8

• Butterfly Robot 1x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Butterfly/1.0; +http://labs.topsy.com/butterfly/) Gecko/2009032608 Firefox/3.0.8

• ca-crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; ca-crawler/1.0)

• CakePHP 1x detected

  Example user agent
  CakePHP

• Camo Asset Proxy 1x detected

  Example user agent
  Camo Asset Proxy 2.2.0

• CareerBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; CareerBot/1.1; +http://www.career-x.de/bot.html)

• cars-app-browser 1x detected

  Example user agent
  cars-app-browser

• Casterly 1x detected

  Example user agent
  Casterly

• CatchBot 3x detected

  Example user agent
  CatchBot/2.0; +http://www.catchbot.com

• CATExplorador 1x detected

  Example user agent
  CATExplorador/1.0beta (sistemes at domini dot cat; http://domini.cat/catexplorador.html)

• CazoodleBot 2x detected

  Example user agent
  CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com)

• CC Metadata Scaper 1x detected

  Example user agent
  CC Metadata Scaper http://wiki.creativecommons.org/Metadata_Scraper

• CCBot 2x detected

  Example user agent
  CCBot/2.0 (http://commoncrawl.org/faq/)

• Charlotte 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Charlotte/1.0b; charlotte@beta.spider.com)

• CheckLinks 1x detected

  Example user agent
  Checklinks/1.3 (pywikipedia robot; http://toolserver.org/~dispenser/view/Checklinks)

• CheckSite Verification Agent 1x detected

  Example user agent
  CheckSite Verification Agent (+http://www.checksite.us)

• chlooe Bot 1x detected

  Example user agent
  bot-pge.chlooe.com/1.0.0 (+http://www.chlooe.com/)

• city-map screenshot service 1x detected

  Example user agent
  city-map screenshot service

• Cliqzbot 2x detected

  Example user agent
  Cliqzbot/0.1 (+http://cliqz.com/company/cliqzbot)

• CloudFlare AlwaysOnline 1x detected

  Example user agent
  Mozilla/5.0 (compatible; CloudFlare-AlwaysOnline/1.0; +http://www.cloudflare.com/always-online) AppleWebKit/534.34

• CMS Crawler 1x detected

  Example user agent
  Mozilla/4.0 (CMS Crawler: http://www.cmscrawler.com)

• Coccoc bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; coccoc/1.0; +http://help.coccoc.com/)

• CommonCrawler Node 1x detected

  Example user agent
  Mozilla/5.0 CommonCrawler Node MNATI3RZFBD6ZTQNRVQGXBDCQOEXIA4CIDEUKNYZDF3MJSH5G7BCQ5EMADE5TLF.MHCZ3LLTWGHIHMYLM.YFBJBHE6R2YQTHOTJ3N5BGFP457JRX4AJRXGAJYGDAANRY24.cdn0.common.crawl.zone

• Comodo Spider 2x detected

  Example user agent
  Comodo Spider 1.1

• Comodo SSL Checker 1x detected

  Example user agent
  Comodo SSL Checker

• ContextAd Bot 1x detected

  Example user agent
  ContextAd Bot 1.0

• Convera 1x detected

  Example user agent
  ConveraCrawler/0.9c ( http://www.authoritativeweb.com/crawl)

• ConveraMultiMediaCrawler 1x detected

  Example user agent
  ConveraMultiMediaCrawler/0.1 ( http://www.authoritativeweb.com/crawl)

• Cookie Reports Bot 1x detected

  Example user agent
  CookieReports.com/0.1

• Crawlboy 10x detected

  Example user agent
  crawl/0.4 langcrawl/0.1

• CrawlConvera 1x detected

  Example user agent
  CrawlConvera0.1 (CrawlConvera@yahoo.com)

• Crawler 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Crawler/0.9; http://linkfluence.net/)

• crawler4j 1x detected

  Example user agent
  crawler4j (http://code.google.com/p/crawler4j/)

• CrawlRobot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; CrawlRobot; +http://localhost/bot.php)

• Crazywebcrawler 1x detected

  Example user agent
  CRAZYWEBCRAWLER 0.9.0, http://www.crazywebcrawler.com

• CSE HTML Validator 3x detected

  Example user agent
  CSE HTML Validator Online (http://www.OnlineWebCheck.com) via 23.19.188.134

• Curb 1x detected

  Example user agent
  Ruby/Curb

• cURL 9x detected

  Example user agent
  curl/7.19.5 (i586-pc-mingw32msvc) libcurl/7.19.5 zlib/1.2.3

• Cyberduck 1x detected

  Example user agent
  Cyberduck/4.6.4 (16610) (Windows XP/5.1) (x86)

• CyberPatrol 1x detected

  Example user agent
  CyberPatrol SiteCat Webbot (http://www.cyberpatrol.com/cyberpatrolcrawler.asp)

• Cydral Web Image Search 1x detected

  Example user agent
  CydralSpider/3.2 (Cydral Image Search; http://www.cydral.com)

• Daumoa 5x detected

  Example user agent
  Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server;) Daumoa/4.0;

• DAWINCI ANTIPLAG SPIDER 1x detected

  Example user agent
  Mozilla/4.0 (compatible; DAWINCI ANTIPLAG SPIDER)

• DBot 2x detected

  Example user agent
  Mozilla/5.1 (compatible; DBot/7.0; +http://getdownload.ws)

• dead link checker 1x detected

  Example user agent
  www.deadlinkchecker.com XMLHTTP/1.0 Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.86 Safari/537.36

• Diffbot 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.15 (KHTML, like Gecko; +http://www.diffbot.com) Chrome/24.0.1295.0 Safari/537.15

• Digg Bot 2x detected

  Example user agent
  Mozilla/5.0 (Digg/1.0; support@digg.com)

• Digg Feed Fetcher 1x detected

  Example user agent
  Digg Feed Fetcher 1.0 (Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_1) AppleWebKit/534.48.3 (KHTML, like Gecko) Version/5.1 Safari/534.48.3)

• Digincore Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Digincore bot; https://www.digincore.com/crawler.html for rules and instructions.

• DiscoverEd 1x detected

  Example user agent
  DiscoverEd/Nutch-1.7 (OER search crawler; http://wiki.creativecommons.org/DiscoverEd; webmaster@creativecommons.org)

• Discovery Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; discoverybot/2.0; +http://discoveryengine.com/discoverybot.html)

• Dispatch 1x detected

  Example user agent
  Dispatch/0.11.1-SNAPSHOT

• DMCA Page Protection Crawling Service 1x detected

  Example user agent
  DMCA.com Page Protection Crawling Service

• DNS Group Crawler 1x detected

  Example user agent
  DNSGroup/0.1 (DNS Group Crawler; http://www.dnsgroup.com/; crawler@dnsgroup.com)

• DocWeb Link Crawler 1x detected

  Example user agent
  DocWeb Link Crawler (http://doc.php.net)

• Dolphin smalltalk http client 1x detected

  Example user agent
  Dolphin http client/10.3.0(280) (Android)

• DomainAppender Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; DomainAppender /1.0; +http://www.profound.net/domainappender)

• DomainCrawler 1x detected

  Example user agent
  DomainCrawler/2.0 (info@domaincrawler.com; http://www.domaincrawler.com/bot

• DomainsBot 1x detected

  Example user agent
  domainsbot (+http://www.domainsbot.com)

• DomainScan Server Monitoring 2x detected

  Example user agent
  DomainSCAN

• DomainsDB 1x detected

  Example user agent
  DomainsDB.net MetaCrawler v.0.9.7b (http://domainsdb.net/)

• DomainSigmaCrawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; DomainSigmaCrawler/0.1; +http://domainsigma.com/robot)

• Domnutch Bot 1x detected

  Example user agent
  Domnutch-Bot/Nutch-1.0 (Domnutch; http://www.Nutch.de/)

• DotBot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org)

• Download Accelerator 1x detected

  Example user agent
  masscan/1.0 (https://github.com/robertdavidgraham/masscan)

• DuckDuck App 1x detected

  Example user agent
  DDG-Android-3.0.11

• DuckDuck Favicons Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com)

• DueDil Crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; electricmonk/3.2.0 +https://www.duedil.com/our-crawler/)

• E-Mail Siphon 1x detected

  Example user agent
  EmailSiphon

• EasouSpider 1x detected

  Example user agent
  Mozilla/5.0 (compatible; EasouSpider; +http://www.easou.com/search/spider.html)

• EasyBib AutoCite 2x detected

  Example user agent
  EasyBib AutoCite (http://content.easybib.com/autocite/)

• EBSCO EJS Content Server 1x detected

  Example user agent
  EBSCO EJS Content Server

• ECCP 1x detected

  Example user agent
  ECCP/1.0 (search@eniro.com)

• Echoping 1x detected

  Example user agent
  Echoping/6.0.2

• Elmer 1x detected

  Example user agent
  Elmer, the Thinglink ImageBot (http://www.thinglink.com/help/ThinglinkImageBot)

• Embed PHP Library 1x detected

  Example user agent
  Embed PHP Library

• Embedly 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Embedly/0.2; snap; +http://support.embed.ly/)

• Enigma Browser 1x detected

  Example user agent
  Enigma Browser

• Entireweb 10x detected

  Example user agent
  Speedy Spider (http://www.entireweb.com/about/search_tech/speedyspider/)

• Envolk 3x detected

  Example user agent
  envolk[ITS]spider/1.6 ( http://www.envolk.com/envolkspider.html)

• Esribot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Esribot/1.0; http://www.esrihu.hu/)

• Europe Internet Portal 1x detected

  Example user agent
  EuripBot/0.5 (+http://www.eurip.com) PreCheck

• EventMachine HttpClient 1x detected

  Example user agent
  EventMachine HttpClient

• Evernote Clip Resolver 1x detected

  Example user agent
  Evernote Clip Resolver

• EveryoneSocialBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; EveryoneSocialBot/1.0; support@everyonesocial.com http://everyonesocial.com/)

• Exabot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)

• ExactSeek Crawler 1x detected

  Example user agent
  ExactSeek Crawler/0.1

• Exalead 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails)

• Exalead CloudView 1x detected

  Example user agent
  Mozilla/5.0 (compatible; ExaleadCloudView/5;)

• Experibot 1x detected

  Example user agent
  Experibot_v1 (https://dl.dropboxusercontent.com/u/8024465/site/Info.html)

• Exploratodo Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Exploratodo/1.0; +http://www.exploratodo.com

• eZ Publish Link Validator 1x detected

  Example user agent
  eZ Publish Link Validator

• Ezooms 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)

• Facebook 1x detected

  Example user agent
  facebookplatform/1.0 (+http://developers.facebook.com)

• FacebookExternalHit 4x detected

  Example user agent
  facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

• Facebookscraper 1x detected

  Example user agent
  facebookscraper/1.0( http://www.facebook.com/sharescraper_help.php)

• Facebot 1x detected

  Example user agent
  Facebot/1.0

• Faraday 1x detected

  Example user agent
  Faraday v0.9.2

• FAST Enterprise Crawler 3x detected

  Example user agent
  RB2B-bot v0.1 (Using Fast Enterprise Crawler 6 search@reedbusiness.com)

• FAST MetaWeb Crawler 1x detected

  Example user agent
  FAST MetaWeb Crawler (helpdesk at fastsearch dot com)

• FAST PartnerSite 1x detected

  Example user agent
  Fast PartnerSite Crawler

• FAST-WebCrawler 3x detected

  Example user agent
  FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)

• fastbot crawler 1x detected

  Example user agent
  fastbot crawler beta 4.0 (+http://www.fastbot.de)

• FDSE Robot 1x detected

  Example user agent
  Mozilla/4.0 (compatible: FDSE robot)

• FeedBlitz 2x detected

  Example user agent
  FeedBlitz/1.0

• FeedBurner 1x detected

  Example user agent
  FeedBurner/1.0 (http://www.FeedBurner.com)

• FeedDemon 2x detected

  Example user agent
  FeedDemon/4.5 (http://www.feeddemon.com/; Microsoft Windows)

• Feeddler RSS Reader 1x detected

  Example user agent
  FeeddlerRSS 2.4 (iPad; iPhone OS 7.1; en_GB)

• FeedFetcher 1x detected

  Example user agent
  livedoor FeedFetcher/0.01 (http://reader.livedoor.com/; 999 subscribers)

• Feedfetcher-Google 5x detected

  Example user agent
  Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; 19 subscribers; feed-id=13965549748850348809)

• feedly App 1x detected

  Example user agent
  FeedlyApp/1.0 (http://www.feedly.com)

• feedly Feed Fetcher 1x detected

  Example user agent
  Feedly/1.0 (+http://www.feedly.com/fetcher.html; like FeedFetcher-Google)

• FeedlyBot 1x detected

  Example user agent
  FeedlyBot/1.0 (http://feedly.com)

• FeedValidator 1x detected

  Example user agent
  FeedValidator/1.3

• FHScan Core 1x detected

  Example user agent
  Mozilla/5.0 (FHScan Core 1.1)

• Finderlein Research Crawler 1x detected

  Example user agent
  Finderlein Research Crawler 1.0

• FindLinks 1x detected

  Example user agent
  findlinks/2.6 ( http://wortschatz.uni-leipzig.de/findlinks/)

• Flatland 1x detected

  Example user agent
  flatlandbot/allspark (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot; jason@flatlandindustries.com)

• FlipboardProxy 1x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:28.0) Gecko/20100101 Firefox/28.0 (FlipboardProxy/1.1; +http://flipboard.com/browserproxy)

• focuseekbot 1x detected

  Example user agent
  Mozilla/4.0 (compatible; focuseekbot)

• Forum Poster 1x detected

  Example user agent
  Forum Poster V3

• fr-crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; fr-crawler/1.1)

• FreeWebMonitoring SiteChecker 1x detected

  Example user agent
  FreeWebMonitoring SiteChecker/0.1 (+http://www.freewebmonitoring.com)

• Friendica 15x detected

  Example user agent
  Friendica 'Ginger' 3.3.1-1174; http://friendica.offerman.com

• FyberSpider 3x detected

  Example user agent
  FyberSpider/1.3 (http://www.fybersearch.com/fyberspider.php)

• GarlikCrawler 2x detected

  Example user agent
  GarlikCrawler/1.2 (http://garlik.com/, crawler@garlik.com)

• Genderanalyzer 1x detected

  Example user agent
  Genderanalyzer/1.0

• GenieKnows 2x detected

  Example user agent
  genieBot ((http://64.5.245.11/faq/faq.html))

• Genieo Web Filter 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Genieo/1.0 http://www.genieo.com/webfilter.html)

• Getintent Crawler 1x detected

  Example user agent
  GetintentCrawler getintent.com

• GetLinkInfo Bot 1x detected

  Example user agent
  Mozilla/5.0 (GetLinkInfo.com - http://www.getlinkinfo.com)

• gettor 1x detected

  Example user agent
  gettor/0.5

• GG PeekBot 1x detected

  Example user agent
  GG PeekBot 2.0 ( http://gg.pl/ http://info.gadu-gadu.pl/praca )

• GIDBot 1x detected

  Example user agent
  GIDBot/2.0 (+http://www.gidnetwork.com/tools/gzip-test.php)

• Gigablast Search Engine 1x detected

  Example user agent
  GigablastOpenSource/1.0

• Gigabot 2x detected

  Example user agent
  Gigabot/2.0/gigablast.com/spider.html

• Girafabot 2x detected

  Example user agent
  Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322; Girafabot [girafa.com])

• GLBot 1x detected

  Example user agent
  Mozilla/5.1 (compatible; GLBot/1.0; +http://galaxydownloads.co)

• Globel Bot 1x detected

  Example user agent
  Mozilla/4.0 (compatible; Globel; Traffic Sent From: http://addictive.me.uk)

• Gluten Free Crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Gluten Free Crawler/1.0; +http://glutenfreepleasure.com/)

• GO HttpClient 2x detected

  Example user agent
  Go-http-client/1.1

• GoGuidesBot 1x detected

  Example user agent
  GoGuidesBot/0.0.1 (GoGuides Indexing Spider; http://www.goguides.org/spider.html)

• Goldfire Server 1x detected

  Example user agent
  Goldfire Server

• Gomez Site Monitor 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; WOW64; rv:13.0; GomezAgent 3.0) Gecko/20100101 Firefox/13.0.1

• gooblog 1x detected

  Example user agent
  gooblog/2.0 (http://help.goo.ne.jp/contact/)

• Google 1x detected

  Example user agent
  Mozilla/5.0 (en-us) AppleWebKit/525.13 (KHTML, like Gecko; Google Web Preview) Version/3.1 Safari/525.13

• Google Adwords DisplayAds WebRender 2x detected

  Example user agent
  Mozilla/5.0 (en-us) AppleWebKit/537.36(KHTML like Gecko; Google-Adwords-DisplayAds-WebRender;) Chrome/27.0.1453Safari/537.36

• Google App Engine 3x detected

  Example user agent
  AppEngine-Google; ( http://code.google.com/appengine)

• Google Bot 35x detected

  Example user agent
  Googlebot v2.1 (+http://www.google.com/bot.html) (http://www.openwebspider.org/)

• Google Bot Mobile 6x detected

  Example user agent
  DoCoMo//2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

• Google Feedfetcher 1x detected

  Example user agent
  Mozilla/5.0 (compatible) Feedfetcher-Google;(+http://www.google.com/feedfetcher.html)

• Google HTTP Client Library for Java 2x detected

  Example user agent
  Google-HTTP-Java-Client/1.13.1-beta (gzip)

• Google Image Proxy 3x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7 (via ggpht.com)

• Google Image Search 1x detected

  Example user agent
  Googlebot-Image/1.0

• google images relinker 1x detected

  Example user agent
  greasemonkey – google images relinker (v 2.0)

• Google Keyword Suggestion 1x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux x86_64; en-US) AppleWebKit/534.16 (KHTML, like Gecko, Google Keyword Suggestion) Chrome/10.0.648.127 Safari/534.16

• Google PageSpeed Insights 5x detected

  Example user agent
  Mozilla/5.0 (iPhone; CPU iPhone OS 6_0_1 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko; Google Page Speed Insights) Version/6.0 Mobile/10A525 Safari/8536.25 GoogleBot/2.1

• Google Search Appliance 1x detected

  Example user agent
  gsa-crawler

• Google Structured-Data TestingTool 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Google-Structured-Data-Testing-Tool +http://developers.google.com/structured-data/testing-tool/)

• Google Toolbar 1x detected

  Example user agent
  Mozilla/4.0 (compatible; GoogleToolbar 7.5.5111.1712; Windows XP 5.1; MSIE 8.0.6001.18702)

• Google Web Preview 3x detected

  Example user agent
  Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; Google Web Preview) Chrome/27.0.1453 Safari/537.36

• Google Web Snippet 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; rv:6.0) Gecko/20110814 Firefox/6.0 Google (+https://developers.google.com/+/web/snippet/)

• Google Wireless Transcoder 1x detected

  Example user agent
  Mozilla/5.0 (en-us) AppleWebKit/534.14 (KHTML, like Gecko; Google Wireless Transcoder) Chrome/9.0.597 Safari/534.14

• Google-Site-Verification 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Google-Site-Verification/1.0)

• Google-Sitemaps 1x detected

  Example user agent
  Google-Sitemaps/1.0

• Googlebot-News 2x detected

  Example user agent
  Googlebot-News (2.3.3, ruby 1.9.3 (2013-11-22))

• Googlebot-Video 1x detected

  Example user agent
  Googlebot-Video/1.0

• goose-extractor 1x detected

  Example user agent
  Goose/1.0.25

• gosquared-thumbnailer 1x detected

  Example user agent
  gosquared-thumbnailer/1.0

• Grammarly 1x detected

  Example user agent
  Grammarly/1.0 (http://www.grammarly.com)

• grapeFX 1x detected

  Example user agent
  Mozilla/5.0 (compatible; grapeFX/0.9; crawler@grapeshot.co.uk

• GrapeshotCrawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; +http://www.grapeshot.co.uk/crawler.php)

• GreatNews 1x detected

  Example user agent
  GreatNews/1.0

• Gregarius 1x detected

  Example user agent
  Gregarius/0.5.2 (+http://devlog.gregarius.net/docs/ua)

• GroupHigh Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; GroupHigh/1.0; +http://www.grouphigh.com/bot.html)

• grub 2x detected

  Example user agent
  grub-client-1.5.3; (grub-client-1.5.3; Crawl your own stuff with http://grub.org)

• GurujiBot 5x detected

  Example user agent
  Mozilla/5.0 (compatible; GurujiBot/1.0; +http://www.guruji.com/en/WebmasterFAQ.html)

• Guzzle Http Client 4x detected

  Example user agent
  GuzzleHttp/6.1.0 curl/7.35.0 PHP/5.5.9-1ubuntu4.14

• gvfs 1x detected

  Example user agent
  gvfs/1.24.1

• GWPImages 1x detected

  Example user agent
  Mozilla/5.0 (compatible; GWPImages/1.0)

• Hatena Antenna 1x detected

  Example user agent
  Hatena Antenna/0.5 (http://a.hatena.ne.jp/help)

• Hatena Crawler 1x detected

  Example user agent
  Hatena::Crawler/0.01

• Hatena::Bookmark 1x detected

  Example user agent
  Hatena::Bookmark/2.00 (Hatena::Bookmark; master;)

• Heritrix 13x detected

  Example user agent
  Mozilla/5.0 (compatible; heritrix/3.1.1 +http://www.run4dom.com)

• HggH Screenshot System with PhantomJS 1x detected

  Example user agent
  HggH PhantomJS Screenshoter

• HiddenMarket 1x detected

  Example user agent
  HiddenMarket-1.0-beta (www.hiddenmarket.net/crawler.php)

• hitcrawler 1x detected

  Example user agent
  hitcrawler_0.1 (ringken@gmail.com)

• hivaBot 2x detected

  Example user agent
  hivaBot/hivaBot-0.2 (info@gorgor.ir)

• Holmes 2x detected

  Example user agent
  holmes/3.12.4 (http://morfeo.centrum.cz/bot)

• HooWWWer 1x detected

  Example user agent
  HooWWWer/2.1.0 ( http://cosco.hiit.fi/search/hoowwwer/ | mailto:crawler-info<at>hiit.fi)

• HRCrawler 1x detected

  Example user agent
  HRCrawler/2.0 (XF86; MacOS x86_64) AppleWebKit/537.31 (KHTML, like Gecko)

• ht://Dig 7x detected

  Example user agent
  htdig/3.1.6 (unconfigured@htdig.searchengine.maintainer)

• HTTP Kit 1x detected

  Example user agent
  http-kit/2.0

• HTTP Request 1x detected

  Example user agent
  raynette_httprequest/1.0

• HTTP Service 1x detected

  Example user agent
  HTTP Service

• http_requester 1x detected

  Example user agent
  http_requester/0.1

• httpclient 1x detected

  Example user agent
  HTTPClient/1.0 (2.4.0, ruby 1.9.3 (2013-06-27))

• HTTrack 1x detected

  Example user agent
  Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)

• HuaweiSymantecSpider 1x detected

  Example user agent
  HuaweiSymantecSpider/1.0 DSE-support@huaweisymantec.com (compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR ; http://www.huaweisymantec.com/cn/IRL/spider)

• HubPages Bot 1x detected

  Example user agent
  HubPages V0.2.2 (http://hubpages.com/help/crawlingpolicy)

• HubSpot Webcrawler 1x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.116 Safari/537.36 HubSpot Webcrawler

• HyperCrawl 1x detected

  Example user agent
  Mozilla/5.0 (compatible; HyperCrawl/0.2; +http://www.seograph.net/bot.html)

• i1searchbot 1x detected

  Example user agent
  i1searchbot/2.0 (i1search web crawler; http://www.i1search.com; crawler@i1search.com)

• IBM Connections 1x detected

  Example user agent
  IC OpenGraph Crawler 4.5 (proprietary)

• Icarus6j 1x detected

  Example user agent
  Icarus6j - (contact: phil@icarus6.com)

• ICC-Crawler 3x detected

  Example user agent
  ICC-Crawler/2.0 (Mozilla-compatible; ; http://www.nict.go.jp/en/univ-com/plan/crawl.html)

• Ichiro Bot 3x detected

  Example user agent
  ichiro/5.0 (http://help.goo.ne.jp/door/crawler.html)

• Ichiro Mobile Bot 3x detected

  Example user agent
  DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://search.goo.ne.jp/option/use/sub4/sub4-1/)

• IconSurf 1x detected

  Example user agent
  IconSurf/2.0 favicon finder (see http://iconsurf.com/robot.html)

• Iframely Bot 1x detected

  Example user agent
  Iframely/0.7.1 (+http://iframe.ly/;)

• IIS Site Analysis Web Crawler 1x detected

  Example user agent
  iisbot/1.0 (+http://www.iis.net/iisbot.html)

• Ilse 2x detected

  Example user agent
  INGRID/3.0 MT (webcrawler@NOSPAMexperimental.net; http://aanmelden.ilse.nl/?aanmeld_mode=webhints)

• ImplisenseBot 1x detected

  Example user agent
  ImplisenseBot 1.0

• InAGist URL Resolver 1x detected

  Example user agent
  InAGist URL Resolver (http://inagist.com)

• inbound.li link checker 1x detected

  Example user agent
  inboundli link checker

• inbound.li parser 1x detected

  Example user agent
  inbound.li parser

• Incoming Links - WordPress Plugin 1x detected

  Example user agent
  MonitorBacklinksWP (+http://monitorbacklinks.com/blog/incoming-links/)

• InfegyAtlas 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Linux; InfegyAtlas/1.0; en-US; collection@infegy.com)

• infoX-WISG 1x detected

  Example user agent
  infoX-WISG

• Instant Payment Notification 1x detected

  Example user agent
  PayPal IPN ( https://www.paypal.com/ipn )

• Integrity 1x detected

  Example user agent
  integrity/4

• Internet Archive 9x detected

  Example user agent
  InternetArchive/0.8-dev (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)

• Internet Archive Special Archiver 3x detected

  Example user agent
  Mozilla/5.0 (compatible; special_archiver/3.2.0 +http://www.loc.gov/webarchiving/notice_to_webmasters.html)

• InternetSeer.com 1x detected

  Example user agent
  InternetSeer.com

• IPv4Scan 1x detected

  Example user agent
  IPv4Scan (+http://ipv4scan.com)

• IRLbot 6x detected

  Example user agent
  IRLbot/2.0 ( http://irl.cs.tamu.edu/crawler)

• isc header collector handlers 1x detected

  Example user agent
  isc header collector handlers@isc.sans.edu

• IstellaBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; IstellaBot/1.18.81 +http://www.tiscali.it/)

• itsscan 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Muenster University of Applied Sciences; +http://fb02itsscan.fh-muenster.de)

• iZSearch Bot 1x detected

  Example user agent
  iZSearch.com

• Jakarta Commons HttpClient 1x detected

  Example user agent
  Jakarta Commons-HttpClient/3.0

• JamesBOT 1x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 - James BOT - WebCrawler http://cognitiveseo.com/bot.html

• Java Standard Library 19x detected

  Example user agent
  Java1.4.2_03

• Jayde Crawler 1x detected

  Example user agent
  Jayde Crawler. http://www.jayde.com

• Jeode 1x detected

  Example user agent
  Jeode/1.x.x

• jig browser web 20x detected

  Example user agent
  Mozilla/4.0 (jig browser web; 1.0.4; N02A)

• Jigsaw_W3C_CSS_Validator 1x detected

  Example user agent
  Jigsaw/2.3.0 W3C_CSS_Validator_JFouffa/2.0 (See <http://validator.w3.org/services>)

• JobBoerse Bot 1x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux Core i7-4980HQ; de; rv:32.0; compatible; Jobboerse.com; http://www.xn--jobbrse-d1a.com) Gecko/20100401 Firefox/24.0

• JobdiggerSpider 1x detected

  Example user agent
  Mozilla/5.0 (compatible; JobdiggerSpider +http://www.jobdigger.nl/spider)

• JobRoboter 1x detected

  Example user agent
  JobRoboter/1.1

• JoobleBot 1x detected

  Example user agent
  JoobleBot (compatible; http://jooble.org/jooble-bot)

• Jupdate 1x detected

  Example user agent
  jupdate

• JUST-CRAWLER 1x detected

  Example user agent
  JUST-CRAWLER( http://www.justsystems.com/jp/tech/crawler/)

• kgbody 1x detected

  Example user agent
  Mozilla/5.0 (compatible; kgbody/2.0; +http://kids.goo.ne.jp/tool/kgbody.php)

• KomodiaBot 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; Win64; x64) KomodiaBot/1.0

• Kraken 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Kraken/0.1; http://linkfluence.net/; bot@linkfluence.net)

• krakenjs 1x detected

  Example user agent
  kraken/0.6.0

• kulturarw3 1x detected

  Example user agent
  Mozilla/5.0 (compatible; kulturarw3 +http://www.kb.se/om/projekt/Svenska-webbsidor---Kulturarw3/)

• Larbin 5x detected

  Example user agent
  LarbinWebCrawler (internet@bredband.net)

• lbot 2x detected

  Example user agent
  Mozilla/5.0 (lbot/2.6.4) lbot@mailme.not

• Leadify Bot 1x detected

  Example user agent
  Leadify/1.01 Page Staleness Detector

• libcurl 1x detected

  Example user agent
  libcurl-agent/1.0

• libwww 29x detected

  Example user agent
  NCSA Mosaic/2.6b1 (X11;UNIX_System_V 4.2 R4000) libwww/2.12 modified

• Liferea 3x detected

  Example user agent
  Liferea/1.10-RC1 (Linux; en_GB.UTF-8; http://liferea.sf.net/)

• Lightspeed Systems Crawler 1x detected

  Example user agent
  Mozilla/4.0 (compatible; MSIE 7.0;Windows NT 5.1;.NET CLR 1.1.4322;.NET CLR 2.0.50727;.NET CLR 3.0.04506.30) Lightspeedsystems

• Lightspeed Systems RocketCrawler 1x detected

  Example user agent
  LSSRocketCrawler/1.0 LightspeedSystems

• Link Valet 1x detected

  Example user agent
  Link Valet Online 1.1

• link_thumbnailer 1x detected

  Example user agent
  Ruby, link_thumbnailer

• linkCheck 1x detected

  Example user agent
  Mozilla/5.0 (compatible; linkCheckV3.0)

• Linkdex Bot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; linkdexbot/2.0; +http://www.linkdex.com/about/bots/)

• LinkedInBot 3x detected

  Example user agent
  LinkedInBot/1.0 (compatible; Mozilla/5.0; Jakarta Commons-HttpClient/3.1 http://www.linkedin.com)

• LinkpadBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; LinkpadBot/1.06; +http://www.linkpad.ru)

• Links4US-Crawler 1x detected

  Example user agent
  Links4US-Crawler, ( http://links4us.com/)

• LinksCrawler 1x detected

  Example user agent
  LinksCrawler 0.1beta

• LinksManager 2x detected

  Example user agent
  Mozilla/5.0 (compatible; LinksManager.com_bot http://linksmanager.com/linkchecker.html)

• LinkStats Bot 1x detected

  Example user agent
  LinkStats Bot

• LinkWalker 1x detected

  Example user agent
  LinkWalker/2.0

• Lipperhey Kaus Australis 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Lipperhey-Kaus-Australis/5.0; +https://www.lipperhey.com/en/about/)

• Lipperhey SEO Service 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Lipperhey SEO Service; http://www.lipperhey.com/)

• Livelap Crawler 1x detected

  Example user agent
  LivelapBot/0.2 (http://site.livelap.com/crawler)

• LoadTimeBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; LoadTimeBot/0.9; +http://www.loadtime.net/bot.html)

• Locubot 1x detected

  Example user agent
  Locubot (compatible; Googlebot; msnbot)

• LongURL Bot 1x detected

  Example user agent
  LongURL API

• LOOQ 1x detected

  Example user agent
  LOOQ/0.1 alfa (LOOQ Crawler for european sites; http://looq.eu; root (at) looq dot eu)

• ltx71 Bot 1x detected

  Example user agent
  ltx71 - (http://ltx71.com/)

• Lucidworks Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; LucidWorks/; +; crawler at example dot com)

• lwp 6x detected

  Example user agent
  LWP LDMusicNews::LDNewsAPI

• Lycos 1x detected

  Example user agent
  Lycos_Spider_(modspider)

• m65bot 1x detected

  Example user agent
  DoCoMo/2.0 P904i( m65bot/0.1; c; http://m65.jp/bot.html )

• magpie-crawler 2x detected

  Example user agent
  magpie-crawler/1.1 (U; Linux amd64; en-GB; http://www.brandwatch.net)

• MagpieRSS 4x detected

  Example user agent
  MagpieRSS/0.72 (+http://magpierss.sf.net)

• Mail.Ru 4x detected

  Example user agent
  Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots; +http://go.mail.ru/help/robots)

• MailChimp.com 1x detected

  Example user agent
  MailChimp.com

• Marketing Grader 1x detected

  Example user agent
  HubSpot Marketing Grader

• MarketwireBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; MSIE 9.0; Windows NT; MarketwireBot +http://www.marketwire.com)

• masidani_bot 1x detected

  Example user agent
  masidani_bot_v0.3 (info@masidani.com)

• mbot 1x detected

  Example user agent
  mbot v.1.16

• meanpathbot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; meanpathbot/1.0; +http://www.meanpath.com/meanpathbot.html)

• MegaIndex Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +https://www.megaindex.ru/?tab=linkAnalyze)

• Melvil Bot 1x detected

  Example user agent
  Melvil/1.0

• Melvil Favicon Bot 1x detected

  Example user agent
  Melvil Favicon/1.0 (Favicon fetcher for Melvil)

• memoryBot 4x detected

  Example user agent
  Mozilla/5.0 (compatible; memorybot/1.20.207 +http://mignify.com/bot.html)

• MerchantCentricBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; MerchantCentricBot/1.0)

• MetaGeneratorCrawler 2x detected

  Example user agent
  MetaGeneratorCrawler/1.3.4 (www.metagenerator.info)

• metager2-verification-bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; metager2-verification-bot; +http://metager2.de/technology.php)

• MetaHeadersBot 1x detected

  Example user agent
  MetaHeadersBot (+http://www.metaheaders.com/bot.html)

• MetaInspector 1x detected

  Example user agent
  MetaInspector/3.0.0 (+https://github.com/jaimeiniesta/metainspector)

• MetaJobBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; MetaJobBot; http://www.metajob.at/crawler)

• MetaURI Bot 1x detected

  Example user agent
  MetaURI API/2.0 +metauri.com

• Microsoft Bing Mobile SocialStreams Bot 1x detected

  Example user agent
  Microsoft Bing Mobile SocialStreams Bot

• Microsoft CryptoAPI 2x detected

  Example user agent
  Microsoft-CryptoAPI/6.1

• Microsoft-WebDAV 1x detected

  Example user agent
  DavClnt

• Mignify Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; imrbot/1.10.8 +http://www.mignify.com)

• MixBot 1x detected

  Example user agent
  MixBot (+http://t.co/GSRLLKex24)

• MixrankBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; MixrankBot; crawler@mixrank.com)

• MJ12bot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; MJ12bot/v1.4.3; http://www.majestic12.co.uk/bot.php?+)

• MnoGoSearch 1x detected

  Example user agent
  MnoGoSearch/3.3.15

• MojeekBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; MojeekBot/0.6; http://www.mojeek.com/bot.html)

• MonkeyCrawl 1x detected

  Example user agent
  MonkeyCrawl/0.05 (MonkeyCrawl; http://www.monkeymethods.org; )

• MonoBot 1x detected

  Example user agent
  Mozilla/5.1 (compatible; MonoBot/1.0; +http://mono.name)

• Moozilla 1x detected

  Example user agent
  Moozilla

• Moreover 1x detected

  Example user agent
  Mozilla/5.0 Moreover/5.1 (+http://www.moreover.com; webmaster@moreover.com)

• MOSBookmarks Link Checker 1x detected

  Example user agent
  Mozilla/5.0 (compatible; MOSBookmarks/v2.6-Plus; Link Checker)

• Mozdex 1x detected

  Example user agent
  mozDex/0.05-dev (mozDex; http://www.mozdex.com/bot.html; spider@mozdex.com)

• Mozilla Crawler 1x detected

  Example user agent
  Mozilla crawl/5.0 (compatible; fairshare.cc +http://fairshare.cc)

• MQbot 1x detected

  Example user agent
  MQbot http://metaquerier.cs.uiuc.edu/crawler

• MS OPD 1x detected

  Example user agent
  Microsoft Office Protocol Discovery

• MSN 3x detected

  Example user agent
  msnbot/2.0 (+http://search.msn.com/msnbot.htm)

• msnbot 10x detected

  Example user agent
  MSNBOT/0.1 (http://search.msn.com/msnbot.htm)

• msnbot-media 5x detected

  Example user agent
  Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X; en-us) AppleWebKit/534+ (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 MsnBot-Media /1.0b

• msnbot-NewsBlogs 1x detected

  Example user agent
  msnbot-NewsBlogs/2.0b (+http://search.msn.com/msnbot.htm)

• MSR-ISRCCrawler 1x detected

  Example user agent
  MSR-ISRCCrawler

• MSRBOT 2x detected

  Example user agent
  MSRBOT (http://research.microsoft.com/research/sv/msrbot)

• n4p_bot 1x detected

  Example user agent
  n4p_bot (crawler@n4p.com)

• Nagios 2x detected

  Example user agent
  check_http/v2.0 (nagios-plugins 2.0)

• NameProtect 1x detected

  Example user agent
  abot/0.1 (abot; http://www.abot.com; abot@abot.com)

• NaverBot 12x detected

  Example user agent
  Yeti/1.1 (Naver Corp.; http://help.naver.com/robots/)

• nbot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; nbot/2.0)

• NerdyBot 1x detected

  Example user agent
  NerdyBot

• Netchart Adv Crawler 1x detected

  Example user agent
  Netchart Adv Crawler 1.0

• Netcraft Webserver Survey 1x detected

  Example user agent
  Mozilla/4.0 (compatible; Netcraft Web Server Survey)

• netEstate NE Crawler 2x detected

  Example user agent
  netEstate NE Crawler (+http://www.sengine.info/)

• NetLyzer FastProbe 1x detected

  Example user agent
  NetLyzer FastProbe

• NetNewsWire 4x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_2) AppleWebKit/537.74.9 (KHTML, like Gecko) Version/6.0 NetNewsWire/4.0.0

• NetSeer Crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; NetSeer crawler/2.0; +http://www.netseer.com/crawler.html; crawler@netseer.com)

• NetSurf 3x detected

  Example user agent
  NetSurf/2.0 (RISC OS; armv5l)

• Nett.io bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Nett.io bot/1.0; +http://nett.io/)

• Netvibes 2x detected

  Example user agent
  Netvibes (http://www.netvibes.com)

• NetzCheckBot 1x detected

  Example user agent
  NetzCheckBot/1.0 (security seal; private-krankenversicherung.de.netzcheck.com; bot@netzcheck.com)

• NewsBlur Favicon Fetcher 2x detected

  Example user agent
  NewsBlur Favicon Fetcher - 7 subscribers - http://www.newsblur.com/site/1948420/analytics-piwik (Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_1) AppleWebKit/534.48.3 (KHTML, like Gecko) Version/5.1 Safari/534.48.3)

• NewsBlur Feed Fetcher 2x detected

  Example user agent
  NewsBlur Feed Fetcher - 7 subscribers - http://www.newsblur.com/site/1948420/analytics-piwik (Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_1) AppleWebKit/534.48.3 (KHTML, like Gecko) Version/5.1 Safari/534.48.3)

• NewsGator 2x detected

  Example user agent
  NewsGator/2.0 Bot (http://www.newsgator.com)

• NewsGator FetchLinks 1x detected

  Example user agent
  NewsGator FetchLinks extension/0.2.0 (http://graemef.com)

• NewsGatorOnline 2x detected

  Example user agent
  NewsGatorOnline/2.0 (http://www.newsgator.com)

• newsme 1x detected

  Example user agent
  newsme/1.0; feedback@news.me

• newspaper 3x detected

  Example user agent
  newspaper/0.0.7

• NikiBot 1x detected

  Example user agent
  niki-bot

• nineconnections 1x detected

  Example user agent
  Kimengi/nineconnections.com

• NING 1x detected

  Example user agent
  NING/1.0

• node-fetch 1x detected

  Example user agent
  node-fetch/1.0 (+https://github.com/bitinn/node-fetch)

• Norbert the Spider 1x detected

  Example user agent
  Norbert the Spider(Burf.com)

• Northern Light Web Search 1x detected

  Example user agent
  Mozilla/5.0 (compatible; NLCrawler/2.0.15; Linux 2.6.3-7; i686; en_US)KHTML/3.4.89 (like Gecko)

• NoteTextView 1x detected

  Example user agent
  NoteTextView

• nuSearch 3x detected

  Example user agent
  nuSearch Spider <a href='http://www.nusearch.com'>www.nusearch.com</a> (compatible; MSIE 4.01; Windows NT)

• Nutch 26x detected

  Example user agent
  emBot-GalaBuzz/Nutch-1.0 (http://emining.jp/; em@galabuzz.jp)

• ObjectsSearch 1x detected

  Example user agent
  ObjectsSearch/0.2 (ObjectsSearch; http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com)

• oBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; oBot/2.3.1; http://filterdb.iss.net/crawler/)

• OffByOne 2x detected

  Example user agent
  Mozilla/4.7 (compatible; OffByOne; Windows 2000) Webster Pro V3.4

• Omea Reader 1x detected

  Example user agent
  JetBrains Omea Reader 2.2 (http://www.jetbrains.com/omea/reader/)

• online link validator 1x detected

  Example user agent
  online link validator (http://www.dead-links.com/)

• Open Vulnerability Assessment System 1x detected

  Example user agent
  Mozilla/4.75 [en] (X11, U; OpenVAS)

• open-webkit-sharp 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) OpenWebKitSharp

• OpenBSD ftp 1x detected

  Example user agent
  OpenBSD ftp

• OpenHoseBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; OpenHoseBot/2.1; +http://www.openhose.org/bot.html)

• OpenWebSpider 3x detected

  Example user agent
  OpenWebSpider/0.6 (http://www.openwebspider.org)

• OpmlViewer network fetcher 1x detected

  Example user agent
  OpmlViewer network fetcher version 1.0.0.0

• Optimizer Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Optimizer)

• optivo NetHelper 1x detected

  Example user agent
  optivo(R) NetHelper

• Orangebot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Orangebot/2.0; support.orangebot@orange.com)

• OWASP_SECRET_BROWSER 1x detected

  Example user agent
  OWASP_SECRET_BROWSER/3.0

• Owler Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Owler/0.4; +; )

• Page Analyzer 1x detected

  Example user agent
  Page Analyzer v4.0 ( http://www.ranks.nl/ )

• PageFreezer 1x detected

  Example user agent
  PageFreezer (pagefreezer crawler; http://pagefreezer.com/pagefreezer-crawler/; info@pagefreezer.com)

• PagePeeker Screenshot Maker 1x detected

  Example user agent
  Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/538.1 (KHTML, like Gecko) domain.com Safari/538.1

• PagesInventory Bot 3x detected

  Example user agent
  PagesInventory (robot http://www.pagesinvenotry.com)

• Paper.li Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; PaperLiBot/2.1; http://support.paper.li/entries/20023257-what-is-paper-li)

• Patwebbot 1x detected

  Example user agent
  Patwebbot (http://www.herz-power.de/technik.html)

• Pcore::HTTP::UA 1x detected

  Example user agent
  Mozilla/5.0 (compatible; U; Pcore-HTTP-UA/v0.12.4

• PDFBot 1x detected

  Example user agent
  PDFBot (crawler@pdfind.com)

• pdrlabs Bot 1x detected

  Example user agent
  Cloud mapping experiment. Contact research@pdrlabs.net

• PEAR HTTP_Request2 1x detected

  Example user agent
  HTTP_Request2/2.1.1 (http://pear.php.net/package/http_request2) PHP/5.3.10-1ubuntu3.6

• PEAR-PHP 1x detected

  Example user agent
  PEAR HTTP_Request class

• Pearltrees Bot 1x detected

  Example user agent
  Pearltrees

• PECL HTTP 1x detected

  Example user agent
  PECL::HTTP/1.7.4 (PHP/5.4.4)

• Peeplo Screenshot Bot 1x detected

  Example user agent
  Peeplo Screenshot Bot/0.20 ( abuse at peeplo dot_com )

• Pete-Spider 1x detected

  Example user agent
  Pete-Spider/1.1

• Phantom.js bot 1x detected

  Example user agent
  Phantom.js bot

• phantomas 1x detected

  Example user agent
  phantomas/1.8.0 (PhantomJS/1.9.8; linux x64)

• Photon 1x detected

  Example user agent
  Photon/1.0

• PHP 3x detected

  Example user agent
  PHP/5.2.13

• picmole Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible;picmole/1.0 +http://www.picmole.com)

• Picsearch Bot 3x detected

  Example user agent
  psbot/0.1 (+http://www.picsearch.com/bot.html)

• Pingdom 2x detected

  Example user agent
  Pingdom.com_bot_version_1.4_(http://www.pingdom.com)

• PiplBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; PiplBot; http://www.pipl.com/bot/)

• PlantyNet 1x detected

  Example user agent
  PlantyNet_WebRobot_V1.9 babo@plantynet.com

• PluckItCrawler 1x detected

  Example user agent
  PluckItCrawler/1.0 (compatible; Mozilla 4.0; MSIE 5.5; http://www.pluck.com;)

• Plus5Bot 1x detected

  Example user agent
  Mozilla/5.1 (compatible; +5Bot/1.0; +http://plus5files.net)

• pmoz.info ODP link checker 1x detected

  Example user agent
  Mozilla/5.0 (compatible; pmoz.info ODP link checker; +http://pmoz.info/doc/botinfo.htm)

• Pompos 1x detected

  Example user agent
  Pompos/1.2 http://pompos.iliad.fr

• Powermarks 1x detected

  Example user agent
  Mozilla/4.0 (compatible; Powermarks/3.5; Windows 95/98/2000/NT)

• Premium URL Shortener 1x detected

  Example user agent
  Premium URL Shortener 4.0

• Prlog 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Prlog/1.0; +http://prlog.ru/)

• profiller 1x detected

  Example user agent
  Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.21 (KHTML, like Gecko) profiller Safari/537.21

• ProspectB2B Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; ProspectB2B/2.0; http://prospectb2b.com)

• proximic 1x detected

  Example user agent
  Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php)

• Proxy Gear Pro 1x detected

  Example user agent
  Proxy Gear Pro/2.1 (Windows; N; Windows NT 6.1; en)

• pub-crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; pub-crawler; +http://wiki.github.com/bixo/bixo/bixocrawler; bixo-dev@yahoogroups.com)

• publiclibraryarchive Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; publiclibraryarchive.org/1.0; +crawl@publiclibraryarchive.org)

• PWBot 1x detected

  Example user agent
  Mozilla/5.1 (compatible; PWBot/1.0; +http://opendownload.pw)

• PycURL 1x detected

  Example user agent
  PycURL/7.22.0

• Python 1x detected

  Example user agent
  pythonic-crawler (suzuki@tkl.iis.u-tokyo.ac.jp)

• python-requests 6x detected

  Example user agent
  python-requests/2.2.1 CPython/2.7.3 Linux/3.2.0-56-generic

• Python-urllib 12x detected

  Example user agent
  Python-urllib/2.1

• Qualidator.com Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Qualidator.com Bot 1.0;)

• QuerySeekerSpider 1x detected

  Example user agent
  QuerySeekerSpider ( http://queryseeker.com/bot.html )

• QuickFinder 1x detected

  Example user agent
  QuickFinder Crawler

• QuickiWiki Bot 1x detected

  Example user agent
  QuickiWiki/1.0 (http://www.quickiwiki.com; admin@quickiwiki.com) BasedOnNodeJs/0.10.23

• Quora Link Preview Bot 1x detected

  Example user agent
  Quora Link Preview/1.0 (http://www.quora.com)

• Qwantify 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Qwantify/2.0; +https://www.qwant.com/)

• R6 CommentReader 1x detected

  Example user agent
  R6_CommentReader(www.radian6.com/crawler)

• R6 FeedFetcher 2x detected

  Example user agent
  R6_FeedFetcher_(www.radian6.com/crawler)

• RamblerMail Bot 1x detected

  Example user agent
  RamblerMail/6.0 (incompatible; ImageProxy/6.0)

• RankFlex 1x detected

  Example user agent
  RankFlex.com Webspider

• Raven Link Checker 1x detected

  Example user agent
  Raven Link Checker

• redbot 1x detected

  Example user agent
  RED/1 (http://redbot.org/)

• RedCarpet 2x detected

  Example user agent
  RedCarpet/2.1 CFNetwork/672.0.2 Darwin/14.0.0

• Reddit 1x detected

  Example user agent
  Mozilla/5.0 (compatible; redditbot/1.0; +http://www.reddit.com/feedback)

• reddit pic scraper 1x detected

  Example user agent
  Mozilla / reddit pic scraper v0.8 (bklug@tyx.net)

• REL Link Checker 1x detected

  Example user agent
  REL Link Checker Lite 1.0

• RemoteGet 1x detected

  Example user agent
  gpEasy RemoteGet

• Research Projects 1x detected

  Example user agent
  CMS crawler ( http://buytaert.net/crawler/)

• restify 1x detected

  Example user agent
  restify/2.6.3 (x64-darwin; v8/3.14.5.9; OpenSSL/1.0.1i) node/0.10.32

• Reverse IP Lookup 1x detected

  Example user agent
  Mozilla/5.0+(compatible; RevIP.info site analyzer v4.00; http://poweredby.revip.info)

• Riddler 2x detected

  Example user agent
  Riddler (http://riddler.io/about.html)

• Rippers 2x detected

  Example user agent
  Mozilla/3.01 (compatible;)

• Rival IQ Bot 1x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9) AppleWebKit/537.71 (KHTML, like Gecko) Version/7.0 Safari/537.71 (Rival IQ, rivaliq.com)

• RMSnapKit 1x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10) AppleWebKit/600.1.25 (KHTML, like Gecko) RMSnapKit/1.0

• Rogerbot 5x detected

  Example user agent
  rogerbot/1.0 (http://www.seomoz.org/dp/rogerbot, rogerbot-crawler@seomoz.org)

• ROR Sitemap Generator 1x detected

  Example user agent
  ROR Sitemap Generator (http://www.rorweb.com)

• RSS2HTML 1x detected

  Example user agent
  FeedForAll rss2html.php v2

• RssBandit 2x detected

  Example user agent
  RssBandit/1.9.0.1002

• RssBar 1x detected

  Example user agent
  RssBar/1.29 (RssBar for unDonut 1.35)

• RSSOwl 2x detected

  Example user agent
  RSSOwl/2.2.1.201312301316 (X11; U; en)

• Safari RSS 1x detected

  Example user agent
  AppleSyndication/56.1

• Safe-t.net Web Filtering Service 1x detected

  Example user agent
  FANGCrawl/0.01

• SafeSearch microdata crawler 1x detected

  Example user agent
  SafeSearch microdata crawler (https://safesearch.avira.com, safesearch-abuse@avira.com)

• Save n Keep Screenshot Bot 1x detected

  Example user agent
  SNK Screenshot Bot/0.20 ( abuse at savenkeep dot_com )

• ScollSpider 1x detected

  Example user agent
  ScollSpider/2.0 ( http://www.webwobot.com/ScollSpider.php)

• Scopia Crawler 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Scopia Crawler 1.2; +http://www.scopia.co)

• ScoutJet 1x detected

  Example user agent
  Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/)

• Scrapy 5x detected

  Example user agent
  Scrapy/1.0.3.post6+g2d688cd (+http://scrapy.org)

• Screaming Frog SEO Spider 6x detected

  Example user agent
  Screaming Frog SEO Spider/2,55

• ScreenerBot 1x detected

  Example user agent
  ScreenerBot Crawler Beta 2.0 (+http://www.ScreenerBot.com)

• Screenshot Bot 1x detected

  Example user agent
  pr-cy.ru Screenshot Bot

• Scrubby 6x detected

  Example user agent
  Mozilla/5.0 (compatible; Scrubby/3.2; +http://seotools.scrubtheweb.com/webpage-analyzer.html)

• Searchteq Bot 1x detected

  Example user agent
  stq_bot (+http://www.searchteq.de)

• Second Live Client 1x detected

  Example user agent
  Mozilla/5.0 (Windows; U; ; en-US) AppleWebKit/533.3 (KHTML, like Gecko) SecondLife/3.7.23.297296 (Second Life Release; default skin) Safari/533.3

• Second Live Commerce Client 1x detected

  Example user agent
  Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0 ; .NET CLR 2.0.50215; SL Commerce Client v1.0; Tablet PC 2.0

• Securepoint Content Filter 1x detected

  Example user agent
  securepoint cf

• SeeBot 1x detected

  Example user agent
  seebot/2.0 (+http://www.seegnify.com/bot)

• Semantic Discovery 2x detected

  Example user agent
  semanticdiscovery/2.0(http://www.semanticdiscovery.com/robot.html)

• semantic-visions.com crawler 1x detected

  Example user agent
  Mozilla/5.0 (X11; compatible; semantic-visions.com crawler; HTTPClient 3.1)

• SemanticBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; SemanticBot/1.1)

• SemrushBot 4x detected

  Example user agent
  Mozilla/5.0 (compatible; SemrushBot-SI/0.97; +http://www.semrush.com/bot.html)

• SEOdiver Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; SEOdiver/1.0; +http://www.seodiver.com/bot)

• SEOkicks Robot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; SEOkicks-Robot +http://www.seokicks.de/robot.html)

• SEOprofiler 2x detected

  Example user agent
  Mozilla/5.0 (compatible; spbot/4.0.9; +http://OpenLinkProfiler.org/bot )

• SEOstats 1x detected

  Example user agent
  SEOstats 2.1.0 https://github.com/eyecatchup/SEOstats

• SetLinks.ru Crawler 2x detected

  Example user agent
  Mozilla/5.0 (compatible; SetLinks bot 1.2)

• Seznam Screenshot Generator 2x detected

  Example user agent
  Mozilla/5.0 PhantomJS (compatible; Seznam screenshot-generator 2.1; +http://fulltext.sblog.cz/screenshot/)

• SeznamBot 4x detected

  Example user agent
  SeznamBot/3.0 (+http://fulltext.sblog.cz/)

• Shim Crawler 1x detected

  Example user agent
  Shim-Crawler

• ShopWiki 1x detected

  Example user agent
  ShopWiki/1.0 ( +http://www.shopwiki.com/wiki/Help:Bot)

• Short URL Checker 2x detected

  Example user agent
  GentleSource Short URL Checker ( http://www.gentlesource.com/ )

• ShortLinkTranslate 1x detected

  Example user agent
  ShortLinkTranslate

• ShowyouBot 1x detected

  Example user agent
  ShowyouBot (http://showyou.com/crawler)

• Shrook 2x detected

  Example user agent
  Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10) AppleWebKit/600.1.25 (KHTML, like Gecko) Shrook/1290y

• SimplePie 4x detected

  Example user agent
  SimplePie/1.2.1-dev (Feed Parser; http://simplepie.org; Allow like Gecko) Build/20130514092120

• Simpy 1x detected

  Example user agent
  Simpy/1.1 (Simpy; http://www.simpy.com/?ref=bot; feedback at simpy dot com)

• Sistrix Crawler 2x detected

  Example user agent
  Mozilla/5.0 (compatible; SISTRIX Crawler; http://crawler.sistrix.net/)

• SiteBar 2x detected

  Example user agent
  SiteBar/3.3.8 (Bookmark Server; http://sitebar.org/)

• SiteCon 2x detected

  Example user agent
  Mozilla/5.0 (Linux; U; en-gb) AppleWebKit/418.9.1 (KHTML, like Gecko) SiteCon/8.10.22

• SiteExplorer 2x detected

  Example user agent
  Mozilla/5.0 (compatible; SiteExplorer/1.0b; +http://siteexplorer.info/)

• Sitemap Generator 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Sitemap Generator/1.3; +http://www.check-domains.com/sitemap/index.php)

• SiteSell 1x detected

  Example user agent
  SBIder/0.8-dev (SBIder; http://www.sitesell.com/sbider.html; http://support.sitesell.com/contact-support.html)

• SkypeUriPreview 1x detected

  Example user agent
  Mozilla/5.0 (Windows NT 6.1; WOW64) SkypeUriPreview Preview/0.5

• Slackbot 1x detected

  Example user agent
  Slackbot (+https://api.slack.com/robots)

• Slackbot-Link-Expanding 2x detected

  Example user agent
  Slackbot-LinkExpanding (+https://api.slack.com/robots)

• Slinky 1x detected

  Example user agent
  Slinky v1.0 +http://dentedreality.com.au/projects/slinky/

• Smartsite HTTPClient 1x detected

  Example user agent
  Smartsite HTTPClient - Mozilla/4.0 (compatible; MSIE 6.0)

• SMRF URL Expander 1x detected

  Example user agent
  SMRF URL Expander

• SMTBot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; SMTBot/1.0; +http://www.similartech.com/smtbot)

• Socialradar Bot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Linux; Socialradarbot/2.0; en-US; bot@infegy.com)

• SocialSpider-Finder 1x detected

  Example user agent
  SocialSpider-Finder/0.2

• SoftListBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; SoftListBot/2.2; +http://www.softlist.us/)

• SoftMaker Fetch 1x detected

  Example user agent
  SoftMaker Fetch/1.0

• Sogou Develop Spider 1x detected

  Example user agent
  Sogou develop spider/4.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• Sogou Head Spider 1x detected

  Example user agent
  Sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• Sogou Image Crawler 3x detected

  Example user agent
  Sogou Pic Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm

• Sogou Orion spider 1x detected

  Example user agent
  Sogou Orion spider/4.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• Sogou Push Spider 1x detected

  Example user agent
  Sogou Push Spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• Sogou Spider 2x detected

  Example user agent
  New-Sogou-Spider/1.0 (compatible; MSIE 5.5; Windows 98)

• Sogou Web Spider 3x detected

  Example user agent
  Sogou web spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• Sogou-Test-Spider 1x detected

  Example user agent
  Sogou-Test-Spider/4.0 (compatible; MSIE 5.5; Windows 98)

• Sophora Linkchecker 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Sophora Linkchecker; http://www.subshell.com)

• SophosAgent 1x detected

  Example user agent
  SophosAgent/1.0 (type= spa )

• SophosUpdateManager 1x detected

  Example user agent
  SophosUpdateManager/1.5.7.50 SDDS/2.0 (u= EO2ANA123G c= 6342da15-f351-4ab7-9656-3f5f2d50885d )

• Sosospider 2x detected

  Example user agent
  Sosospider+(+http://help.soso.com/webspider.htm)

• SPDYCheck SPDY Protocol Tester 1x detected

  Example user agent
  SPDYCheck SPDY Protocol Tester, see http://spdycheck.org/about.html

• Spiderlytics 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Spiderlytics/1.0; +spider@spiderlytics.com)

• Spinn3r RSS Aggregator 1x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/2010040121 Firefox/3.0.19

• SPIP 1x detected

  Example user agent
  SPIP-3.0.20 (http://www.spip.net)

• Sprinklr 1x detected

  Example user agent
  Sprinklr 2.0

• Sproose 1x detected

  Example user agent
  sproose/1.0beta (sproose bot; http://www.sproose.com/bot.html; crawler@sproose.com)

• Squid 3x detected

  Example user agent
  BREW-Applet/0x20068888 (BREW/3.1.5.20; DeviceId: 90086; Lang: zhcn) ucweb-squid

• Squzer 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Squzer/0.0.1; +http://www.declum.com/)

• sReleaseBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; sReleaseBot/6.1; +http://www.srelease.com/)

• sSearch Crawler 1x detected

  Example user agent
  ssearch_bot (sSearch Crawler; http://www.semantissimo.de)

• Steeler 3x detected

  Example user agent
  Steeler/1.3 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/)

• Stratagems Kumo 1x detected

  Example user agent
  Stratagems Kumo

• superagent 1x detected

  Example user agent
  node-superagent/1.4.0

• Superarama.com - BOT 1x detected

  Example user agent
  Superarama.com - BOT/v.0.1

• Superfeedr Bot 2x detected

  Example user agent
  Superfeedr bot/2.0 http://superfeedr.com - Make your feeds realtime: get in touch

• SurveyBot 1x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.9.0.13) Gecko/2009073022 Firefox/3.5.2 (.NET CLR 3.5.30729) SurveyBot/2.3 (DomainTools)

• Svven Summarizer Bot 1x detected

  Example user agent
  Svven-Summarizer

• Swiss Search Engine 1x detected

  Example user agent
  search.ch/2.8 Android/4.0.3; htc_europe:HTC One V; Mozilla/5.0 (Linux; U; Android-universal)

• Symfony RSS reader 1x detected

  Example user agent
  sfFeedReader/0.9

• SynHttpClient 1x detected

  Example user agent
  SynHttpClient-Built/5759

• T-Online Browser 1x detected

  Example user agent
  T-Online Browser

• Taproot Bot 1x detected

  Example user agent
  Taproot (Guzzle) http://taprootproject.com

• Teoma 3x detected

  Example user agent
  Mozilla/2.0 (compatible; Ask Jeeves/Teoma)

• test certificate info 1x detected

  Example user agent
  test certificate info

• TestCrawler 8x detected

  Example user agent
  WEBB Crawler - see: http://badcheese.com/robots.html

• Texis Webscript 1x detected

  Example user agent
  Mozilla/4.0 (compatible; T-H-U-N-D-E-R-S-T-O-N-E)

• The Old Reader 1x detected

  Example user agent
  Mozilla/5.0 (compatible; theoldreader.com; 1 subscribers; feed-id=51413de5bd9279ea5002d75b)

• Theme Spider 1x detected

  Example user agent
  Theme Spider ( http://www.themespider.com/spider.html)

• ThumbnailAgent 1x detected

  Example user agent
  ThumbnailAgent

• Thumbor 1x detected

  Example user agent
  Thumbor/3.14.6

• thumbshots-de-bot 1x detected

  Example user agent
  thumbshots-de-bot (+http://www.thumbshots.de/)

• ThumbShotsBot 1x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux x86_64; de-DE; rv:1.9.0.19) Gecko/2010091808 ThumbShotsBot (KFSW 3.0.6-3)

• ThumbSniper 1x detected

  Example user agent
  ThumbSniper (http://thumbsniper.com)

• TinEye Bot 3x detected

  Example user agent
  TinEye-bot/0.02 (see http://www.tineye.com/crawler.html)

• Tiny Tiny RSS 2x detected

  Example user agent
  Tiny Tiny RSS/1.10 (http://tt-rss.org/)

• TLSProber 1x detected

  Example user agent
  TLSProber/0.8

• Traackr 1x detected

  Example user agent
  Traackr.com

• TrendWinHttp 1x detected

  Example user agent
  TrendWinHttp/

• Trove Bot 1x detected

  Example user agent
  Trove (help@trove.com, http://www.trove.com)

• TURLValidator 1x detected

  Example user agent
  Mozilla/4.0 (compatible; TURLValidator/1.0)

• TurnitinBot 2x detected

  Example user agent
  TurnitinBot/1.5 (http://www.turnitin.com/robot/crawlerinfo.html)

• Tutorial Crawler 1x detected

  Example user agent
  Tutorial Crawler 1.4

• TweetedTimes Bot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; TweetedTimes Bot/1.0; +http://tweetedtimes.com)

• Tweetmeme Bot 3x detected

  Example user agent
  Mozilla/5.0 (compatible; TweetmemeBot/2.11; +http://tweetmeme.com/)

• Tweetminster Bot 1x detected

  Example user agent
  Mozilla/5.0 Tweetminster

• Twikle Bot 1x detected

  Example user agent
  Twikle/1.0 , http://twikle.com , contact@twikle.com

• Twingly Recon 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Twingly Recon; twingly.com)

• Twisted PageGetter 1x detected

  Example user agent
  Twisted PageGetter

• Twitterbot 1x detected

  Example user agent
  Twitterbot/1.0

• Typhoeus 1x detected

  Example user agent
  Typhoeus - https://github.com/typhoeus/typhoeus

• TYPO3 Linkvalidator 1x detected

  Example user agent
  Mozilla/5.0 TYPO3-linkvalidator

• Uipbot 1x detected

  Example user agent
  uipbot/1.0 (uipbot@semasio.net)

• uMBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; uMBot-LN/1.0; mailto: crawling@ubermetrics-technologies.com)

• UnisterBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; UnisterBot; crawler@unister.de)

• Unity Web Player 1x detected

  Example user agent
  UnityPlayer/4.3.2f1 (http://unity3d.com)

• Univention Corporate Server 1x detected

  Example user agent
  UCS (ESX) - 4.0-3 errata302 - 28d414cc-2dac-4c0e-a34a-734020b8af66 - 00000000-0000-0000-0000-000000000000 -

• UniversalFeedParser 1x detected

  Example user agent
  UniversalFeedParser/5.1.3 +https://code.google.com/p/feedparser/

• Updated! 1x detected

  Example user agent
  updated/0.1-alpha (updated crawler; http://www.updated.com; crawler@updated.com)

• URL Grabber 2x detected

  Example user agent
  urlgrabber/3.9.1 yum/3.2.29

• URLAppendBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; URLAppendBot/1.0; +http://www.profound.net/urlappendbot.html)

• URLChecker 1x detected

  Example user agent
  URLChecker

• URLfilterDB Crawler 1x detected

  Example user agent
  Mozilla/5.0 (URLfilterDB-crawler/1.1) ufdb/1.0

• UserAgent Bot 1x detected

  Example user agent
  UserAgent/1.0

• USyd-NLP-Spider 1x detected

  Example user agent
  USyd-NLP-Spider (http://www.it.usyd.edu.au/~vinci/bot.html)

• Vagabondo 7x detected

  Example user agent
  Mozilla/4.0 (compatible; Vagabondo/2.3; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)

• Validator.nu/LV 1x detected

  Example user agent
  Validator.nu/LV http://validator.w3.org/services

• vBulletin Bot 1x detected

  Example user agent
  vBulletin via PHP

• vBulletin SEO Bot 1x detected

  Example user agent
  Mozilla/4.0 (vBSEO; http://www.vbseo.com)

• Veooz Bot 1x detected

  Example user agent
  Mozilla/5.0 ( compatible ; Veooz/1.0 ; +http://www.veooz.com/veoozbot.html )

• Vinti 1x detected

  Example user agent
  Vinti/0.1

• viralvideochart Bot 1x detected

  Example user agent
  viralvideochart.unrulymedia.com

• Virtuoso 1x detected

  Example user agent
  Mozilla/4.0 (compatible; Virtuoso)

• visionutils 1x detected

  Example user agent
  visionutils/0.2

• vkShare 1x detected

  Example user agent
  Mozilla/5.0 (compatible; vkShare; +http://vk.com/dev/Share)

• VoilaBot 3x detected

  Example user agent
  Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com)

• Voyager Bot 2x detected

  Example user agent
  voyager/1.0

• VSE Link Tester 2x detected

  Example user agent
  VSE/1.0 (testcrawler@hotmail.com)

• vSentry 1x detected

  Example user agent
  Mozilla/5.0 (Windows; chromeframe/2.4.8.5746) AppleWebKit/1.0 (KHTML, like Gecko) Bromium Safari/1.0

• W3C I18n Checker 1x detected

  Example user agent
  W3C_I18n-Checker/1.0 (http://validator.w3.org/services)

• W3C Unicorn 1x detected

  Example user agent
  W3C_Unicorn/1.0 (http://validator.w3.org/services)

• W3C_Validator 2x detected

  Example user agent
  W3C_Validator/1.767

• W3C-checklink 2x detected

  Example user agent
  W3C-checklink/4.81 libwww-perl/5.836

• W3C-mobileOK/DDC 1x detected

  Example user agent
  W3C-mobileOK/DDC-1.0 (see http://www.w3.org/2006/07/mobileok-ddc)

• Wada.vn Search Bot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; Wada.vn Vietnamese Image Search)

• WASALive Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; WASALive-Bot ; http://blog.wasalive.com/wasalive-bots/)

• Wayback Archive Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; waybackarchive.org/1.0; +spider@waybackarchive.org)

• WBSearchBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)

• WbSrch Web Search 1x detected

  Example user agent
  Mozilla/5.0 (compatible; WbSrch/1.1 +http://wbsrch.com)

• WDG HTML Validator 1x detected

  Example user agent
  WDG_Validator/1.6.5

• Web Glance 2x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux; C -) AppleWebKit/527+ (KHTML, like Gecko, Safari/419.3) Webglance/0.1

• WEB.DE MailCheck 1x detected

  Example user agent
  WEB.DE MailCheck/2.4.0

• WebAlta Crawler 2x detected

  Example user agent
  WebAlta Crawler/1.3.18 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU)

• Webbot.ru 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Webbot/0.1; http://www.webbot.ru/bot.html)

• webceo Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; online-webceo-bot/1.0; +http://online.webceo.com)

• WebClient 1x detected

  Example user agent
  WebClient/1.0

• WebCorp 1x detected

  Example user agent
  Mozilla/5.0 (compatible; WebCorp/5.0; +http://www.webcorp.org.uk)

• WEBDAV Client 1x detected

  Example user agent
  WEBDAV Client

• WebFuck 1x detected

  Example user agent
  WebFuck V2.1 T0PHackTeam www.t0p.xyz

• WebIndex 1x detected

  Example user agent
  WebIndex

• Webmaster Tips Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; wmtips.com/1.0; +http://www.wmtips.com/tools/)

• WebMasterAid 1x detected

  Example user agent
  Mozilla/5.0 (compatible; WebMasterAid/1.0; +http://wmaid.com/explore/)

• WebmasterCoffee 1x detected

  Example user agent
  Mozilla/5.0 (compatible; WebmasterCoffee/0.7; +http://webmastercoffee.com/about)

• webnumbr Fetcher 1x detected

  Example user agent
  webnumbrFetcher/1.0 (http://webnumbr.com/)

• WebRingChecker 1x detected

  Example user agent
  WebRingChecker/1.71 LWP/5.79

• Websense 1x detected

  Example user agent
  Sqworm/2.9.85-BETA (beta_release; 20011115-775; i686-pc-linux-gnu)

• Website Explorer 1x detected

  Example user agent
  Website Explorer/0.9.9.9

• Website Thumbnail Generator 3x detected

  Example user agent
  Mozilla/5.0 (compatible; WebThumbnail/2.2; Website Thumbnail Generat

• websitepulse checker 1x detected

  Example user agent
  websitepulse checker/1.1 (compatible; MSIE 5.5; Netscape 4.75; Linux)

• WebTarantula 1x detected

  Example user agent
  WebTarantula.com Crawler

• WebThumb 1x detected

  Example user agent
  Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.9.2.19) Gecko WebThumb/1.0

• WebZIP 1x detected

  Example user agent
  WebZIP/7.0 (http://www.spidersoft.com)

• Werbefreie Deutsche Suchmaschine 2x detected

  Example user agent
  Mozilla/5.0 (compatible; DeuSu/0.1.0; +https://deusu.de/robot.html)

• WeSEE Bot 2x detected

  Example user agent
  WeSEE

• WeSEE:Ads 1x detected

  Example user agent
  WeSEE:Ads/PageBot (http://www.wesee.com/bot/)

• WeSEE:Search 2x detected

  Example user agent
  WeSEE:Search/0.1 (Alpha, http://www.wesee.com/en/support/bot/)

• wget 9x detected

  Example user agent
  Wget/1.16.1 (darwin14.0.0)

• WhatWeb Web Scanner 2x detected

  Example user agent
  WhatWeb/0.4.8

• WI Job Roboter 1x detected

  Example user agent
  Mozilla/5.0 (compatible;WI Job Roboter Spider Version 3;+http://www.webintegration.at)

• Willow Internet Crawler 1x detected

  Example user agent
  Willow Internet Crawler by Twotrees V2.1

• Windmaker Bot 1x detected

  Example user agent
  Stewdio Windmaker 2.2

• Windows Phone Search 3x detected

  Example user agent
  Windows Phone Search (Windows Phone OS 8.0;NOKIA;Lumia 1520;8.0;10521)

• Windows-RSS-Platform 2x detected

  Example user agent
  Windows-RSS-Platform/2.0 (MSIE 9.0; Windows NT 6.0)

• Windows-Update-Agent 2x detected

  Example user agent
  Windows-Update-Agent/7.9.9600.17729 Client-Protocol/1.21

• WinHttp 2x detected

  Example user agent
  WinHTTP

• WinkBot 1x detected

  Example user agent
  WinkBot/0.06 (Wink.com search engine web crawler; http://www.wink.com/Wink:WinkBot; winkbot@wink.com)

• WIRE 1x detected

  Example user agent
  WIRE/1.0 (Linux;i686;Bot,Robot,Spider,Crawler)

• WiseNut search engine crawler 8x detected

  Example user agent
  Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.zyborg@looksmart.net; http://www.WISEnutbot.com)

• WNMbot 1x detected

  Example user agent
  WNMbot/0.4.0

• wonderbot 1x detected

  Example user agent
  wonderbot/JS 1.0

• WooRank 2x detected

  Example user agent
  woobot/2.0

• WordPress 15x detected

  Example user agent
  WordPress.com; http://fleurdelyz.com

• woriobot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; woriobot +http://worio.com)

• WorldLingo 1x detected

  Example user agent
  WebIndexer/1-dev (Web Indexer; mailto://webindexerv1@yahoo.com; webindexerv1@yahoo.com)

• worldwebheritage.org Bot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; worldwebheritage.org/1.0; +crawl@worldwebheritage.org)

• Wotbox 3x detected

  Example user agent
  Wotbox/2.01 (+http://www.wotbox.com/bot/)

• WSCheck Bot 1x detected

  Example user agent
  wscheck.com/1.0.0 (+http://wscheck.com/)

• wsr-agent 1x detected

  Example user agent
  wsr-agent/1.0

• WWW-Mechanize 1x detected

  Example user agent
  WWW-Mechanize/1.64

• Xaldon WebSpider 1x detected

  Example user agent
  Xaldon WebSpider 2.7.b6

• Xenus Link Sleuth 12x detected

  Example user agent
  Xenu Link Sleuth/1.3.7

• Xerka 1x detected

  Example user agent
  Xerka WebBot v1.0.0 [AIDO_CREA_ab]

• XING Contenttabreceiver 1x detected

  Example user agent
  XING-contenttabreceiver/2.0

• XML Sitemaps Generator 2x detected

  Example user agent
  Mozilla/5.0 (compatible; XML Sitemaps Generator; https://www.xml-sitemaps.com) Gecko XML-Sitemaps/1.0

• XmlSitemapGenerator 2x detected

  Example user agent
  XmlSitemapGenerator - http://xmlsitemapgenerator.org

• XoviBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)

• XSpider 1x detected

  Example user agent
  XSpider 0.01;http://uncool.oicp.net/spider.html

• Xyleme 1x detected

  Example user agent
  cosmos/0.9_(robot@xyleme.com)

• Y!J-AGENT 9x detected

  Example user agent
  Y!J-BRJ/YATS crawler (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)

• YaCy Bot 2x detected

  Example user agent
  yacybot (freeworld/global; x86 Windows XP 5.1; java 1.7.0_21; GMT+04:00/ru) http://yacy.net/bot.html

• Yahoo Ad Monitoring 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html)

• Yahoo Link Preview 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Yahoo Link Preview; https://help.yahoo.com/kb/mail/yahoo-link-preview-SLN23615.html)

• Yahoo Mobile App 2x detected

  Example user agent
  YahooMobile/1.0 (Yahoo! Search; 3.1.2) (Apple; iPod touch; iPhone OS/7.1.1); YHOO_Search_App/3.1.2

• Yahoo Pipes 1x detected

  Example user agent
  Yahoo Pipes 2.0

• Yahoo Slingstone 1x detected

  Example user agent
  Yahoo:LinkExpander:Slingstone

• Yahoo-MMCrawler 2x detected

  Example user agent
  Mozilla/5.0 (Yahoo-MMCrawler/4.0; mailto:vertical-crawl-support@yahoo-inc.com)

• Yahoo-Test 2x detected

  Example user agent
  Mozilla/5.0 (Yahoo-Test/4.0 ysm-keystone-crawl-support@yahoo-inc.com)

• Yahoo! Slurp 7x detected

  Example user agent
  Mozilla/3.0 (Slurp.so/1.0; slurp@inktomi.com; http://www.inktomi.com/slurp.html)

• Yahoo! Slurp China 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)

• YahooCacheSystem 2x detected

  Example user agent
  YahooCacheSystem; YahooWebServiceClient

• YahooSeeker 1x detected

  Example user agent
  YahooSeeker/1.0 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/shop/merchant/)

• YahooSeeker-Mobile 1x detected

  Example user agent
  LG-C1500 UP.Browser/6.2.3 (GUI) MMP/1.0 (compatible;YahooSeeker/M1A1-R2D2; http://help.yahoo.com/help/us/ysearch/crawling/crawling-01.html)

• YandexBlogs 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexBlogs/0.99; robot; B; +http://yandex.com/bots)

• YandexBot 2x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots),gzip(gfe) AppEngine-Google; (+http://code.google.com/appengine; appid: twitter-mirror),gzip(gfe),gzip(gfe),gzip(gfe)

• YandexDirect-Dyatel 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexDirect/3.0; +http://yandex.com/bots)

• YandexFavicons 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexFavicons/1.0; +http://yandex.com/bots)

• YandexImageResizer 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexImageResizer/2.0; +http://yandex.com/bots)

• YandexImages 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)

• YandexMetrika 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexMetrika/2.0; +http://yandex.com/bots)

• YandexNews 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YandexNews/3.0; +http://yandex.com/bots)

• YellowPages 1x detected

  Example user agent
  yp-crawl@attinteractive.com

• YioopBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YioopBot; +http://173.13.143.74/bot.php)

• YisouSpider 1x detected

  Example user agent
  YisouSpider

• YodaoBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )

• YodaoBot-Image 1x detected

  Example user agent
  Mozilla/5.0 (compatible;YodaoBot-Image/1.0;http://www.youdao.com/help/webmaster/spider/;)

• yoozBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; yoozBot-2.2; http://yooz.ir; info@yooz.ir)

• YoudaoBot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )

• YOURLS 35x detected

  Example user agent
  YOURLS v1.7 +http://yourls.org/ (running on http://shortr.at)

• YRL_ODP_CRAWLER 1x detected

  Example user agent
  YRL_ODP_CRAWLER

• Zao 1x detected

  Example user agent
  Zao/0.1 (http://www.kototoi.org/zao/)

• Zao-Crawler 1x detected

  Example user agent
  Zao-Crawler

• ZE.bz 1x detected

  Example user agent
  ZeBot_www.ze.bz (ze.bz@hotmail.com)

• Zend_Http_Client 1x detected

  Example user agent
  Zend_Http_Client

• Zeus 1x detected

  Example user agent
  Zeusbot/0.8.1 (Ulysseek's web-crawling robot; http://www.zeusbot.com; agent@zeusbot.com)

• ZIBB Crawler 1x detected

  Example user agent
  ZIBB Crawler (email address / WWW address)

• zitebot 1x detected

  Example user agent
  Mozilla/5.0 (compatible; zitebot support [at] zite [dot] com +http://zite.com)

• ZmEu 1x detected

  Example user agent
  ZmEu

• ZnajdzFoto/ImageBot 1x detected

  Example user agent
  ZnajdzFoto/Image 2.0

• Zollard Worm 1x detected

  Example user agent
  Mozilla/5.0 (compatible; Zollard; Linux)

• Zookabot 2x detected

  Example user agent
  Zookabot/2.4; +http://zookabot.com

• ZumBot 2x detected

  Example user agent
  ZumBot/1.0 (ZUM Search; http://help.zum.com/inquiry)

About this comparison