Detected as bot - UserAgentStringCom

• Googlebot

  Example user agent
  Googlebot-richsnippets

• Googlebot

  Example user agent
  KDDI-CA34 UP.Browser/6.2.0.10.2.2(GUI)MMP/2.0 (compatible; KDDI-Googlebot-Mobile/2.1; http://www.google.com/bot.html)

• DataparkSearch

  Example user agent
  DataparkSearch/4.35-02122005 ( http://www.dataparksearch.org/)

• Java

  Example user agent
  Mozilla/5.0 (LG-T530-Orange/V10b AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• NewsGator

  Example user agent
  NewsGator/2.0 Bot (http://www.newsgator.com)

• Teoma

  Example user agent
  Inne: Mozilla/2.0 (compatible; Ask Jeeves/Teoma; http://sp.ask.com/docs/about/tech_crawling.html)

• sogou spider

  Example user agent
  Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

• Ezooms

  Example user agent
  Mozilla/5.0 (compatible; Ezooms/1.0; help@moz.com)

• msnbot

  Example user agent
  msnbot/1.1 ( http://search.msn.com/msnbot.htm)

• Java

  Example user agent
  Huawei/1.0/0HuaweiU3311/B100 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• Java

  Example user agent
  ICE Browser/5.05 (Java 1.4.0; Windows 2000 5.0 x86)

• Baiduspider

  Example user agent
  Mozilla/5.0 (compatible; Baiduspider-cpro; +http://www.baidu.com/search/spider.html)

• YodaoBot

  Example user agent
  Mozilla/5.0 (compatible;YodaoBot-Image/1.0;http://www.youdao.com/help/webmaster/spider/;)

• Nusearch Spider

  Example user agent
  Nusearch Spider (compatible; MSIE 6.0)

• Vagabondo

  Example user agent
  Mozilla/4.0 (compatible; Vagabondo/4.0Beta; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)

• Googlebot

  Example user agent
  Googlebot/2.1 (+http://www.google.com/bot.html)

• NewsGator

  Example user agent
  NewsGatorOnline/2.0 (http://www.newsgator.com)

• Sosospider

  Example user agent
  Mozilla/5.0 (compatible; Sosospider/2.0; +http://help.soso.com/webspider.htm)

• Java

  Example user agent
  LG-A310-Orange/V10c Obigo/Q7.3 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• NetSeer Crawler

  Example user agent
  Mozilla/5.0 (compatible; NetSeer crawler/2.0; +http://www.netseer.com/crawler.html; crawler@netseer.com)

• msnbot

  Example user agent
  msnbot/2.0b v1394720947.6703

• FeedFetcher-Google

  Example user agent
  Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; 2 subscribers; feed-id=17860707833818568603)

• Googlebot

  Example user agent
  Googlebot-Video/1.0

• Java

  Example user agent
  IE6.0,Java(TM) 2 Runtime Environment, Standard Edition

• DotBot

  Example user agent
  dotbot

• Vagabondo

  Example user agent
  Mozilla/4.0 (compatible; Vagabondo/2.3; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)

• Java

  Example user agent
  LG-GU285g Browser/Obigo-Q7.3 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuratbile-video=d6sdv39lierm72vfe4ucsfjo61

• YoudaoBot

  Example user agent
  Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )

• AddSugarSpiderBot

  Example user agent
  Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0) AddSugarSpiderBot www.idealobserver.com

• NewsGator

  Example user agent
  NewsGatorOnline/2.0 (http://www.newsgator.com; 2 subscribers)

• Baiduspider

  Example user agent
  Baiduspider

• thumbshots-de-bot

  Example user agent
  thumbshots-de-bot (+http://www.thumbshots.de/)

• ZyBorg

  Example user agent
  Mozilla/4.0 compatible ZyBorg/1.0 (ZyBorg@WISEnutbot.com; http://www.WISEnutbot.com)

• ZyBorg

  Example user agent
  Mozilla/4.0 compatible ZyBorg/1.0

• Java

  Example user agent
  HUAWEI-U2800/001.00 Browser/Obigo-Browser/Q05A MMS/UNIBOX/V1.2 HuaweiJava/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1

• W3C-checklink

  Example user agent
  W3C-checklink/4.81 libwww-perl/5.836

• sogou spider

  Example user agent
  Sogou Mobile Spider1.0 (http://wap.sogou.com)

• DotBot

  Example user agent
  Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org)

• HuaweiSymantecSpider

  Example user agent
  Huaweisymantecspider (compatible; MSIE 8.0; DSE-support@huaweisymantec.com)

• IssueCrawler

  Example user agent
  IssueCrawler

• UniversalFeedParser

  Example user agent
  UniversalFeedParser/5.1.3 +https://code.google.com/p/feedparser/

• Java

  Example user agent
  Mozilla/5.0 (LG-T565 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Sosospider

  Example user agent
  Sosospider+(+help.soso.com/webspider.htm)

• Java

  Example user agent
  SmartAndSimpleWebCrawler/1.3 (https://crawler.dev.java.net),gzip(gfe),gzip(gfe)

• Baiduspider

  Example user agent
  Baiduspider+(+http://www.baidu.com/search/spider.htm)

• msnbot

  Example user agent
  msnbot-NewsBlogs/2.0b (+http://search.msn.com/msnbot.htm)

• Googlebot

  Example user agent
  Googlebot/2.1 (http://www.googlebot.com/bot.html)

• Java

  Example user agent
  Apache-HttpClient/UNAVAILABLE (java 1.4)

• MQBOT

  Example user agent
  MQbot http://metaquerier.cs.uiuc.edu/crawler

• msnbot

  Example user agent
  msnbot/2.0 (+http://search.msn.com/msnbot.htm)

• Java

  Example user agent
  Huawei/1.0/0HuaweiU1310/B123 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• Baiduspider

  Example user agent
  baiduspider-mobile-gate

• Xenu Link Sleuth

  Example user agent
  Xenu Link Sleuth 1.1f

• yrspider

  Example user agent
  Mozilla/5.0 (compatible; YRSpider; +http://www.yunrang.com/yrspider.html)

• Googlebot

  Example user agent
  Googlebot/2.1 ( http://www.googlebot.com/bot.html)

• Yahoo! Slurp

  Example user agent
  Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)

• GSiteCrawler

  Example user agent
  GSiteCrawler/v1.12 rev. 260 (http://gsitecrawler.com/)

• Java

  Example user agent
  Mozilla/5.0 (LG-T505 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/A

• Googlebot

  Example user agent
  Googlebot/2.1 (+http://www.googlebot.com/bot.html)

• Java

  Example user agent
  Huawei/1.0/0HuaweiU5900/B000 Browser/Obigo-Browser/Q05A HUAWEI-U5900 HuaweiJava/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1

• Googlebot

  Example user agent
  Mozilla/5.0 (Windows; Mozilla 4.0(compatible; Googlebot/5.0; http://www.google.com/googlebot); en-US;)

• Java

  Example user agent
  Mozilla/5.0 (LG-C195 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• LDSpider

  Example user agent
  ldspider (BTC 2011 crawl, harth@kit.edu, http://code.google.com/p/ldspider/wiki/Robots)

• Java

  Example user agent
  Mozilla/5.0 (LG-T395 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Java

  Example user agent
  LG/KC910i/V10a Browser/Obigo-Q7.1 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• YahooSeeker

  Example user agent
  YahooSeeker/1.0 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/shop/merchant/)

• yrspider

  Example user agent
  yrspider (Mozilla/5.0 (compatible; YRSpider; http://www.yunrang.com/yrspider.html))

• Java

  Example user agent
  Mozilla/5.0 (LG-C510 AppleWebKit/531 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1),gzip(gfe),gzip(gfe)

• Baiduspider

  Example user agent
  Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search

• Yahoo! Slurp

  Example user agent
  Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)

• Java

  Example user agent
  HuaweiU1250/B002 Browser/Access-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• Gigabot

  Example user agent
  Gigabot/3.0 (http://www.gigablast.com/spider.html)

• ichiro

  Example user agent
  DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo;+http://search.goo.ne.jp/option/use/sub4/sub4-1/)

• Java

  Example user agent
  SonyEricssonw760i/R4EA Java/SEMC-Java/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UNTRUSTED/1.0, sonyericssonw760i

• Java

  Example user agent
  Java/1.8.0_25

• voyager

  Example user agent
  voyager/1.0

• Googlebot

  Example user agent
  Googlebot

• Java

  Example user agent
  LG-T310i/V100 Obigo/Q7.3 MMS/LG-MMS-V1.1/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• TweetedTimes Bot

  Example user agent
  Mozilla/5.0 (compatible; TweetedTimes Bot/1.0 (resolver); +http://tweetedtimes.com)

• DotBot

  Example user agent
  DotBot/1.0.1 (http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org)

• Vagabondo

  Example user agent
  Mozilla/4.0 (compatible; Vagabondo/2.2; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)

• Java

  Example user agent
  Mozilla/5.0 (LG-T585 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Java

  Example user agent
  Mozilla/5.0 (Vodafone/1.0/LG-GS290/V10b Browser/Obigo-Q7.3 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• sogou spider

  Example user agent
  Sogou Orion spider/4.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• WDG_Validator

  Example user agent
  WDG_Validator/1.6.5

• Googlebot

  Example user agent
  Googlebot-News

• Java

  Example user agent
  Huawei/1.0/HuaweiT7200/B100 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• Java

  Example user agent
  HuaweiU3100/B000 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/2.0 Profile/MIDP-2.0 Configurat

• Java

  Example user agent
  Mozilla/5.0 (compatible; Ex-Crawler/v0.1.5ALPHA SVN rev58; powered by ex-crawler; +http://www.ex-crawler.de/) Java/1.6.0_20,gzip(gfe),gzip(gfe)

• Java

  Example user agent
  Mozilla/5.0 (compatible; Ex-Crawler/0.1.5a; powered by ex-crawler; +http://www.ex-crawler.de/) Java/1.6.0_20,gzip(gfe),gzip(gfe)

• boitho.com-dc

  Example user agent
  boitho.com-dc/0.4 ( http://www.boitho.com/dcbot.html )

• boitho.com-dc

  Example user agent
  boitho.com-dc/0.86 ( http://www.boitho.com/dcbot.html )

• omgilibot

  Example user agent
  omgilibot/0.3 +http://www.omgili.com/Crawler.html

• semanticdiscovery

  Example user agent
  semanticdiscovery/0.2(http://www.semanticdiscovery.com/sd/robot.html)

• Scrubby

  Example user agent
  Mozilla/5.0 (compatible; Scrubby/3.2; +http://seotools.scrubtheweb.com/webpage-analyzer.html)

• Java

  Example user agent
  LG-C299/V100 Obigo/Q05A MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• Larbin

  Example user agent
  08_800w_web1 (larbin2.6.3@unspecified.mail)

• Bingbot

  Example user agent
  Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

• MojeekBot

  Example user agent
  Mozilla/5.0 (compatible; MojeekBot/0.6; http://www.mojeek.com/bot.html)

• ichiro

  Example user agent
  ichiro/3.0 (http://help.goo.ne.jp/door/crawler.html)

• Baiduspider

  Example user agent
  Baiduspider-image+(+http://www.baidu.com/search/spider.htm)

• Java

  Example user agent
  Huawei/1.0/0HuaweiU1307/B100 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• AppEngine-Google

  Example user agent
  AppEngine-Google; ( http://code.google.com/appengine)

• ScoutJet

  Example user agent
  Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/)

• Yahoo! Slurp

  Example user agent
  Mozilla/5.0 (compatible; Yahoo! Slurp/3.0 ; http://help.yahoo.com/help/us/ysearch/slurp)

• SandCrawler

  Example user agent
  SandCrawler - Compatibility Testing

• Java

  Example user agent
  Epic Empire/1.80 pgid=454af7cb350c2a1b tag=454af7cb350c2a1b cv=180011 hw=ASUS ME371MG; ME371MG; gzip; JavaHttp

• Yeti

  Example user agent
  Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)

• msnbot

  Example user agent
  msnbot/2.0b ( http://search.msn.com/msnbot.htm)

• FeedFetcher-Google

  Example user agent
  Feedly/1.0 (+http://www.feedly.com/fetcher.html; like FeedFetcher-Google)

• Googlebot

  Example user agent
  Locubot (compatible; Googlebot; msnbot)

• Java

  Example user agent
  LG-BL20f Browser/Obigo-Q7.3 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• Python-urllib

  Example user agent
  IMVU Client/498.0 Python-urllib/2.7

• SeznamBot

  Example user agent
  SeznamBot/3.0 (+http://fulltext.sblog.cz/)

• Java

  Example user agent
  Squrl Java/1.6.0_22

• Googlebot

  Example user agent
  Googlebot (gocrawl v0.4)

• Googlebot

  Example user agent
  Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

• Ezooms

  Example user agent
  Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)

• ichiro

  Example user agent
  DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://help.goo.ne.jp/help/article/1142/)

• Java

  Example user agent
  Huawei/1.0/0HuaweiU1315/B100 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• Accoona-AI-Agent

  Example user agent
  Accoona-AI-Agent/1.1.1 (crawler at accoona dot com)

• Exabot

  Example user agent
  Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); +http://www.exabot.com/go/robot)

• YandexBot

  Example user agent
  Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)

• Java

  Example user agent
  Java/1.7.0_71

• FAST-WebCrawler

  Example user agent
  FAST-WebCrawler/2.2.11 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)

• ichiro

  Example user agent
  ichiro/1.0 (ichiro@nttr.co.jp)

• sogou spider

  Example user agent
  Sogou Pic Spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• Baiduspider

  Example user agent
  Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

• Java

  Example user agent
  Mozilla/5.0 (LG-T500 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1

• Java

  Example user agent
  Huawei/1.0/0HuaweiU3315/B100 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• SeznamBot

  Example user agent
  Mozilla/5.0 (compatible; SeznamBot/3.2-test1; +http://fulltext.sblog.cz/)

• msnbot

  Example user agent
  msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)

• iaskspider

  Example user agent
  iaskspider2 (iask@staff.sina.com.cn)

• Python-urllib

  Example user agent
  Python-urllib/1.15

• sogou spider

  Example user agent
  Sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• Java

  Example user agent
  Mozilla/5.0 (LG-T385 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• semanticdiscovery

  Example user agent
  semanticdiscovery/2.0(http://www.semanticdiscovery.com/robot.html)

• Googlebot

  Example user agent
  Mozilla/5.0 (compatible;acapbot/0.1.;treat like Googlebot)

• Baiduspider

  Example user agent
  'Mozilla/5.0 (compatible; Baiduspider/2.0; +ht'

• TurnitinBot

  Example user agent
  TurnitinBot/1.5 (http://www.turnitin.com/robot/crawlerinfo.html)

• Java

  Example user agent
  JNLP/6.0 javaws/1.6.0_14 (b08) Java/1.6.0_14

• Java

  Example user agent
  LG/KF690/v10a Browser/Obigo-Q05A/3.12 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1 UNTRUSTED/1.0

• Java

  Example user agent
  LG-C320/V100 Obigo/Q7.3 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• noxtrumbot

  Example user agent
  noxtrumbot/1.0 (crawler@noxtrum.com)

• Java

  Example user agent
  Huawei/1.0/0HuaweiU5700/B100 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.

• Java

  Example user agent
  HuaweiU120/1.0/B127 Browser/Obigo-Browser/Q04A MMS/Obigo-MMS/Q04A SyncML/HW-SyncML/1.0 Java/QVM/4.1 Profile/MIDP-2.0 Configuration/CLDC-1.1

• Bingbot

  Example user agent
  Mozilla/5.0 (compatible; bingbot/2.0 http://www.bing.com/bingbot.htm)

• psbot

  Example user agent
  psbot-page (+http://www.picsearch.com/bot.html)

• Java

  Example user agent
  Huawei/1.0/0HuaweiU1300/B123 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• AppEngine-Google

  Example user agent
  Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/) AppEngine-Google; (+http://code.google.com/appengine; appid: s~proxyfile1-hrd)

• Java

  Example user agent
  Vodafone/1.0/0Vodafone715/B116 Browser/Obigo-Browser/Q04A MMS/Obigo-MMS/Q04A SyncML/HW-SyncML/1.0 Java/QVM/4.1 Profile/MIDP-2.0 Configuration/CLDC-1.1

• FAST-WebCrawler

  Example user agent
  FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)

• DotBot

  Example user agent
  Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)

• Java

  Example user agent
  Huawei/1.0/0HuaweiU3317/B100 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• Speedy Spider

  Example user agent
  Speedy Spider (http://www.entireweb.com)

• HuaweiSymantecSpider

  Example user agent
  Huaweisymantecspider (compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727),gzip(gfe)

• Java

  Example user agent
  LG-T300/V100 Obigo/Q7.3 MMS/LG-MMS-V1.1/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• Bingbot

  Example user agent
  Mozilla/5.0 (compatible;bingbot/2.0;+http://www.bing.com/bingbot.htm)

• Python-urllib

  Example user agent
  Python-urllib/3.4

• Java

  Example user agent
  Mozilla/5.0 (LG-C360 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• msnbot

  Example user agent
  msnbot/2.0b (+http://search.msn.com/msnbot.htm)

• 008

  Example user agent
  Mozilla/5.0 (Linux; U; Android 2.3.4; ja-jp; 008Z Build/GINGERBREAD) AppleWebKit/533.1 (KHTML, like Gecko) Version/4.0 Mobile Safari/533.1

• Java

  Example user agent
  Huawei/1.0/0HuaweiU3300/B100 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• Java

  Example user agent
  LG-P520/V100 Obigo/Q7.3 MMS/LG-MMS-V1.1/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• NewsGator

  Example user agent
  NewsGator/3.0,gzip(gfe),gzip(gfe)

• discobot

  Example user agent
  Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html)

• FAST Enterprise Crawler

  Example user agent
  FAST Enterprise Crawler/5.3.4 (crawler@fast.no)

• yrspider

  Example user agent
  Mozilla/5.0 (Android 3.0; YRSpider; +http://www.yunrang.com/yrspider.html)

• Java

  Example user agent
  LG-BL40g/v1.0 Browser/Obigo-Q7.3 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• Gigabot

  Example user agent
  Gigabot/2.0/gigablast.com/spider.html

• Java

  Example user agent
  SonyEricssonW666i/R2BA Java/SEMC-Java/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UNTRUSTED/1.0

• Googlebot

  Example user agent
  DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

• Sosospider

  Example user agent
  Sosospider+(+http://help.soso.com/webspider.htm)

• Java

  Example user agent
  LG-HB620T/v10a Browser/Obigo-Q05A/3.12 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• W3C_CSS_Validator_JFouffa

  Example user agent
  Jigsaw/2.3.0 W3C_CSS_Validator_JFouffa/2.0 (See )

• msnbot

  Example user agent
  MSNBot/Nutch-1.5.1

• Googlebot

  Example user agent
  Googlebot v2.1 (+http://www.google.com/bot.html) (http://www.openwebspider.org/)

• FeedFetcher-Google

  Example user agent
  Mozilla/5.0 (compatible) Feedfetcher-Google;(+http://www.google.com/feedfetcher.html)

• Java

  Example user agent
  CTC/HUAWEIC5720 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UNTRUSTED/1.0

• AppEngine-Google

  Example user agent
  AppEngine-Google; (+http://code.google.com/appengine; appid: xbmacx)

• Googlebot

  Example user agent
  Googlebot-News (2.3.3, ruby 1.9.3 (2013-11-22))

• Shim-Crawler

  Example user agent
  Shim-Crawler

• YandexMetrika

  Example user agent
  Mozilla/5.0 (compatible; YandexMetrika/2.0; +http://yandex.com/bots)

• Java

  Example user agent
  LG-GU285f Browser/Obigo-Q7.3 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• Nusearch Spider

  Example user agent
  nuSearch Spider www.nusearch.com (compatible; MSIE 4.01; Windows NT)

• ichiro

  Example user agent
  ichiro/5.0 (http://help.goo.ne.jp/door/crawler.html)

• Java

  Example user agent
  HuaweiC6100 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UNTRUSTED/1.0

• Jaxified

  Example user agent
  Jaxified Crawler 1.0a (+http://www.jaxified.com/),gzip(gfe),gzip(gfe)

• Java

  Example user agent
  Mozilla/5.0 (LG-T515 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Linguee Bot

  Example user agent
  Linguee Bot (bot@linguee.com)

• Mediapartners-Google

  Example user agent
  DoCoMo/2.0 SH905i(c100;TB;W24H16) (compatible; Mediapartners-Google/2.1; +http://www.google.com/bot.html)

• Googlebot

  Example user agent
  SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

• suggybot

  Example user agent
  Mozilla/5.0 (compatible; suggybot v0.01a, http://blog.suggy.com/was-ist-suggy/suggy-webcrawler/)

• Java

  Example user agent
  LG/KC910e/V10c Browser/Obigo-Q7.1 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• Java

  Example user agent
  Nokia6650d-1bh/03.25/sw_platform=S60;sw_platform_version=3.2;java_build_version=74701 Profile/MIDP-2.1 Configuration/CLDC-1.1

• Java

  Example user agent
  MQQBrowser/Mini2.2 (Nokia5230/50.0.001/sw_platform=S60;sw_platform_version=5.0;java_build_version=1.4.43)

• TinEye

  Example user agent
  TinEye-bot/0.02 (see http://www.tineye.com/crawler.html)

• MQBOT

  Example user agent
  CazoodleBot/0.1 (CazoodleBot Crawler; http://www.cazoodle.com; mqbot@cazoodle.com)

• YandexImages

  Example user agent
  Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)

• Java

  Example user agent
  LG-A155/V100 Obigo/Q05A MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• ShopWiki

  Example user agent
  ShopWiki/1.0 ( +http://www.shopwiki.com/wiki/Help:Bot)

• findlinks

  Example user agent
  findlinks/2.6 ( http://wortschatz.uni-leipzig.de/findlinks/)

• Jaxified

  Example user agent
  Jaxified Public RSS Crawler ( http://www.jaxified.com/)

• SeznamBot

  Example user agent
  Mozilla/5.0 (compatible; SeznamBot/3.1-test1; +http://fulltext.sblog.cz/)

• Java

  Example user agent
  Java/1.17

• Java

  Example user agent
  Java/1.7

• Yeti

  Example user agent
  Yeti-FeedItemCrawler/1.0 (NHN Corp.;+http://help.naver.com/robots/)

• ia_archiver

  Example user agent
  ia_archiver/8.7 (Windows NT 5.0; )

• MSRBOT

  Example user agent
  MSRBOT (http://research.microsoft.com/research/sv/msrbot)

• Java

  Example user agent
  Mozilla/5.0 (LG-C205 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Vagabondo

  Example user agent
  Mozilla/5.0 (compatible; Vagabondo/Wapspider; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)

• YodaoBot

  Example user agent
  Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )

• OOZBOT

  Example user agent
  Mozilla/5.0 (compatible; yoozBot-2.2; http://yooz.ir; info@yooz.ir)

• sogou spider

  Example user agent
  Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

• Java

  Example user agent
  Mozilla/5.0 (LG-C199 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Java

  Example user agent
  Mozilla/5.0 (LG-C330 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• HuaweiSymantecSpider

  Example user agent
  HuaweiSymantecSpider/1.0 DSE-support@huaweisymantec.com (compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR ; http://www.huaweisymantec.com/cn/IRL/spider)

• NewsGator

  Example user agent
  NewsGator FetchLinks extension/0.2.0 (http://graemef.com)

• Java

  Example user agent
  LG/KU990i/v10a Browser/Obigo-Q05A/3.6 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1

• Java

  Example user agent
  Huawei/1.0/0HuaweiU2800/B000 Browser/Obigo-Browser/Q05A HUAWEI-U2800 HuaweiJava/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1

• Java

  Example user agent
  Mozilla/5.0 (LG-T565b AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• 008

  Example user agent
  Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html;) Gecko/2008032620

• Java

  Example user agent
  LG/KF750/v10a Browser/Obigo-Q05A/3.12 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• YoudaoBot

  Example user agent
  Mozilla/5.0 (compatible; YoudaoBot-rts/1.0; http://www.youdao.com/help/webmaster/spider/; )

• htdig

  Example user agent
  htdig/3.1.6 (romieu@bastide-medical.fr)

• OmniExplorer_Bot

  Example user agent
  OmniExplorer_Bot/6.70 ( http://www.omni-explorer.com) WorldIndexer

• MagpieRSS

  Example user agent
  MagpieRSS/0.72 (+http://magpierss.sf.net)

• MagpieRSS

  Example user agent
  MagpieRSS/0.61 (+http://magpierss.sf.net)

• Googlebot

  Example user agent
  Googlebot-Mobile (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

• Python-urllib

  Example user agent
  Python-urllib/1.16

• zspider

  Example user agent
  Zspider (+http://www.zhanzhangsou.com/index.htm)

• Java

  Example user agent
  Huawei/1.0/0HuaweiU3315h/B100 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• ichiro

  Example user agent
  DoCoMo/2.0 P900i(c100;TB;W24H11)(compatible; ichiro/mobile goo; http://help.goo.ne.jp/door/crawler.html)

• Larbin

  Example user agent
  LarbinWebCrawler (internet@bredband.net)

• Xenu Link Sleuth

  Example user agent
  Xenu Link Sleuth/1.3.8

• voyager

  Example user agent
  voyager/2.0 (http://www.kosmix.com/crawler.html)

• ia_archiver

  Example user agent
  ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)

• Java

  Example user agent
  Samsung/910XXIG2/sw_platform=S60;sw_platform_version=5.0;java_build_version=1.3.4 Profile/MIDP-2.1 Configuration/CLDC-1.1 UNTRUSTED/1.0

• Java

  Example user agent
  Mozilla/5.0 (LG-C365 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Yeti

  Example user agent
  Mozilla/5.0 (compatible; Yeti/1.1; +http://help.naver.com/robots/)

• msnbot

  Example user agent
  msnbot-media/2.0b (+http://search.msn.com/msnbot.htm)

• Orbiter

  Example user agent
  Orbiter ( http://www.dailyorbit.com/bot.htm)

• TweetedTimes Bot

  Example user agent
  Mozilla/5.0 (compatible; TweetedTimes Bot/1.0; +http://tweetedtimes.com)

• EmeraldShield.com WebBot

  Example user agent
  EmeraldShield.com WebBot

• yacy

  Example user agent
  yacybot (freeworld/global; amd64 Linux 3.2.0-4-amd64; java 1.7.0_25; Europe/en) http://yacy.net/bot.html

• Baiduspider

  Example user agent
  Baiduspider+(+http://www.baidu.com/search/spider_jp.html)

• sogou spider

  Example user agent
  Sogou Pic Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm

• Java

  Example user agent
  Nokia5228/40.1.003/sw_platform=S60;sw_platform_version=5.0;java_build_version=1.4.48

• Java

  Example user agent
  Apache-HttpClient/4.0-beta2 (java 1.5)

• W3C-checklink

  Example user agent
  W3C-checklink/4.0 [4.4] libwww-perl/5.803

• Peew

  Example user agent
  Mozilla/5.0 (compatible; Peew/1.0; http://www.peew.de/crawler/)

• FeedFetcher-Google

  Example user agent
  FeedFetcher-Google; ( http://www.google.com/feedfetcher.html)

• Zao

  Example user agent
  Zao-Crawler

• AppEngine-Google

  Example user agent
  AppEngine-Google

• W3C_Validator

  Example user agent
  W3C_Validator/1.767

• Googlebot

  Example user agent
  Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) ASProxy/5.5b5

• Java

  Example user agent
  LG-E500/V100 Obigo/Q7.3 MMS/LG-MMS-V1.1/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1,gzip(gfe)

• Java

  Example user agent
  Mozilla/5.0 (LG-C370 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Java

  Example user agent
  LG-T310-Orange/V10a Obigo/Q7.3 MMS/LG-MMS-V1.1/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• Java

  Example user agent
  LG-A290/V100 Obigo/Q05A MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• Java

  Example user agent
  Huawei/1.0/0HuaweiU1305/B100 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• Java

  Example user agent
  0HuaweiU5705/Huawei/1.0/B100 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• msnbot

  Example user agent
  "msnbot-NewsBlogs/2.0b (+http://search.msn.com/msnbot.htm)

• Java

  Example user agent
  Mozilla/5.0 (LG-T500 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Java

  Example user agent
  Mozilla/5.0 (Vodafone/1.0/LG-BL40/V10a Browser/Obigo-Q7.3 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• iaskspider

  Example user agent
  iaskspider/2.0( http://iask.com/help/help_index.html)

• NutchCVS

  Example user agent
  NutchCVS/0.06-dev (Nutch running at UW; http://www.nutch.org/docs/en/bot.html; sycrawl@cs.washington.edu)

• Googlebot

  Example user agent
  Googlebot/2.2

• LDSpider

  Example user agent
  lworldspider

• Googlebot

  Example user agent
  DoCoMo//2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

• Java

  Example user agent
  LG-A390/V100 Obigo/Q05A MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• Baiduspider

  Example user agent
  BaiDuSpider

• Python-urllib

  Example user agent
  Mozilla/5.0 (Python-urllib2)

• sogou spider

  Example user agent
  Sogou Pic Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)

• Java

  Example user agent
  Mozilla/5.0 (LG-C333 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Java

  Example user agent
  Mozilla/5.0 (LG-T395 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1) UNTRUSTED/1.0

• Java

  Example user agent
  OneBrowser/3.1 (Nokia501.2/14.0.4/java_runtime_version=Nokia_Asha_1_2)

• Java

  Example user agent
  Mozilla/5.0 (LG-T580 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Baiduspider

  Example user agent
  Baiduspider+(+http://www.baidu.jp/spider/)

• magpie-crawler

  Example user agent
  magpie-crawler/1.1 (U; Linux amd64; en-GB; +http://www.brandwatch.net)

• Baiduspider

  Example user agent
  Baiduspider-image ( http://www.baidu.com/search/spider.htm)

• Baiduspider

  Example user agent
  Baiduspider ( http://www.baidu.com/search/spider.htm)

• Mnogosearch

  Example user agent
  MnoGoSearch/3.3.15

• Amaya

  Example user agent
  amaya/9.51 libwww/5.4.0

• sogou spider

  Example user agent
  Sogou develop spider/4.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• 008

  Example user agent
  Mozilla/5.0 (compatible; 008/0.85; http://www.80legs.com/webcrawler.html) Gecko/2008032620

• W3C_Validator

  Example user agent
  W3C_Validator/1.3 http://validator.w3.org/services

• SeznamBot

  Example user agent
  Mozilla/5.0 (compatible; SeznamBot/3.2; +http://fulltext.sblog.cz/)

• DomainsDB.net MetaCrawler

  Example user agent
  DomainsDB.net MetaCrawler v.0.9.7b (http://domainsdb.net/)

• Googlebot

  Example user agent
  Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)

• FurlBot

  Example user agent
  Mozilla/4.0 compatible FurlBot/Furl Search 2.0 (FurlBot; http://www.furl.net; wn.furlbot@looksmart.net)

• Vagabondo

  Example user agent
  Mozilla/4.0 (compatible; Vagabondo/4.0/EU; http://www.wise-guys.nl/)

• TurnitinBot

  Example user agent
  TurnitinBot/3.0 (http://www.turnitin.com/robot/crawlerinfo.html)

• Exabot

  Example user agent
  Mozilla/5.0 (compatible; Alexabot/1.0; +http://www.alexa.com/help/certifyscan; certifyscan@alexa.com)

• Java

  Example user agent
  Mozilla/5.0 (LG-C207 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• msnbot

  Example user agent
  msnbot/2.0b (+http://search.msn.com/msnbot.htm)._

• FeedFetcher-Google

  Example user agent
  Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; 375 subscribers; feed-id=15381863289700640853)

• Java

  Example user agent
  SEC-SGHE900/10 SAMSUNG JAVA CLIENT

• Nusearch Spider

  Example user agent
  NuSearch Spider www.nusearch.com

• TweetedTimes Bot

  Example user agent
  TweetedTimes Bot/1.0 (Mozilla/5.0 Compatible, +http://tweetedtimes.com)

• lmspider

  Example user agent
  lmspider (lmspider@scansoft.com)

• Teoma

  Example user agent
  Mozilla/2.0 (compatible; Ask Jeeves/Teoma)

• Java

  Example user agent
  Java/1.5.0_17

• Java

  Example user agent
  ProjectWF-java-test-crawler

• Bingbot

  Example user agent
  Mozilla/5.0 (compatible; bingbot/2.0; )"

• Googlebot

  Example user agent
  Googlebot/Nutch-1.7

• Holmes

  Example user agent
  holmes/2.3

• VoilaBot

  Example user agent
  Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA 1.2 (http://www.voila.com/)

• NetSeer Crawler

  Example user agent
  compatible; Netseer crawler/2.0; +http://www.netseer.com/crawler.html; crawler@netseer.com

• Java

  Example user agent
  Mozilla/5.0 (LG-T385b-Bouygues AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Bingbot

  Example user agent
  bingbot

• Yahoo! Slurp China

  Example user agent
  Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)

• psbot

  Example user agent
  psbot/0.1 (+http://www.picsearch.com/bot.html)

• Bingbot

  Example user agent
  Mozilla/5.0 (compatible; bingbot/2.1; +http://www.bing.com/bingbot.htm)

• Java

  Example user agent
  Java/1.6.0_43

• IRLbot

  Example user agent
  IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler)

• psbot

  Example user agent
  psbot-image (+http://www.picsearch.com/bot.html)

• IRLbot

  Example user agent
  IRLbot/1.0 ( http://irl.cs.tamu.edu/crawler)

• MojeekBot

  Example user agent
  Mozilla/5.0 (compatible; MojeekBot/0.6; +https://www.mojeek.com/bot.html)

• ichiro

  Example user agent
  DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://search.goo.ne.jp/option/use/sub4/sub4-1/)

• FAST Enterprise Crawler

  Example user agent
  FAST Enterprise Crawler/6 (www.fastsearch.com)

• Java

  Example user agent
  Mozilla/5.0 (Vodafone/1.0/LG-GT350/V10a Browser/Obigo-Q7.3 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• Speedy Spider

  Example user agent
  Mozilla/5.0 (compatible; Speedy Spider; http://www.entireweb.com/about/search_tech/speedy_spider/)

• PostPost

  Example user agent
  PostPost/1.0 ( http://postpo.st/crawlers)

• magpie-crawler

  Example user agent
  magpie-crawler/1.1 (U; Linux amd64; en-GB; http://www.brandwatch.net)

• WWW-Mechanize

  Example user agent
  WWW-Mechanize/1.64

• Java

  Example user agent
  LG-T325/V100 Obigo/Q7.3 MMS/LG-MMS-V1.1/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• Java

  Example user agent
  Mozilla/5.0 (LG-C375 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Googlebot

  Example user agent
  Mozilla (Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html))

• FeedFetcher-Google

  Example user agent
  Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; feed-id=000000000000000000)

• Java

  Example user agent
  Mozilla/5.0 (Vodafone/1.0/LG-T385b/V10i AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• lwp-trivial

  Example user agent
  lwp-trivial/1.41

• Holmes

  Example user agent
  holmes/3.12.4 (http://morfeo.centrum.cz/bot)

• Googlebot-Image

  Example user agent
  Googlebot-Image/1.0

• Java

  Example user agent
  LG-KF700Q Browser/Obigo-Q05A/3.12 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• msnbot

  Example user agent
  adidxbot/2.0 (+http://search.msn.com/msnbot.htm)

• Java

  Example user agent
  Mozilla/5.0 (LG-T370 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• msnbot

  Example user agent
  msnbot-media/1.0 ( http://search.msn.com/msnbot.htm)

• Baiduspider

  Example user agent
  Mozilla/5.0+(compatible;+Baiduspider/2.0;++http://www.baidu.com/search/spider.html)

• yacy

  Example user agent
  yacybot (freeworld/global; x86 Windows XP 5.1; java 1.7.0_21; GMT+04:00/ru) http://yacy.net/bot.html

• Java

  Example user agent
  SonyEricssonw580i/R4EA Java/SEMC-Java/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 sonyericssonw580i

• Vagabondo

  Example user agent
  Mozilla/5.0 (compatible; Vagabondo/2.1; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/)

• Java

  Example user agent
  Mozilla/5.0 (LG-T510 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Pompos

  Example user agent
  Pompos/1.2 http://pompos.iliad.fr

• Java

  Example user agent
  Huawei/1.0/0MTC-752/B000 Browser/Obigo-Browser/Q05A MTC-752 HuaweiJava/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1

• FAST-WebCrawler

  Example user agent
  FAST-WebCrawler/3.7 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)

• Exabot

  Example user agent
  Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)

• Java

  Example user agent
  LG-BL42k/v10b Browser/Obigo-Q7.3 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1

• Java

  Example user agent
  Vodafone/1.0/0vodafone810/B626 Browser/Obigo-browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJA/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1

• ConveraCrawler

  Example user agent
  ConveraCrawler/0.9c ( http://www.authoritativeweb.com/crawl)

• Java

  Example user agent
  Mozilla/5.0 (Vodafone/1.0/LG-BL20/V10b Browser/Obigo-Q7.3 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• Googlebot

  Example user agent
  googlebot

• AppEngine-Google

  Example user agent
  Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots),gzip(gfe) AppEngine-Google; (+http://code.google.com/appengine; appid: twitter-mirror),gzip(gfe),gzip(gfe),gzip(gfe)

• Googlebot

  Example user agent
  Googlebot/2.1(+http://www.googlebot.com/bot.html)

• updated

  Example user agent
  updated/0.1-alpha (updated crawler; http://www.updated.com; crawler@updated.com)

• sogou spider

  Example user agent
  Sogou web spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• 008

  Example user agent
  Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/webcrawler.html) Gecko/2008032620

• Charlotte

  Example user agent
  Mozilla/5.0 (compatible; Charlotte/1.0b; charlotte@beta.spider.com)

• sogou spider

  Example user agent
  Sogou Push Spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07)

• Java

  Example user agent
  Mozilla/5.0 (Vodafone/1.0/LG-GC900/V10b Browser/Obigo-Q7.1 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• ScoutJet

  Example user agent
  Mozilla/5.0 (compatible; Blekkobot; ScoutJet; +http://blekko.com/about/blekkobot)

• Java

  Example user agent
  Mozilla/5.0 (LG-GD880-Orange/V09d AppleWebKit/531 MMS/LG-MMS-V1.0/1.2 MediaPlayer/LGPlayer/1.0 Java/ASVM/1.1 Profile/MIDP-2.1 Configuration/CLDC-1.1)

• msnbot

  Example user agent
  msnbot-UDiscovery/2.0b (+http://search.msn.com/msnbot.htm)

• FeedFetcher-Google

  Example user agent
  Feedfetcher-Google; (+http://www.google.com/feedfetcher.html; 19 subscribers; feed-id=13965549748850348809)

• Java

  Example user agent
  Mozilla/5.0 (LG-T375 AppleWebkit/531 Browser/Phantom/V2.0 Widget/LGMW/3.0 MMS/LG-MMS-V1.0/1.2 Java/ASVM/1.1 Profile/MIDP-2.1

• Mozilla

  Example user agent
  Hybridcast/1.0 (;008045;PANATV1308;2;2;)

• Bingbot

  Example user agent
  Mozilla/5.0 (compatible; bingbot/2.0 +http://www.bing.com/bingbot.htm)

• Java

  Example user agent
  HuaweiU7510/B000 Browser/Obigo-Browser/Q05A MMS/Obigo-MMS/Q05A SyncML/HW-SyncML/1.0 Java/HWJa/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 Player/QTV-Player/5.3

• msnbot

  Example user agent
  msnbot/1.1 (+http://search.msn.com/msnbot.htm)

• Yeti

  Example user agent
  Yeti/1.1 (Naver Corp.; http://help.naver.com/robots/)

• Mediapartners-Google

  Example user agent
  Mediapartners-Google

• ssearch_bot

  Example user agent
  ssearch_bot (sSearch Crawler; http://www.semantissimo.de)

• Baiduspider

  Example user agent
  Baiduspider-testbranch

• envolk[ITS]spider

  Example user agent
  envolk[ITS]spider/1.6 ( http://www.envolk.com/envolkspider.html)

• Yahoo! Slurp

  Example user agent
  Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp

• sogou spider

  Example user agent
  Sogou inst spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

• Java

  Example user agent
  JNLP/1.7.0 javaws/10.17.2.02 () Java/1.7.0_17

About this comparison