Robots |
1 | 1180 | 59.57 | Ezooms/1.0 |
2 | 118 | 5.96 | Googlebot/2.1 |
3 | 83 | 4.19 | YandexBot/3.0 |
4 | 74 | 3.74 | compatible Mozilla/5.0 |
5 | 74 | 3.74 | MJ12bot/v1.4.3 |
6 | 71 | 3.58 | COMODOSpider/Nutch-1.2 |
7 | 48 | 2.42 | Exabot/3.0 |
8 | 46 | 2.32 | bingbot/2.0 |
9 | 40 | 2.02 | msnbot-media/1.1 (+http://search.msn.com... |
10 | 35 | 1.77 | MojeekBot/0.2 |
11 | 22 | 1.11 | Nigma.ru/3.0 |
12 | 20 | 1.01 | Yahoo! Slurp |
13 | 20 | 1.01 | linkdex.com/v2.0 |
14 | 17 | 0.86 | msnbot/2.0b (+http://search.msn.com/msnb... |
15 | 15 | 0.76 | OpenWebIndex/Nutch-1.6 |
16 | 12 | 0.61 | SemrushBot/0.96.2 |
17 | 9 | 0.45 | SISTRIX Crawler |
18 | 9 | 0.45 | MSIE 6.0 |
19 | 6 | 0.30 | arjun/Nutch-1.4 |
20 | 6 | 0.30 | User-agent |
21 | 6 | 0.30 | FyberSpider/1.3 (http://www.fybersearch.... |
22 | 6 | 0.30 | Mail.RU_Bot/2.0 |
23 | 6 | 0.30 | larbin_2.6.3 (larbin2.6.3@unspecified.ma... |
24 | 6 | 0.30 | SiteExplorer/1.0b |
25 | 6 | 0.30 | Snipebot/1.0 |
26 | 5 | 0.25 | SeznamBot/3.0 (+http://fulltext.sblog.cz... |
27 | 4 | 0.20 | AhrefsBot/4.0 |
28 | 4 | 0.20 | Exabot/3.0 (BiggerBetter) |
29 | 4 | 0.20 | AcoonBot/4.11.1 |
30 | 3 | 0.15 | psbot/0.1 (+http://www.picsearch.com/bot... |
31 | 3 | 0.15 | Vagabondo/4.0 |
32 | 2 | 0.10 | emefgebot/beta |
33 | 2 | 0.10 | Wget/1.11.4 |
34 | 2 | 0.10 | Wotbox/2.01 (+http://www.wotbox.com/bot/... |
35 | 2 | 0.10 | Opera 9.80 |
36 | 2 | 0.10 | Firefox/3.6.7 |
37 | 2 | 0.10 | PEAR HTTP_Request class ( http://pear.ph... |
38 | 2 | 0.10 | MSIE 4.01 |
39 | 2 | 0.10 | www.integromedb.org/Crawler |
40 | 1 | 0.05 | netEstate NE Crawler (+http://www.websit... |
41 | 1 | 0.05 | Python-urllib/2.7 |
42 | 1 | 0.05 | HD nutch agent/Nutch-1.1 (Think) |
43 | 1 | 0.05 | spbot/3.1 |
44 | 1 | 0.05 | nutch-1.4/Nutch-1.4 |
45 | 1 | 0.05 | PagesInventory (robot http://www.pagesin... |
46 | 1 | 0.05 | CloudACL/Nutch-1.4 |