Robots |
1 | 498 | 27.14 | linkdexbot/2.0 |
2 | 355 | 19.35 | MJ12bot/v1.4.5 |
3 | 294 | 16.02 | compatible Mozilla/5.0 |
4 | 146 | 7.96 | Googlebot/2.1 |
5 | 138 | 7.52 | Linux x86_64 |
6 | 132 | 7.19 | YandexBot/3.0 |
7 | 36 | 1.96 | CB/Nutch-1.7 |
8 | 35 | 1.91 | Yahoo! Slurp |
9 | 30 | 1.63 | bingbot/2.0 |
10 | 18 | 0.98 | SeznamBot/3.2 |
11 | 16 | 0.87 | GigablastOpenSource/1.0 |
12 | 16 | 0.87 | AhrefsBot/5.0 |
13 | 13 | 0.71 | Googlebot (gocrawl v0.4) |
14 | 13 | 0.71 | - |
15 | 12 | 0.65 | Exabot/3.0 |
16 | 12 | 0.65 | Firefox/2.0.0.6 |
17 | 11 | 0.60 | ia_archiver |
18 | 8 | 0.44 | WorldBrewBot/2.1 (+http://www.marketbrew... |
19 | 8 | 0.44 | meanpathbot/1.0 |
20 | 7 | 0.38 | MSIE 9.0 |
21 | 6 | 0.33 | spbot/4.4.2 |
22 | 4 | 0.22 | BLEXBot/1.0 |
23 | 4 | 0.22 | Findxbot/1.0 |
24 | 2 | 0.11 | psbot/0.1 (+http://www.picsearch.com/bot... |
25 | 2 | 0.11 | compatible Mozilla/4.0 |
26 | 2 | 0.11 | YisouSpider |
27 | 2 | 0.11 | Plukkie/1.5 |
28 | 2 | 0.11 | nutch-1.4/Nutch-1.4 |
29 | 2 | 0.11 | VeriCiteCrawler/Nutch-1.9 |
30 | 2 | 0.11 | MJ12bot/v1.4.4 |
31 | 2 | 0.11 | AdnormCrawler www.adnorm.com/crawler |
32 | 2 | 0.11 | AdvBot/2.0 |
33 | 2 | 0.11 | archive.org_bot |
34 | 1 | 0.05 | Wotbox/2.01 (+http://www.wotbox.com/bot/... |
35 | 1 | 0.05 | SemrushBot/0.98~bl |
36 | 1 | 0.05 | My Nutch Spider/Nutch-1.9 |