Robots |
1 | 789 | 30.58 | MJ12bot/v1.4.5 |
2 | 614 | 23.80 | linkdexbot/2.0 |
3 | 276 | 10.70 | Riddler (http://riddler.io/about) |
4 | 165 | 6.40 | Googlebot/2.1 |
5 | 163 | 6.32 | ltx71 - (http://ltx71.com/) |
6 | 114 | 4.42 | YandexBot/3.0 |
7 | 76 | 2.95 | Linux x86_64 |
8 | 71 | 2.75 | bingbot/2.0 |
9 | 60 | 2.33 | compatible Mozilla/5.0 |
10 | 57 | 2.21 | Yahoo! Slurp |
11 | 26 | 1.01 | Y!J-ASR/0.1 crawler (http://www.yahoo-he... |
12 | 21 | 0.81 | Exabot/3.0 |
13 | 16 | 0.62 | cis455crawler |
14 | 16 | 0.62 | - |
15 | 15 | 0.58 | AhrefsBot/5.0 |
16 | 12 | 0.47 | spbot/4.4.2 |
17 | 12 | 0.47 | coccoc/1.0 |
18 | 10 | 0.39 | SeznamBot/3.2 |
19 | 8 | 0.31 | Stratagems Kumo |
20 | 7 | 0.27 | archive.org_bot |
21 | 6 | 0.23 | MSIE 6.0 |
22 | 6 | 0.23 | voltron |
23 | 4 | 0.16 | Googlebot (gocrawl v0.4) |
24 | 4 | 0.16 | DeuSu/5.0.2 |
25 | 3 | 0.12 | yoozBot-2.2 |
26 | 3 | 0.12 | ia_archiver |
27 | 2 | 0.08 | binlar_2.6.3 (test@mgmt.mic) |
28 | 2 | 0.08 | Applebot/0.3 |
29 | 2 | 0.08 | python-requests/2.8.1 |
30 | 2 | 0.08 | nutch-1.4/Nutch-1.4 |
31 | 2 | 0.08 | Openstat/0.1 |
32 | 2 | 0.08 | Plukkie/1.5 |
33 | 2 | 0.08 | fujilabolx1 Spider/Nutch-1.10 |
34 | 2 | 0.08 | fujilabolx7 Spider/Nutch-1.10 |
35 | 2 | 0.08 | Lipperhey-Kaus-Australis/5.0 |
36 | 2 | 0.08 | MSIE 9.0 |
37 | 2 | 0.08 | python-requests/2.5.3 CPython/2.7.6 Linu... |
38 | 2 | 0.08 | SurdotlyBot/1.0 |
39 | 2 | 0.08 | meanpathbot/1.0 |