Robots |
1 | 199 | 19.66 | msnbot-media/1.1 (+http://search.msn.com... |
2 | 140 | 13.83 | linkdexbot/2.0 |
3 | 107 | 10.57 | MJ12bot/v1.4.4 |
4 | 106 | 10.47 | Googlebot/2.1 |
5 | 102 | 10.08 | MJ12bot/v1.4.5 |
6 | 79 | 7.81 | bingbot/2.0 |
7 | 60 | 5.93 | Linux x86_64 |
8 | 56 | 5.53 | YandexBot/3.0 |
9 | 35 | 3.46 | Yahoo! Slurp |
10 | 25 | 2.47 | Ezooms/1.0 |
11 | 21 | 2.08 | DotBot/1.1 |
12 | 17 | 1.68 | compatible Mozilla/5.0 |
13 | 11 | 1.09 | SeznamBot/3.2 |
14 | 8 | 0.79 | MSIE 9.0 |
15 | 7 | 0.69 | YandexImages/3.0 |
16 | 6 | 0.59 | Baiduspider/2.0 |
17 | 5 | 0.49 | Exabot/3.0 |
18 | 5 | 0.49 | nutch-1.4/Nutch-1.4 |
19 | 4 | 0.40 | CCBot/2.0 (http://commoncrawl.org/faq/) |
20 | 3 | 0.30 | Sogou web spider/4.0(+http://www.sogou.c... |
21 | 3 | 0.30 | SISTRIX Crawler |
22 | 3 | 0.30 | AhrefsBot/5.0 |
23 | 2 | 0.20 | msnbot/2.0b (+http://search.msn.com/msnb... |
24 | 2 | 0.20 | archive.org_bot |
25 | 2 | 0.20 | SiteExplorer/1.0b |
26 | 1 | 0.10 | Apache-HttpClient/4.3 (java 1.5) |
27 | 1 | 0.10 | spbot/4.0.9 |
28 | 1 | 0.10 | SEOkicks-Robot |
29 | 1 | 0.10 | PagesInventory (robot http://www.pagesin... |