47 different robots | Hits | Bandwidth | Last visit |
MJ12bot | 226,913+1652 | 767.16 MB | 30 Sep 2018 - 01:12 |
SemrushBot | 60,164+1378 | 517.07 MB | 30 Sep 2018 - 03:22 |
AhrefsBot | 54,257+63 | 348.63 MB | 30 Sep 2018 - 02:48 |
Unknown robot (identified by 'crawl') | 50,988+5 | 454.65 MB | 27 Sep 2018 - 00:23 |
Unknown robot (identified by empty user agent string) | 42,976+5 | 3.49 GB | 30 Sep 2018 - 03:22 |
Bingbot | 12,896+200 | 1.07 GB | 30 Sep 2018 - 03:18 |
Googlebot | 9,191+58 | 717.99 MB | 30 Sep 2018 - 02:57 |
Googlebot-Image | 3,810 | 215.21 MB | 29 Sep 2018 - 22:01 |
Bing Preview bot | 3,719 | 180.95 MB | 30 Sep 2018 - 03:11 |
DotBot, Open Site Explorer | 804+1865 | 52.16 MB | 30 Sep 2018 - 03:07 |
Yandex Bot | 1,505+233 | 60.45 MB | 30 Sep 2018 - 00:47 |
FaceBook bot | 788 | 40.40 MB | 29 Sep 2018 - 22:07 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 617+91 | 458.29 MB | 29 Sep 2018 - 18:36 |
Common Crawl | 569+9 | 4.98 MB | 26 Sep 2018 - 07:38 |
Unknown robot (identified by 'scanner') | 274+94 | 11.48 MB | 20 Sep 2018 - 00:38 |
Java (Often spam bot) | 339 | 13.67 MB | 28 Sep 2018 - 21:38 |
yeti | 319+4 | 242.59 MB | 27 Sep 2018 - 03:10 |
SeznamBot | 74+66 | 421.63 KB | 29 Sep 2018 - 22:31 |
Google Web Preview | 125 | 4.68 MB | 27 Sep 2018 - 17:35 |
FavIconizer | 123 | 1.30 MB | 29 Sep 2018 - 08:46 |
Mail.ru bot | 63+51 | 663.86 KB | 29 Sep 2018 - 13:25 |
Unknown robot (identified by hit on 'robots.txt') | 0+103 | 90.70 KB | 29 Sep 2018 - 23:34 |
SMTBot | 101+1 | 836.77 KB | 22 Sep 2018 - 14:43 |
Web Core / Roots | 85 | 1.14 MB | 25 Sep 2018 - 22:14 |
Alexa (IA Archiver) | 61+21 | 2.51 MB | 29 Sep 2018 - 13:40 |
Sogou Spider | 7+68 | 145.82 KB | 29 Sep 2018 - 23:36 |
SEOkicks Webcrawler | 64+8 | 505.72 KB | 29 Sep 2018 - 07:42 |
Python-urllib | 68 | 1.88 MB | 29 Sep 2018 - 12:04 |
360spider | 55 | 584.55 KB | 28 Sep 2018 - 18:55 |
Linkdex | 28+6 | 558.64 KB | 27 Sep 2018 - 15:03 |
Feedfetcher-Google | 33 | 69.70 KB | 29 Sep 2018 - 15:54 |
Cliqzbot | 18+12 | 191.99 KB | 24 Sep 2018 - 14:27 |
GigaBot | 28+1 | 1.02 MB | 11 Sep 2018 - 20:36 |
Suspected bot masqurading as Mozilla | 14 | 303.01 KB | 29 Sep 2018 - 20:53 |
Dataprovider Site Explorer | 11+1 | 420.96 KB | 26 Sep 2018 - 20:26 |
BaiDuSpider | 9+2 | 143.87 KB | 29 Sep 2018 - 23:21 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1+7 | 15.16 KB | 29 Sep 2018 - 06:08 |
Proximic Spider | 0+5 | 5.45 KB | 23 Sep 2018 - 00:11 |
ltx71 | 0+5 | 3.22 KB | 11 Sep 2018 - 07:06 |
Phantom | 4 | 40.78 KB | 21 Sep 2018 - 23:35 |
Unknown robot (identified by 'checker') | 3 | 35.37 KB | 24 Sep 2018 - 08:56 |
Additional Yahoo bots. | 2 | 389.57 KB | 27 Sep 2018 - 17:02 |
MojeekBot | 1+1 | 11.30 KB | 25 Sep 2018 - 10:52 |
archive.org bot | 0+2 | 1.29 KB | 05 Sep 2018 - 23:44 |
Microsoft Office Protocol Discovery/Microsoft Office Existence Discovery | 1 | 256 Bytes | 22 Sep 2018 - 01:12 |
Custo | 1 | 57.72 KB | 22 Sep 2018 - 03:16 |
Suspected bot masqurading as Mozilla | 1 | 10.72 KB | 19 Sep 2018 - 14:09 |
|