54 different robots | Hits | Bandwidth | Last visit |
MJ12bot | 201,650+1544 | 707.19 MB | 31 Jul 2018 - 03:24 |
AhrefsBot | 82,544+61 | 584.91 MB | 31 Jul 2018 - 03:29 |
SemrushBot | 60,803+1319 | 506.16 MB | 31 Jul 2018 - 03:28 |
Unknown robot (identified by empty user agent string) | 55,961+10 | 3.83 GB | 31 Jul 2018 - 03:28 |
Unknown robot (identified by 'crawl') | 43,022+25 | 609.30 MB | 30 Jul 2018 - 14:17 |
Bingbot | 14,044+185 | 1.08 GB | 31 Jul 2018 - 03:14 |
Googlebot | 11,141+60 | 631.26 MB | 31 Jul 2018 - 03:28 |
DotBot, Open Site Explorer | 5,715+3531 | 561.74 MB | 31 Jul 2018 - 03:21 |
Googlebot-Image | 4,016 | 148.35 MB | 31 Jul 2018 - 02:30 |
Bing Preview bot | 2,754 | 127.93 MB | 30 Jul 2018 - 19:20 |
Yandex Bot | 829+238 | 335.88 MB | 31 Jul 2018 - 01:17 |
SEOprofiler Bot | 995+1 | 8.16 MB | 13 Jul 2018 - 05:52 |
Common Crawl | 724+13 | 9.42 MB | 23 Jul 2018 - 02:29 |
007ac9 Crawler, seems to belong to SISTRIX | 712+1 | 5.73 MB | 08 Jul 2018 - 03:15 |
Java (Often spam bot) | 591 | 22.93 MB | 22 Jul 2018 - 08:54 |
Google Web Preview | 541 | 8.32 MB | 29 Jul 2018 - 19:39 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 334+53 | 223.90 MB | 30 Jul 2018 - 01:36 |
FaceBook bot | 334 | 18.47 MB | 30 Jul 2018 - 22:33 |
WordPress | 333 | 6.08 MB | 22 Jul 2018 - 21:11 |
Mail.ru bot | 151+126 | 13.12 MB | 30 Jul 2018 - 20:49 |
yeti | 260+1 | 2.85 MB | 30 Jul 2018 - 10:40 |
FavIconizer | 223 | 2.27 MB | 30 Jul 2018 - 21:00 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 191+2 | 21.57 MB | 31 Jul 2018 - 02:50 |
HTTrack off-line browser | 139+1 | 5.50 MB | 04 Jul 2018 - 16:58 |
Alexa (IA Archiver) | 103+24 | 15.42 MB | 30 Jul 2018 - 07:28 |
Suspected bot masqurading as Mozilla | 115 | 5.39 MB | 30 Jul 2018 - 15:28 |
Unknown robot (identified by 'scanner') | 77+37 | 833.02 KB | 31 Jul 2018 - 01:20 |
Web Core / Roots | 107 | 1.17 MB | 30 Jul 2018 - 18:29 |
SEOkicks Webcrawler | 89+16 | 988.71 KB | 30 Jul 2018 - 02:02 |
Linkdex | 61+9 | 932.71 KB | 30 Jul 2018 - 11:24 |
Unknown robot (identified by hit on 'robots.txt') | 0+57 | 44.62 KB | 26 Jul 2018 - 09:43 |
360spider | 43+8 | 464.71 KB | 30 Jul 2018 - 12:07 |
Python-urllib | 40+5 | 2.25 MB | 28 Jul 2018 - 03:07 |
ltx71 | 1+41 | 918.18 KB | 25 Jul 2018 - 05:05 |
Unknown robot (identified by 'robot') | 0+41 | 42.32 KB | 30 Jul 2018 - 17:07 |
Feedfetcher-Google | 32 | 43.90 KB | 30 Jul 2018 - 15:36 |
SeznamBot | 9+12 | 23.99 KB | 29 Jul 2018 - 05:21 |
WGet tools | 16 | 893.69 KB | 30 Jul 2018 - 09:23 |
Dataprovider Site Explorer | 11+1 | 420.32 KB | 24 Jul 2018 - 05:28 |
Proximic Spider | 0+7 | 7.63 KB | 30 Jul 2018 - 16:16 |
Common *nix tool for automating web document retireval. Most likely a bot. | 7 | 399.37 KB | 29 Jul 2018 - 15:59 |
A PHP script | 6 | 307.36 KB | 17 Jul 2018 - 20:07 |
Powermarks | 4 | 126.11 KB | 15 Jul 2018 - 15:02 |
BaiDuSpider | 2+2 | 22.42 KB | 21 Jul 2018 - 13:03 |
MSIECrawler | 4 | 127.43 KB | 15 Jul 2018 - 13:20 |
A6-Indexer | 1+1 | 11.60 KB | 12 Jul 2018 - 17:31 |
Unknown robot (identified by 'discovery') | 2 | 136.28 KB | 12 Jul 2018 - 21:15 |
Yahoo Slurp | 1+1 | 14.05 KB | 10 Jul 2018 - 21:10 |
Cliqzbot | 1+1 | 13.04 KB | 02 Jul 2018 - 20:40 |
archive.org bot | 0+2 | 1.29 KB | 25 Jul 2018 - 16:05 |
Sift | 1 | 15.68 KB | 16 Jul 2018 - 04:37 |
Additional Yahoo bots. | 1 | 66.07 KB | 06 Jul 2018 - 22:18 |
ning | 0+1 | 1.03 KB | 02 Jul 2018 - 05:01 |
Unknown robot (identified by 'checker') | 1 | 57.21 KB | 12 Jul 2018 - 23:33 |