| 54 different robots | Hits | Bandwidth | Last visit |
|---|
| MJ12bot | 133,016+1235 | 487.57 MB | 30 Nov 2018 - 02:09 |
| Unknown robot (identified by empty user agent string) | 62,582+6 | 4.38 GB | 30 Nov 2018 - 02:48 |
| AhrefsBot | 57,625+77 | 402.77 MB | 30 Nov 2018 - 02:49 |
| SemrushBot | 40,738+1189 | 400.84 MB | 30 Nov 2018 - 02:48 |
| Bingbot | 12,664+148 | 1.21 GB | 30 Nov 2018 - 02:33 |
| Googlebot | 7,969+58 | 506.31 MB | 30 Nov 2018 - 02:45 |
| Googlebot-Image | 2,689 | 129.20 MB | 30 Nov 2018 - 02:09 |
| DotBot, Open Site Explorer | 1,106+1112 | 106.46 MB | 18 Nov 2018 - 14:37 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,634+70 | 619.37 MB | 30 Nov 2018 - 02:49 |
| Bing Preview bot | 1,657 | 112.69 MB | 30 Nov 2018 - 01:32 |
| Yandex Bot | 758+212 | 91.37 MB | 30 Nov 2018 - 02:01 |
| Unknown robot (identified by 'scanner') | 547+174 | 27.88 MB | 15 Nov 2018 - 17:43 |
| Unknown robot (identified by 'crawl') | 275+350 | 2.03 MB | 17 Nov 2018 - 06:44 |
| Common Crawl | 540+12 | 21.01 MB | 21 Nov 2018 - 17:59 |
| archive.org bot | 527+7 | 36.50 MB | 22 Nov 2018 - 05:53 |
| FaceBook bot | 476+1 | 40.19 MB | 29 Nov 2018 - 22:01 |
| Mail.ru bot | 129+94 | 13.77 MB | 30 Nov 2018 - 01:00 |
| yeti | 183+7 | 4.28 MB | 27 Nov 2018 - 20:09 |
| SMTBot | 140+1 | 1.25 MB | 14 Nov 2018 - 09:42 |
| Sogou Spider | 5+114 | 168.56 KB | 29 Nov 2018 - 15:20 |
| Java (Often spam bot) | 105 | 4.38 MB | 29 Nov 2018 - 04:28 |
| SeznamBot | 51+53 | 3.58 MB | 29 Nov 2018 - 13:19 |
| SEOkicks Webcrawler | 80+10 | 679.52 KB | 28 Nov 2018 - 23:24 |
| Alexa (IA Archiver) | 59+22 | 2.43 MB | 29 Nov 2018 - 13:31 |
| Unknown robot (identified by hit on 'robots.txt') | 0+69 | 55.68 KB | 29 Nov 2018 - 21:33 |
| Linkdex | 49+7 | 833.23 KB | 29 Nov 2018 - 18:29 |
| FavIconizer | 53 | 547.40 KB | 28 Nov 2018 - 18:06 |
| Suspected bot masqurading as Mozilla | 51 | 857.83 KB | 19 Nov 2018 - 23:04 |
| Unknown robot (identified by 'spider') | 49+1 | 1.04 MB | 06 Nov 2018 - 07:27 |
| 360spider | 31+12 | 337.24 KB | 28 Nov 2018 - 16:55 |
| Phantom | 40 | 180.05 KB | 29 Nov 2018 - 11:01 |
| Python-urllib | 33+2 | 122.23 KB | 29 Nov 2018 - 17:53 |
| Feedfetcher-Google | 33 | 44.84 KB | 29 Nov 2018 - 15:10 |
| Web Core / Roots | 29 | 326.09 KB | 24 Nov 2018 - 11:31 |
| GigaBot | 27+1 | 943.12 KB | 21 Nov 2018 - 20:22 |
| Exabot | 14+9 | 123.89 KB | 29 Nov 2018 - 19:13 |
| ning | 20 | 2.36 MB | 06 Nov 2018 - 20:51 |
| ltx71 | 0+16 | 10.30 KB | 28 Nov 2018 - 00:09 |
| Zend Http Client | 9 | 19.04 KB | 29 Nov 2018 - 20:19 |
| Cliqzbot | 4+4 | 107.26 KB | 25 Nov 2018 - 08:35 |
| WGet tools | 6 | 873.38 KB | 22 Nov 2018 - 13:07 |
| BaiDuSpider | 6 | 64.01 KB | 22 Nov 2018 - 12:12 |
| twitterbot | 4+1 | 164.90 KB | 18 Nov 2018 - 12:07 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 4 | 2.72 KB | 01 Nov 2018 - 21:59 |
| MojeekBot | 2+2 | 21.70 KB | 20 Nov 2018 - 07:52 |
| Additional Yahoo bots. | 3 | 751.05 KB | 17 Nov 2018 - 17:53 |
| Unknown robot (identified by 'checker') | 3 | 35.32 KB | 17 Nov 2018 - 18:14 |
| MSIECrawler | 3 | 173.27 KB | 15 Nov 2018 - 02:14 |
| Grapeshot Crawler | 1+1 | 13.74 KB | 09 Nov 2018 - 17:02 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 0+2 | 1.29 KB | 02 Nov 2018 - 11:38 |
| Suspected bot masqurading as Mozilla | 2 | 0 | 28 Nov 2018 - 03:20 |
| Unknown robot (identified by 'robot') | 1+1 | 45.91 KB | 09 Nov 2018 - 11:04 |
| CMS Crawler | 1 | 57.50 KB | 25 Nov 2018 - 17:34 |
| lwp-trivial | 1 | 57.20 KB | 20 Nov 2018 - 17:15 |
|