59 different robots | Hits | Bandwidth | Last visit |
MJ12bot | 188,048+1443 | 665.55 MB | 31 May 2018 - 03:19 |
AhrefsBot | 99,271+58 | 772.27 MB | 31 May 2018 - 03:19 |
Unknown robot (identified by empty user agent string) | 78,156+7 | 6.01 GB | 31 May 2018 - 03:19 |
SemrushBot | 77,098+617 | 814.79 MB | 31 May 2018 - 03:19 |
Unknown robot (identified by 'crawl') | 34,346+12 | 407.96 MB | 28 May 2018 - 01:16 |
Googlebot | 29,670+60 | 2.14 GB | 31 May 2018 - 03:19 |
Bingbot | 16,727+158 | 1.29 GB | 31 May 2018 - 03:17 |
DotBot, Open Site Explorer | 2,544+3512 | 221.42 MB | 31 May 2018 - 03:15 |
Python-urllib | 4,798+2 | 334.11 MB | 30 May 2018 - 11:29 |
Googlebot-Image | 4,490 | 197.24 MB | 31 May 2018 - 03:17 |
Bing Preview bot | 4,131 | 164.42 MB | 31 May 2018 - 02:23 |
SEOprofiler Bot | 1,990+2 | 16.92 MB | 17 May 2018 - 06:30 |
Yandex Bot | 1,011+267 | 18.44 MB | 31 May 2018 - 01:40 |
FaceBook bot | 516 | 33.12 MB | 31 May 2018 - 01:26 |
Java (Often spam bot) | 421 | 13.90 MB | 29 May 2018 - 00:04 |
Common Crawl | 402+7 | 3.22 MB | 27 May 2018 - 19:43 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 260+34 | 334.31 MB | 31 May 2018 - 02:21 |
yeti | 266+1 | 3.53 MB | 30 May 2018 - 02:29 |
FavIconizer | 197 | 2.36 MB | 30 May 2018 - 23:05 |
Site Explorer | 159+25 | 1.40 MB | 30 May 2018 - 02:12 |
Mail.ru bot | 87+84 | 1.30 MB | 30 May 2018 - 07:37 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 155 | 16.91 MB | 19 May 2018 - 23:19 |
Cliqzbot | 92+22 | 981.01 KB | 30 May 2018 - 23:49 |
Google Web Preview | 107 | 2.32 MB | 12 May 2018 - 13:58 |
ltx71 | 10+84 | 2.96 MB | 27 May 2018 - 11:40 |
Phantom | 66 | 574.94 KB | 10 May 2018 - 01:07 |
Unknown robot (identified by hit on 'robots.txt') | 0+64 | 62.95 KB | 30 May 2018 - 02:05 |
SeznamBot | 27+31 | 43.34 KB | 29 May 2018 - 16:08 |
Linkdex | 35+11 | 527.15 KB | 30 May 2018 - 11:20 |
360spider | 31+4 | 408.01 KB | 30 May 2018 - 05:06 |
Feedfetcher-Google | 35 | 93.29 KB | 31 May 2018 - 01:21 |
SEOkicks Webcrawler | 21+3 | 623.34 KB | 25 May 2018 - 02:46 |
Dataprovider Site Explorer | 22+2 | 912.88 KB | 25 May 2018 - 05:03 |
Nutch | 12+11 | 164.30 KB | 25 May 2018 - 06:07 |
Unknown robot (identified by 'robot') | 0+18 | 21.34 KB | 26 May 2018 - 18:35 |
BaiDuSpider | 10+5 | 2.71 MB | 28 May 2018 - 19:12 |
MSIECrawler | 14 | 305.66 KB | 29 May 2018 - 19:09 |
Unknown robot (identified by 'spider') | 13 | 34.05 MB | 16 May 2018 - 22:17 |
Powermarks | 11 | 236.40 KB | 30 May 2018 - 15:10 |
ips-agent Verisign(?) - no reliable information found. | 10+1 | 468.03 KB | 13 May 2018 - 19:37 |
Unknown robot (identified by 'checker') | 5+4 | 69.78 KB | 10 May 2018 - 20:38 |
Proximic Spider | 0+8 | 9.95 KB | 30 May 2018 - 19:39 |
Exabot | 5+3 | 45.74 KB | 29 May 2018 - 12:27 |
Heritrix | 0+5 | 6.02 KB | 23 May 2018 - 12:38 |
WGet tools | 4 | 290.05 KB | 29 May 2018 - 15:43 |
Sogou Spider | 0+4 | 4.82 KB | 01 May 2018 - 08:08 |
Microsoft Office Protocol Discovery/Microsoft Office Existence Discovery | 3 | 73.17 KB | 08 May 2018 - 19:02 |
CFNetwork | 3 | 132.36 KB | 02 May 2018 - 20:25 |
Suspected bot masqurading as Mozilla | 3 | 0 | 21 May 2018 - 14:37 |
James BOT | 3 | 151.15 KB | 03 May 2018 - 11:42 |
Common *nix tool for automating web document retireval. Most likely a bot. | 2 | 1.66 KB | 28 May 2018 - 15:33 |
MojeekBot | 1+1 | 13.71 KB | 26 May 2018 - 20:47 |
Perl tool | 2 | 145.81 KB | 22 May 2018 - 20:37 |
archive.org bot | 0+2 | 1.59 KB | 11 May 2018 - 21:17 |
Netcraft | 2 | 77.73 KB | 04 May 2018 - 00:12 |
Jakarta commons-httpclient | 1 | 27.26 MB | 27 May 2018 - 22:18 |
A PHP script | 1 | 69.78 KB | 07 May 2018 - 17:21 |
Sift | 1 | 15.79 KB | 11 May 2018 - 15:42 |
Web Core / Roots | 1 | 13.06 KB | 12 May 2018 - 05:04 |
|