85 different robots | Hits | Bandwidth | Last visit |
MJ12bot | 175,983+1408 | 646.39 MB | 30 Apr 2019 - 03:06 |
empty user agent string | 85,898+7 | 6.13 GB | 30 Apr 2019 - 03:31 |
AhrefsBot | 80,057+60 | 504.00 MB | 30 Apr 2019 - 03:33 |
SemrushBot | 77,106+1400 | 688.06 MB | 30 Apr 2019 - 03:33 |
crawl | 47,279+216 | 371.79 MB | 18 Apr 2019 - 22:42 |
MegaIndex.ru | 25,082+1 | 175.05 MB | 14 Apr 2019 - 00:12 |
DomainCrawler | 19,928+2 | 473.32 MB | 26 Apr 2019 - 03:13 |
bingbot | 17,671+190 | 1.84 GB | 30 Apr 2019 - 03:30 |
Googlebot | 7,736+59 | 605.07 MB | 30 Apr 2019 - 02:23 |
DotBot | 860+1714 | 59.39 MB | 30 Apr 2019 - 03:29 |
Googlebot-Image | 2,172 | 96.97 MB | 30 Apr 2019 - 02:36 |
BingPreview | 2,142 | 229.51 MB | 29 Apr 2019 - 23:39 |
MSIE 6 - ( Rogue Robot ) | 801+1 | 36.61 MB | 29 Apr 2019 - 15:32 |
ltx71 | 134+583 | 75.75 MB | 29 Apr 2019 - 17:50 |
Unknown robot identified by bot\* | 588+18 | 7.89 MB | 29 Apr 2019 - 23:31 |
facebookexternalhit | 586 | 38.40 MB | 29 Apr 2019 - 21:09 |
YandexBot | 298+198 | 13.46 MB | 30 Apr 2019 - 03:21 |
Java ( catchall ) | 449 | 18.11 MB | 30 Apr 2019 - 00:57 |
Applebot | 330+117 | 3.25 MB | 30 Apr 2019 - 03:19 |
Baidu ( catchall ) | 381 | 15.71 MB | 29 Apr 2019 - 18:37 |
CCBot | 267+4 | 2.23 MB | 23 Apr 2019 - 02:57 |
Mail.RU Bot | 150+83 | 1.25 GB | 29 Apr 2019 - 15:59 |
archive.org_bot | 152+4 | 2.54 MB | 07 Apr 2019 - 19:00 |
seokicks.de | 128+16 | 992.79 KB | 27 Apr 2019 - 16:28 |
YandexImages | 133 | 3.94 MB | 29 Apr 2019 - 11:28 |
Firefox version 10 and lower - various robots | 115+8 | 4.03 MB | 30 Apr 2019 - 02:58 |
SeznamBot | 56+56 | 7.03 MB | 28 Apr 2019 - 03:30 |
Apache-HttpClient | 107+1 | 1.11 MB | 29 Apr 2019 - 21:15 |
ia_archiver | 84+23 | 4.00 MB | 29 Apr 2019 - 23:24 |
libwww-perl | 105 | 3.84 MB | 27 Apr 2019 - 18:28 |
motor | 100 | 1.47 MB | 22 Apr 2019 - 14:18 |
MSIE 5 - ( Rogue Robot ) | 100 | 6.66 MB | 27 Apr 2019 - 17:40 |
yeti | 92+6 | 1.87 MB | 30 Apr 2019 - 01:34 |
Baiduspider | 93+1 | 30.24 MB | 29 Apr 2019 - 18:37 |
360Spider | 63+10 | 657.39 KB | 29 Apr 2019 - 21:58 |
titan | 72 | 918.15 KB | 18 Apr 2019 - 22:07 |
YandexMobileBot | 67 | 655.04 KB | 28 Apr 2019 - 09:26 |
qwantify | 58+4 | 2.21 MB | 27 Apr 2019 - 07:59 |
smtbot | 60+1 | 547.10 KB | 28 Apr 2019 - 02:52 |
Unknown robot (identified by hit on robots.txt) | 0+60 | 58.13 KB | 29 Apr 2019 - 07:57 |
python | 54 | 40.53 MB | 30 Apr 2019 - 02:59 |
Sogou web spider | 8+43 | 135.03 KB | 29 Apr 2019 - 23:07 |
favicon | 46 | 448.49 KB | 29 Apr 2019 - 15:39 |
Dalvik | 35 | 219.84 MB | 29 Apr 2019 - 12:23 |
Exabot | 20+15 | 2.83 MB | 29 Apr 2019 - 16:31 |
Feedfetcher-Google | 34 | 55.94 KB | 30 Apr 2019 - 01:33 |
DuckDuckGo-Favicons-Bot | 31 | 334.64 KB | 29 Apr 2019 - 14:15 |
zend_http_client | 29 | 156.24 KB | 27 Apr 2019 - 13:44 |
core | 28 | 1.35 MB | 26 Apr 2019 - 14:05 |
Cliqzbot | 15+8 | 176.87 KB | 25 Apr 2019 - 20:51 |
mozilla/5.0 - ( Rogue Robot ) | 20 | 259.25 KB | 29 Apr 2019 - 18:37 |
mozilla/4.0 (compatible;) - ( Rogue Robot ) | 18 | 0 | 28 Apr 2019 - 10:26 |
Uptimebot | 16 | 22.03 KB | 20 Apr 2019 - 14:59 |
Mozilla Beta (Windows) - ( Rogue Robot ) | 15 | 1.16 MB | 16 Apr 2019 - 23:40 |
dataprovider.com | 11+1 | 419.27 KB | 17 Apr 2019 - 14:55 |
MSIE 3 - ( Rogue Robot ) | 12 | 920.64 KB | 27 Apr 2019 - 10:22 |
linkdexbot | 10+1 | 116.10 KB | 06 Apr 2019 - 09:35 |
Python-urllib | 2+8 | 133.57 KB | 28 Apr 2019 - 10:57 |
Babya Discoverer | 9 | 696.48 KB | 28 Apr 2019 - 20:44 |
MSIE 2 - ( Rogue Robot ) | 9 | 744.41 KB | 07 Apr 2019 - 05:09 |
Deepnet Explorer | 9 | 674.13 KB | 23 Apr 2019 - 21:28 |
PhantomJS | 8 | 1.04 MB | 29 Apr 2019 - 22:21 |
GarlikCrawler | 5+1 | 727.34 KB | 18 Apr 2019 - 18:36 |
Windows 95 - ( Rogue Robot ) | 6 | 446.51 KB | 17 Apr 2019 - 02:08 |
Wget | 6 | 492.33 KB | 28 Apr 2019 - 21:56 |
CFNetwork | 6 | 269.96 KB | 13 Apr 2019 - 14:29 |
MSIECrawler | 6 | 472.40 KB | 21 Apr 2019 - 19:18 |
yahoocachesystem | 5 | 1.22 MB | 25 Apr 2019 - 02:33 |
feed | 4 | 14.54 KB | 27 Apr 2019 - 08:49 |
MSIE 4 - ( Rogue Robot ) | 3 | 224.19 KB | 23 Apr 2019 - 16:31 |
Mozilla ( Rogue Robot ) | 3 | 2.41 KB | 19 Apr 2019 - 18:59 |
GrapeshotCrawler | 2+1 | 22.31 KB | 18 Apr 2019 - 08:08 |
nutch ( catchall ) | 1+1 | 11.56 KB | 07 Apr 2019 - 16:41 |
MojeekBot | 1+1 | 11.46 KB | 29 Apr 2019 - 21:16 |
A PHP script | 2 | 102.00 KB | 01 Apr 2019 - 06:18 |
Yandex ( catchall ) | 2 | 297.71 KB | 24 Apr 2019 - 15:18 |
checker | 2 | 114.54 KB | 05 Apr 2019 - 18:13 |
nbot | 2 | 1.38 KB | 13 Apr 2019 - 00:41 |
SafeDNSBot | 1+1 | 11.54 KB | 22 Apr 2019 - 02:29 |
netcraft | 2 | 62.12 KB | 01 Apr 2019 - 20:53 |
SurdotlyBot | 1 | 10.88 KB | 16 Apr 2019 - 04:29 |
Curl | 1 | 57.47 KB | 24 Apr 2019 - 20:25 |
Microsoft Office Protocol Discovery | 1 | 4.58 KB | 19 Apr 2019 - 17:48 |
Validator.nu | 1 | 10.80 KB | 09 Apr 2019 - 22:52 |
istellabot | 0+1 | 752 Bytes | 04 Apr 2019 - 23:37 |
|