| 139 different robots | Hits | Bandwidth | Last visit |
|---|
| Adsbot | 36,587 | 4.46 GB | 31 Dec 2020 - 19:27 |
| bingbot | 23,811 | 2.94 GB | 31 Dec 2020 - 23:58 |
| Googlebot | 15,412 | 955.73 MB | 31 Dec 2020 - 23:32 |
| Googlebot-Image | 13,005 | 294.97 MB | 31 Dec 2020 - 23:26 |
| SeznamBot | 11,702 | 199.45 MB | 31 Dec 2020 - 23:37 |
| AhrefsBot | 11,444 | 920.18 MB | 31 Dec 2020 - 21:19 |
| PetalBot | 10,592 | 411.88 MB | 31 Dec 2020 - 23:59 |
| DotBot | 8,075 | 1014.72 MB | 31 Dec 2020 - 22:22 |
| SemrushBot | 7,924 | 60.99 MB | 30 Dec 2020 - 15:36 |
| MSIE 6 - ( Rogue Robot ) | 6,134 | 158.55 MB | 31 Dec 2020 - 23:44 |
| The Knowledge AI | 4,925 | 53.08 MB | 28 Dec 2020 - 13:34 |
| YandexImages | 4,832 | 207.94 MB | 31 Dec 2020 - 16:51 |
| YandexBot | 3,893 | 559.82 MB | 31 Dec 2020 - 07:47 |
| Applebot | 2,223 | 56.92 MB | 31 Dec 2020 - 17:41 |
| AlphaBot | 2,183 | 140.99 MB | 10 Jun 2020 - 13:58 |
| empty user agent string | 2,138 | 65.46 MB | 30 Dec 2020 - 00:55 |
| Firefox version 10 and lower - various robots | 1,686 | 7.68 MB | 22 Dec 2020 - 20:44 |
| seokicks.de | 1,618 | 22.17 MB | 21 Dec 2020 - 01:35 |
| crawl | 1,451 | 53.85 MB | 25 Dec 2020 - 19:11 |
| MJ12bot | 1,431 | 11.36 MB | 31 Dec 2020 - 23:50 |
| facebookexternalhit | 1,413 | 196.44 MB | 31 Dec 2020 - 11:43 |
| BLEXBot | 1,213 | 13.30 MB | 27 Dec 2020 - 05:59 |
| link | 1,130 | 69.51 MB | 09 Nov 2020 - 03:09 |
| BingPreview | 1,089 | 1.05 GB | 30 Dec 2020 - 10:49 |
| panscient | 1,001 | 10.40 MB | 22 Dec 2020 - 13:43 |
| msnbot | 988 | 191.16 MB | 30 Apr 2020 - 18:57 |
| Pinterestbot | 962 | 39.28 MB | 31 Dec 2020 - 21:32 |
| Sogou web spider | 891 | 11.44 MB | 31 Dec 2020 - 23:49 |
| Barkrowler | 888 | 7.93 MB | 24 Dec 2020 - 22:06 |
| Apache-HttpClient | 854 | 3.27 MB | 12 Dec 2020 - 19:28 |
| coccoc | 745 | 8.21 MB | 31 Dec 2020 - 19:27 |
| Lightspeed | 740 | 14.41 MB | 14 Dec 2020 - 21:12 |
| DuckDuckBot-Https | 661 | 6.97 MB | 29 Jun 2020 - 12:28 |
| Mail.RU Bot | 661 | 53.17 MB | 31 Dec 2020 - 19:31 |
| MSIE 5 - ( Rogue Robot ) | 586 | 153.63 MB | 31 Dec 2020 - 09:08 |
| python | 564 | 79.62 MB | 29 Dec 2020 - 04:02 |
| DuckDuckGo-Favicons-Bot | 427 | 2.30 MB | 31 Dec 2020 - 04:45 |
| linkwalker | 421 | 4.86 MB | 15 Oct 2020 - 07:25 |
| dataprovider.com | 418 | 9.70 MB | 13 Dec 2020 - 06:32 |
| mozilla/5.0 - ( Rogue Robot ) | 414 | 3.08 MB | 16 Nov 2020 - 01:47 |
| Java ( catchall ) | 407 | 16.07 MB | 01 Oct 2020 - 03:31 |
| PhantomJS | 401 | 8.20 MB | 18 Dec 2020 - 15:33 |
| DomainStatsBot | 390 | 14.85 MB | 23 Dec 2020 - 00:53 |
| 360Spider | 339 | 1.83 MB | 31 Dec 2020 - 05:24 |
| Go-http-client | 327 | 36.90 MB | 30 Dec 2020 - 00:15 |
| IndeedBot | 283 | 2.79 MB | 17 Jan 2020 - 07:46 |
| MegaIndex.ru | 255 | 3.20 MB | 29 Dec 2020 - 16:15 |
| Wget | 246 | 24.89 MB | 31 Dec 2020 - 10:25 |
| CCBot | 246 | 4.44 MB | 02 Dec 2020 - 00:26 |
| scrapy | 245 | 6.79 MB | 13 Oct 2020 - 19:57 |
| Nautic Expo using Firefox/1.5 | 238 | 100.37 KB | 26 Nov 2020 - 07:22 |
| GarlikCrawler | 212 | 21.07 MB | 13 Nov 2020 - 02:43 |
| Unknown robot identified by bot\* | 194 | 5.63 MB | 24 Dec 2020 - 20:26 |
| nbot | 194 | 1.99 MB | 26 Dec 2020 - 21:43 |
| favicon | 153 | 966.26 KB | 31 Dec 2020 - 18:49 |
| CheckMarkNetwork | 150 | 852.74 KB | 31 Oct 2020 - 04:16 |
| Baiduspider | 146 | 1.06 MB | 31 Dec 2020 - 20:47 |
| Deepnet Explorer | 145 | 3.96 MB | 29 Dec 2020 - 06:29 |
| ltx71 | 120 | 14.27 MB | 20 Dec 2020 - 09:08 |
| MauiBot | 120 | 1.47 MB | 21 May 2020 - 15:44 |
| daum | 118 | 35.47 MB | 05 Sep 2020 - 08:12 |
| Nimbostratus-Bot | 113 | 1.68 MB | 29 Dec 2020 - 10:35 |
| Baiduspider ( catchall ) | 102 | 1020.37 KB | 25 Dec 2020 - 02:17 |
| Dalvik | 84 | 195.75 MB | 31 Dec 2020 - 14:44 |
| MSIE 2 - ( Rogue Robot ) | 79 | 1.18 MB | 30 Nov 2020 - 16:02 |
| YandexImageResizer | 78 | 12.97 MB | 27 Dec 2020 - 01:06 |
| Python-urllib | 76 | 9.32 MB | 21 Dec 2020 - 09:27 |
| MSIECrawler | 75 | 1.12 MB | 31 Dec 2020 - 06:31 |
| MojeekBot | 70 | 1.18 MB | 28 Dec 2020 - 18:53 |
| yahoocachesystem | 69 | 9.16 MB | 02 Dec 2020 - 15:19 |
| Curl | 68 | 703.79 KB | 29 Dec 2020 - 08:28 |
| motor | 68 | 1.04 MB | 04 Dec 2020 - 12:21 |
| ia_archiver | 68 | 2.74 MB | 14 Nov 2020 - 13:05 |
| Mozilla Beta (Windows) - ( Rogue Robot ) | 64 | 976.89 KB | 01 Dec 2020 - 11:53 |
| Windows 95 - ( Rogue Robot ) | 53 | 809.01 KB | 31 Dec 2020 - 17:17 |
| netEstate NE Crawler | 53 | 658.60 KB | 08 Oct 2020 - 00:33 |
| Bytespider | 53 | 392.99 KB | 23 Dec 2020 - 11:57 |
| tracemyfile | 51 | 2.21 MB | 16 Sep 2020 - 11:37 |
| linkdexbot | 50 | 298.64 KB | 23 Nov 2020 - 22:53 |
| DuckDuckBot | 48 | 15.33 MB | 20 Dec 2020 - 15:58 |
| spider | 46 | 1.52 MB | 09 Dec 2020 - 23:02 |
| Babya Discoverer | 41 | 625.60 KB | 16 Oct 2020 - 10:05 |
| core | 41 | 80.97 MB | 16 Nov 2020 - 11:16 |
| BW | 40 | 245.01 KB | 01 Dec 2020 - 07:27 |
| netcraft | 37 | 198.45 KB | 31 Dec 2020 - 07:42 |
| YandexMobileBot | 33 | 228.64 KB | 12 Aug 2020 - 08:50 |
| robot | 32 | 193.30 KB | 31 Oct 2020 - 22:15 |
| MSIE 4 - ( Rogue Robot ) | 30 | 457.61 KB | 29 Dec 2020 - 00:05 |
| vse | 27 | 392.73 KB | 17 Aug 2020 - 14:08 |
| MSIE 3 - ( Rogue Robot ) | 26 | 396.69 KB | 25 Oct 2020 - 12:23 |
| Unknown robot identified by \*bot | 21 | 115.80 KB | 02 Dec 2020 - 06:57 |
| yeti | 20 | 177.64 KB | 26 Nov 2020 - 14:32 |
| KomodiaBot | 14 | 1.31 MB | 24 Aug 2020 - 20:58 |
| trendiction | 14 | 517.56 KB | 06 Nov 2020 - 21:20 |
| TweetmemeBot | 14 | 184.91 KB | 26 Nov 2020 - 14:09 |
| Cliqzbot | 13 | 3.56 MB | 08 Jul 2020 - 15:05 |
| msie8 - ( Rogue Robot ) | 12 | 129.84 KB | 15 Sep 2020 - 21:20 |
| SurdotlyBot | 11 | 60.68 KB | 16 Dec 2020 - 19:28 |
| AdIdxBot Microsoft Ad Quality control | 11 | 11.82 MB | 17 Dec 2020 - 12:02 |
| crawler4j | 11 | 17.13 KB | 16 Sep 2020 - 22:52 |
| ips-agent | 9 | 40.51 KB | 02 Nov 2020 - 19:01 |
| CFNetwork | 9 | 6.32 MB | 17 Nov 2020 - 16:05 |
| Yandex ( catchall ) | 6 | 608.45 KB | 04 Jun 2020 - 16:07 |
| facebook | 5 | 159.82 KB | 06 Oct 2020 - 20:54 |
| linkbot | 5 | 32.60 KB | 30 Oct 2020 - 07:41 |
| Yahoo! Slurp | 5 | 75.29 KB | 10 Sep 2020 - 03:31 |
| wordpress | 4 | 0 | 06 Nov 2020 - 19:42 |
| Mozilla ( Rogue Robot ) | 4 | 122.30 KB | 16 Sep 2020 - 15:14 |
| ubermetrics-technologies.com | 4 | 5.53 KB | 06 Nov 2020 - 13:41 |
| Screaming Frog SEO Spider | 3 | 19.06 KB | 21 Jun 2020 - 14:56 |
| Discordbot | 3 | 104.79 KB | 08 Jul 2020 - 01:45 |
| checker | 3 | 36.02 KB | 18 Aug 2020 - 15:48 |
| proximic | 3 | 64.74 KB | 16 Aug 2020 - 14:56 |
| IonCrawl | 3 | 4.87 KB | 28 Dec 2020 - 19:01 |
| fastcrawler | 2 | 164.70 KB | 10 Jun 2020 - 09:43 |
| Yahoo Link Preview | 2 | 57.74 KB | 03 Sep 2020 - 23:18 |
| adscanner | 2 | 249.88 KB | 16 Jan 2020 - 21:12 |
| anthill | 2 | 96.02 KB | 03 Dec 2020 - 19:05 |
| techbot | 2 | 7.98 KB | 10 Jul 2020 - 02:52 |
| Velen | 2 | 11.02 KB | 12 Apr 2020 - 22:51 |
| y!j | 2 | 11.02 KB | 17 Apr 2020 - 00:11 |
| TelegramBot | 2 | 3.37 MB | 02 Apr 2020 - 08:30 |
| LinkCheck | 1 | 15.28 KB | 04 Sep 2020 - 04:28 |
| scanner | 1 | 5.53 KB | 07 Oct 2020 - 12:49 |
| checkbot | 1 | 15.25 KB | 26 May 2020 - 06:11 |
| nutch ( catchall ) | 1 | 53.90 KB | 11 Aug 2020 - 16:27 |
| yak-linkfluence | 1 | 8.44 KB | 07 Nov 2020 - 00:27 |
| GrapeshotCrawler | 1 | 53.90 KB | 11 Aug 2020 - 11:22 |
| CUBOT | 1 | 7.16 KB | 14 Mar 2020 - 19:04 |
| Microsoft Office Protocol Discovery | 1 | 0 | 16 Nov 2020 - 04:22 |
| Konqueror | 1 | 2.47 KB | 12 Nov 2020 - 16:56 |
| octopus | 1 | 15.48 KB | 20 Jul 2020 - 14:28 |
| Links ( | 1 | 2.47 KB | 27 Dec 2020 - 21:40 |
| Exabot | 1 | 5.53 KB | 11 Sep 2020 - 15:21 |
| qwantify | 1 | 15.25 KB | 30 Mar 2020 - 17:02 |
| Xenu Link Sleuth | 1 | 15.25 KB | 20 Mar 2020 - 05:11 |
| webcollage | 1 | 105.56 KB | 15 Jul 2020 - 00:35 |
| Mediapartners-Google | 1 | 22.12 KB | 13 Aug 2020 - 01:30 |
| internetarchive | 1 | 0 | 06 Jan 2020 - 08:26 |
|