Telling the humans from the bots — across 40 live websites. Right now.
Visitors yesterday
3,889
real · referred + return
Page views yesterday
8,276
served to humans
Bots filtered yesterday
61,607
spiders · unknown · blocked
Who’s really visiting · yesterday, across the fleet
15,598 human27,885 good crawlers (Google, Bing… welcomed)33,722 bad bots blocked · 80% non-human
The dyad — two views of the same traffic · yesterday
77,205
Requests the servers saw
11,756
Human pages (server log)
8,276
Human pages (JS beacon)
30%
Difference
29 Jul
30
31
1 Aug
2
3
4
5
6
7
8
9
10
11
beacon page viewsserver-log human pages
Both count the same thing — human page requests — measured two ways. The server log uses our corpus only, so a bot that behaves like a browser is counted as human. The JS beacon needs JavaScript, so it misses visitors who don’t run it. The real figure is between the two: the gap is an upper bound on behavioural bots, not a count. Assets, and the 80% that wasn’t human, don’t reach a JavaScript tracker.
Who’s crawling the network — last 30 days
OpenAI is the busiest crawler here: 59% of all crawler requests, more than 3× the next. Google is 4th.
OpenAI / ChatGPT712,497
Petal Search198,759
Bing108,153
Google45,912
Amazon41,571
ByteDance39,626
Serpstat14,431
TikTok13,538
Apple7,281
ClaudeBot5,663
1,204,226 crawler visits classified · welcomed, never counted as human traffic
What our humans browse with — last 30 days
Chrome66%
Safari25%
Firefox9%
Internet Explorer0%
Other0%
Opera0%
share of 217,622 classified human page views
Where our humans come from — last 30 days
fewermore visitors
🇬🇧 United Kingdom60%
🇺🇸 United States8%
🇨🇳 China7%
🇳🇱 Netherlands4%
🇸🇪 Sweden4%
🇩🇪 Germany3%
🇮🇳 India1%
🇫🇷 France1%
🇷🇴 Romania1%
🇸🇬 Singapore1%
🇨🇦 Canada1%
🇦🇩 Andorra1%
top countries by unique engaged visitors · geolocated (DB-IP), CDN/cloud excluded · map: simple-world-map (CC BY-SA)
Defenses — the curated corpus
99
IP bans
217
Referrer rules
390
User-agent rules
191
URI rules
897 live block rules · and 300 search engines & 310 crawler signatures & 58 browsers classified.
Firewall — attacks blocked, last 30 days
1,447
Attacks blocked
764
Attacker IPs
246
SSH brute-force
1,201
Web probes
Where attacks come from · 52 countries
🇺🇸 United States196
🇩🇪 Germany49
🇬🇧 United Kingdom38
🇳🇱 Netherlands36
🇨🇦 Canada35
🇨🇳 China31
🇦🇩 Andorra26
🇸🇬 Singapore26
🇧🇷 Brazil26
🇵🇱 Poland25
Daily traffic — last 14 days, all sites
29 Jul
30
31
1 Aug
2
3
4
5
6
7
8
9
10
11
visitspage views
live · 40 sites · figures to 11 Aug · page generated 20:51