Telling the humans from the bots — across 40 live websites. Right now.
Visitors yesterday
3,410
real · referred + return
Page views yesterday
5,505
served to humans
Bots filtered yesterday
57,367
spiders · unknown · blocked
Who’s really visiting · yesterday, across the fleet
11,652 human18,713 good crawlers (Google, Bing… welcomed)38,654 bad bots blocked · 83% non-human
The dyad — two views of the same traffic · yesterday
69,019
Requests the servers saw
8,482
Human pages (server log)
5,505
Human pages (JS beacon)
35%
Difference
24 Jul
25
26
27
28
29
30
31
1 Aug
2
3
4
5
6
beacon page viewsserver-log human pages
Both count the same thing — human page requests — measured two ways. The server log uses our corpus only, so a bot that behaves like a browser is counted as human. The JS beacon needs JavaScript, so it misses visitors who don’t run it. The real figure is between the two: the gap is an upper bound on behavioural bots, not a count. Assets, and the 83% that wasn’t human, don’t reach a JavaScript tracker.
Who’s crawling the network — last 30 days
OpenAI is the busiest crawler here: 58% of all crawler requests, more than 3× the next. Google is 4th.
OpenAI / ChatGPT692,099
Petal Search195,455
Bing119,096
Google45,761
ByteDance39,039
Amazon37,150
TikTok14,372
Serpstat13,736
Apple7,760
ClaudeBot5,514
1,184,185 crawler visits classified · welcomed, never counted as human traffic
What our humans browse with — last 30 days
Chrome69%
Safari22%
Firefox8%
Internet Explorer0%
Other0%
Opera0%
share of 236,179 classified human page views
Where our humans come from — last 30 days
fewermore visitors
🇬🇧 United Kingdom59%
🇺🇸 United States8%
🇨🇳 China8%
🇳🇱 Netherlands5%
🇸🇪 Sweden4%
🇩🇪 Germany3%
🇮🇳 India1%
🇸🇬 Singapore1%
🇫🇷 France1%
🇷🇺 Russia1%
🇷🇴 Romania1%
🇨🇦 Canada1%
top countries by unique engaged visitors · geolocated (DB-IP), CDN/cloud excluded · map: simple-world-map (CC BY-SA)
Defenses — the curated corpus
99
IP bans
217
Referrer rules
390
User-agent rules
191
URI rules
897 live block rules · and 300 search engines & 310 crawler signatures & 58 browsers classified.
Firewall — attacks blocked, last 30 days
1,963
Attacks blocked
1,062
Attacker IPs
828
SSH brute-force
1,135
Web probes
Where attacks come from · 77 countries
🇺🇸 United States213
🇨🇳 China95
🇩🇪 Germany59
🇳🇱 Netherlands47
🇧🇷 Brazil46
🇨🇦 Canada42
🇸🇬 Singapore41
🇮🇩 Indonesia40
🇬🇧 United Kingdom38
🇮🇳 India31
Daily traffic — last 14 days, all sites
24 Jul
25
26
27
28
29
30
31
1 Aug
2
3
4
5
6
visitspage views
live · 40 sites · figures to 6 Aug · page generated 17:18