Telling the humans from the bots — across 40 live websites. Right now.
Visitors yesterday
4,067
real · referred + return
Page views yesterday
12,743
served to humans
Bots filtered yesterday
71,057
spiders · unknown · blocked
Who’s really visiting · yesterday, across the fleet
18,919 human24,378 good crawlers (Google, Bing… welcomed)46,679 bad bots blocked · 79% non-human
The dyad — two views of the same traffic · yesterday
89,976
Requests the servers saw
16,329
Human pages (server log)
12,743
Human pages (JS beacon)
22%
Difference
30 Jul
31
1 Aug
2
3
4
5
6
7
8
9
10
11
12
beacon page viewsserver-log human pages
Both count the same thing — human page requests — measured two ways. The server log uses our corpus only, so a bot that behaves like a browser is counted as human. The JS beacon needs JavaScript, so it misses visitors who don’t run it. The real figure is between the two: the gap is an upper bound on behavioural bots, not a count. Assets, and the 79% that wasn’t human, don’t reach a JavaScript tracker.
Who’s crawling the network — last 30 days
OpenAI is the busiest crawler here: 59% of all crawler requests, more than 3× the next. Google is 4th.
OpenAI / ChatGPT713,900
Petal Search198,837
Bing104,278
Google44,277
Amazon42,551
ByteDance38,492
Serpstat14,702
TikTok13,052
Apple7,475
ClaudeBot5,937
1,200,652 crawler visits classified · welcomed, never counted as human traffic
What our humans browse with — last 30 days
Chrome65%
Safari24%
Firefox10%
Internet Explorer0%
Other0%
Opera0%
share of 224,825 classified human page views
Where our humans come from — last 30 days
fewermore visitors
🇬🇧 United Kingdom60%
🇺🇸 United States8%
🇨🇳 China7%
🇳🇱 Netherlands4%
🇸🇪 Sweden4%
🇩🇪 Germany3%
🇮🇳 India1%
🇫🇷 France1%
🇷🇴 Romania1%
🇸🇬 Singapore1%
🇦🇩 Andorra1%
🇨🇦 Canada1%
top countries by unique engaged visitors · geolocated (DB-IP), CDN/cloud excluded · map: simple-world-map (CC BY-SA)
Defenses — the curated corpus
99
IP bans
217
Referrer rules
390
User-agent rules
191
URI rules
897 live block rules · and 300 search engines & 310 crawler signatures & 58 browsers classified.
Firewall — attacks blocked, last 30 days
1,343
Attacks blocked
711
Attacker IPs
135
SSH brute-force
1,208
Web probes
Where attacks come from · 50 countries
🇺🇸 United States189
🇩🇪 Germany46
🇳🇱 Netherlands37
🇬🇧 United Kingdom35
🇨🇦 Canada34
🇦🇩 Andorra26
🇵🇱 Poland25
🇨🇭 Switzerland25
🇸🇬 Singapore25
🇳🇴 Norway23
Daily traffic — last 14 days, all sites
30 Jul
31
1 Aug
2
3
4
5
6
7
8
9
10
11
12
visitspage views
live · 40 sites · figures to 12 Aug · page generated 06:50