Telling the humans from the bots — across 40 live websites. Right now.
Visitors yesterday
3,020
real · referred + return
Page views yesterday
19,571
served to humans
Bots filtered yesterday
109,284
spiders · unknown · blocked
Who’s really visiting · yesterday, across the fleet
97,553 human33,351 good crawlers (Google, Bing… welcomed)75,933 bad bots blocked · 53% non-human
The dyad — two views of the same traffic · yesterday
206,837
Requests the servers saw
32,739
Human pages (server log)
19,571
Human pages (JS beacon)
40%
Difference
25 Oct
26
27
28
29
30
31
1 Nov
2
3
4
5
6
7
beacon page viewsserver-log human pages
Both count the same thing — human page requests — measured two ways. The server log uses our corpus only, so a bot that behaves like a browser is counted as human. The JS beacon needs JavaScript, so it misses visitors who don’t run it. The real figure is between the two: the gap is an upper bound on behavioural bots, not a count. Assets, and the 53% that wasn’t human, don’t reach a JavaScript tracker.
Who’s crawling the network — last 30 days
Petal Search229,706
Bing80,182
Google78,048
Amazon70,929
ByteDance37,831
Exa (exa.ai)37,119
Facebook25,684
OpenAI / ChatGPT23,342
Sonar / Perplexity16,647
Reflection AI12,820
665,958 crawler visits classified · welcomed, never counted as human traffic
What our humans browse with — last 30 days
Chrome85%
Safari11%
Firefox4%
Internet Explorer0%
Other0%
Opera0%
share of 638,810 classified human page views
Where our humans come from — last 30 days
fewermore visitors
🇬🇧 United Kingdom33%
🇺🇸 United States25%
🇳🇱 Netherlands6%
🇩🇪 Germany3%
🇨🇳 China3%
🇸🇪 Sweden2%
🇮🇳 India2%
🇸🇬 Singapore2%
🇫🇷 France2%
🇨🇦 Canada2%
🇧🇷 Brazil1%
🇲🇽 Mexico1%
top countries by unique engaged visitors · geolocated (DB-IP), CDN/cloud excluded · map: simple-world-map (CC BY-SA)
Defenses — the curated corpus
100
IP bans
217
Referrer rules
390
User-agent rules
191
URI rules
898 live block rules · and 306 search engines & 316 crawler signatures & 58 browsers classified.
Firewall — attacks blocked, last 30 days
3,471
Attacks blocked
2,092
Attacker IPs
2,774
SSH brute-force
697
Web probes
Where attacks come from · 95 countries
🇺🇸 United States364
🇨🇳 China286
🇭🇰 Hong Kong123
🇮🇳 India108
🇰🇷 South Korea89
🇻🇳 Vietnam84
🇸🇬 Singapore81
🇮🇩 Indonesia79
🇩🇪 Germany78
🇧🇷 Brazil77
Daily traffic — last 14 days, all sites
25 Oct
26
27
28
29
30
31
1 Nov
2
3
4
5
6
7
visitspage views
live · 40 sites · figures to 7 Nov · page generated 18:33