Telling the humans from the bots — across 41 live websites. Right now.
Visitors yesterday
2,359
real · referred + return
Page views yesterday
9,732
served to humans
Bots filtered yesterday
79,848
spiders · unknown · blocked
Who’s really visiting · yesterday, across the fleet
39,700 human28,574 good crawlers (Google, Bing… welcomed)51,274 bad bots blocked · 67% non-human
The dyad — two views of the same traffic · yesterday
119,548
Requests the servers saw
35,791
Human pages (server log)
9,732
Human pages (JS beacon)
73%
Difference
10 Sep
11
12
13
14
15
16
17
18
19
20
21
22
23
beacon page viewsserver-log human pages
Both count the same thing — human page requests — measured two ways. The server log uses our corpus only, so a bot that behaves like a browser is counted as human. The JS beacon needs JavaScript, so it misses visitors who don’t run it. The real figure is between the two: the gap is an upper bound on behavioural bots, not a count. Assets, and the 67% that wasn’t human, don’t reach a JavaScript tracker.
Who’s crawling the network — last 30 days
Petal Search223,052
Amazon75,402
Bing68,015
ByteDance44,013
OpenAI / ChatGPT36,841
Google31,533
Apple14,133
Sogou9,391
DataForSEO9,069
Sonar / Perplexity8,689
562,376 crawler visits classified · welcomed, never counted as human traffic
What our humans browse with — last 30 days
Chrome85%
Safari11%
Firefox4%
Internet Explorer0%
Other0%
share of 549,079 classified human page views
Where our humans come from — last 30 days
fewermore visitors
🇬🇧 United Kingdom38%
🇺🇸 United States24%
🇳🇱 Netherlands4%
🇩🇪 Germany3%
🇨🇳 China3%
🇨🇦 Canada2%
🇫🇷 France2%
🇲🇽 Mexico2%
🇵🇱 Poland2%
🇧🇩 Bangladesh2%
🇸🇪 Sweden2%
🇮🇳 India1%
top countries by unique engaged visitors · geolocated (DB-IP), CDN/cloud excluded · map: simple-world-map (CC BY-SA)
Defenses — the curated corpus
100
IP bans
217
Referrer rules
390
User-agent rules
191
URI rules
898 live block rules · and 306 search engines & 316 crawler signatures & 58 browsers classified.
Firewall — attacks blocked, last 30 days
3,291
Attacks blocked
1,964
Attacker IPs
2,152
SSH brute-force
1,139
Web probes
Where attacks come from · 97 countries
🇺🇸 United States342
🇨🇳 China197
🇸🇬 Singapore104
🇭🇰 Hong Kong92
🇮🇳 India89
🇩🇪 Germany87
🇰🇷 South Korea82
🇮🇩 Indonesia71
🇧🇷 Brazil69
🇳🇱 Netherlands66
Daily traffic — last 14 days, all sites
10 Sep
11
12
13
14
15
16
17
18
19
20
21
22
23
visitspage views
live · 41 sites · figures to 23 Sep · page generated 19:12