User-agent & AI crawler patterns
Catches search engine crawlers, headless browsers, SEO and monitoring tools, script and framework HTTP clients — and the growing wave of AI crawlers and agents.
Bot Detection
Five detection layers filter crawlers, scrapers, headless browsers, and AI agents before they pollute your data. And unlike silent filters, Rybbit shows you everything it blocked.
7-day free trial. Cancel anytime.
Live bot report — real bot traffic detected and filtered on this site
Bot Detection
Capabilities
Catches search engine crawlers, headless browsers, SEO and monitoring tools, script and framework HTTP clients — and the growing wave of AI crawlers and agents.
Header heuristics and client-side signals expose bots that fake a browser user-agent: missing browser headers, automation APIs, impossible window dimensions, empty plugin lists, and headless renderers.
Curated ASNs of known AI, scanner, and measurement providers trigger detection directly. Generic hosting ASNs only count as supporting evidence — so visitors on VPNs, corporate gateways, and CDNs aren't falsely flagged.
Rolling windows catch crawl-shaped behavior: bursts from one IP, rapid path fan-out, rotating user-agents, and replayed tracking requests that pass every other check.
See everything that was filtered: total blocked requests, bot share of traffic, trends over time, and breakdowns by page, referrer, country, device, and user-agent — with the exact detection layers that matched.
Detected bot visits don't count toward your usage. You're not paying for GPTBot to crawl your docs or a scraper to hammer your product pages.
Getting Started
Flip one toggle in Site Settings. Bot detection is configured per site, and there's nothing to change in your tracking script.
User-agent patterns, header heuristics, client signals, ASN checks, and rate anomaly detection all run on every incoming tracking request. Rybbit records every layer that matched, then makes one final decision.
Detected bots never touch your normal analytics — dashboards, funnels, journeys, and session lists stay human-only. A compact bot event record is stored separately so nothing disappears silently.
Open the Bots page in your dashboard to audit what was blocked and why. Server-side events sent with an API key are treated as trusted and bypass detection entirely.
Use Cases
Bounce rate, conversion rate, and campaign ROI all break when bots inflate the denominator. Clean traffic means decisions based on humans.
Price scrapers and inventory bots hit product pages constantly. Filter them out so product analytics reflect real shoppers.
AI crawlers now rival search engines in crawl volume. See exactly which bots are reading your content — without them polluting your stats.
Launch-day traffic spikes bring uptime monitors, link previewers, and scrapers along. Know how much of that spike was real.
Client reports lose credibility when numbers include bots. Show clients human traffic, and use the Bots report to explain the difference.
Separate crawler activity from organic visitors, and verify which crawlers actually visit your site and how often.
FAQ
Explore More
Five-layer detection, full visibility into what was filtered, and a bill that only counts humans.
7-day free trial. Cancel anytime.