CrawlWatch – AI Bot Insights
Overview dashboard with AI hits, bots, referrals and readiness score.
CrawlWatch shows you the invisible traffic: GPTBot, ClaudeBot, PerplexityBot, Google-Extended and 40+ AI crawlers visiting your WordPress site.
Read the llms.txt guide — what llms.txt is, the exact format that works, and the mistakes that make one useless · AI bot traffic in WordPress — how to see it, measure it, and decide what to do about it · Plugin page · Development on GitHub — report issues or contribute.
- AI bot hits + which URLs they read
- AI referrals (visitors coming from ChatGPT, Perplexity, Gemini, Claude)
- One-click llms.txt + ai.txt generator
- robots.txt allow/block per AI bot (preview, no code)
- Readiness Score 0-100 with ranked Quick Wins
- 100% free, no upsell. Data stays on your server. IPs are hashed, never stored raw.
No API key. No external service in V1. Lightweight: normal visitors cause zero extra queries.
External services
None. CrawlWatch talks to no third-party service — the only HTTP requests it makes are loopback fetches of your own posts for the on-demand schema scan. Everything is stored and computed on your own server.
Privacy
CrawlWatch logs AI crawler visits locally: time, bot name, visited URL, referrer domain, truncated user-agent, and SHA-256 hashed IP (IPv4 last octet and IPv6 /64 anonymized before hashing). Raw IPs are never stored. Retention is configurable (default 30 days) and all data is deleted on uninstall if enabled in Settings. No visitor data leaves your site.