Ai Crawlers
4 plugins tagged with ai-crawlers
Better Robots.txt – AI-Ready Crawl Control & Bot Governance
Replace the default WordPress robots.txt workflow with a smarter, structured version you can preview before publishing, with Free, Pro, and Premium ed …
4.5 6K+ 315K+
A
AI Crawler and SEO Manager by akbansa
The AI Crawler and SEO Manager by akbansa plugin generates an llms.txt file for crawler discovery and logs visits by AI-based crawlers such as GPTBot, …
— 326
GetCited — AI Visibility
Optimize for AI search. The AI visibility plugin — manage crawlers, generate llms.txt, track citability.
— 288
Agentimus
See which AI agents read your site and block the bad ones — plus llms.txt, crawl controls and a /.well-known discovery layer. AI agent readiness.
— 80