HS3Dev AI Content Index for llms.txt

HS3Dev AI Content Index for llms.txt allows WordPress site owners to automatically generate structured llms.txt and llms-full.txt files for AI systems and large language model crawlers.

It provides full control over included content, supports SEO meta integration, multilingual setups, and ensures safe performance even on large websites through batch processing.

Developed by Mirza Hadi (HS3Dev).

Features

• Generate llms.txt and llms-full.txt files dynamically (no physical file required)
• Select content by post type or individual posts/pages/products
• Include/exclude specific URLs manually
• SEO plugin integration (Yoast, RankMath, AIOSEO, SEOPress)
• Page-builder safe content extraction
• Compatibility mode for live URL content fetching
• Batched generation for large websites
• Auto-regeneration via WP-Cron (on save, daily, weekly)
• AI crawler analytics (GPTBot, ClaudeBot, PerplexityBot, etc.)
• Multilingual support (WPML / Polylang)
• Multisite compatible
• Conflict detection and diagnostics tools