Robots Txt
78 plugins tagged with robots-txt
WP Robots Txt
WP Robots Txt Allows you to edit the content of your robots.txt file.
Virtual Robots.txt
Virtual Robots.txt automatically creates a robots.txt file for your site. Your robots.txt file can be easily edited from the plugin settings page.
Robots.txt Editor
Robots.txt for WordPress
Better Robots.txt – AI-Ready Crawl Control & Bot Governance
Replace the default WordPress robots.txt workflow with a smarter, structured version you can preview before publishing, with Free, Pro, and Premium ed …
Block AI Crawlers
Adds robots.txt rules blocking AI crawlers and AI bots.
Multipart robots.txt editor
Customize your site's robots.txt and include remote content to it
Robots.txt rewrite
Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
Magic robots.txt
This plugin automatically creates a robots.txt analyzing your site to improve your Google ranking and site performance.
Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral Traffic
Track crawlers, scrapers, LLM assistants, and AI agents on your website. Generate a robots.txt that blocks AI bots. Formerly Dark Visitors.
Robots.txt Quick Editor
Plugin to edit robots.txt file
AI Content Signals
Control how AI uses your content — search, AI answers or training — via robots.txt Content Signals, HTTP headers, meta tags and TDMRep.
Admin Robots.txt Editor
Easily create, edit, and manage your site's robots.txt file directly from the WordPress admin panel.
Search engines blocked warning
Shows a warning in the WordPress administration header when the option "Search Engine Visibility: Discourage search engines from indexing this si …
Block Archive.org via WordPress robots.txt
Blocks the archive.org bots through the WordPress virtual robots.txt file.
Bisteinoff SEO Robots.txt
An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).
AI Scrape Protect
Protect your website from AI scraping by adding opt-out instructions to your robots.txt file and including meta tags in the HTML ``.
iRobots.txt SEO
iRobots.txt SEO is a SEO optimized, secure and customizable robots.txt virtual file creator.
Block Chat GPT via robots.txt
Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file
Robots Meta Whiz
Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.
MetaRobots by SEO-Sign
The easiest way to manage meta robots tag.
Block eCommerce Assets via robots.txt
Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
Check Search Engine Visibility on Migration
Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
Forge AI Bot Log – Block AI Bots, Crawler Detection & Verification
Detect, verify and block AI crawlers, bots and scrapers. Vendor IP lists and reverse-DNS checks flag spoofed user agents, not trust them.
Unblock CSS & JS for Googlebot
Modifies robots.txt to allow Googlebot access JS and CSS files.