🎉 Use coupon MYXERO to enjoy 20% recurring discount on any plan. View Pricing
XeroWP

Robots Txt

48 plugins tagged with robots-txt

WP Robots Txt

WP Robots Txt

WP Robots Txt Allows you to edit the content of your robots.txt file.

5 50K+ 554K+
Virtual Robots.txt

Virtual Robots.txt

Virtual Robots.txt automatically creates a robots.txt file for your site. Your robots.txt file can be easily edited from the plugin settings page.

4.3 50K+ 445K+
Robots.txt Editor

Robots.txt Editor

Robots.txt for WordPress

4.5 10K+ 118K+
Better Robots.txt – AI-Ready Crawl Control & Bot Governance

Better Robots.txt – AI-Ready Crawl Control & Bot Governance

Replace the default WordPress robots.txt workflow with a smarter, structured version you can preview before publishing, with Free, Pro, and Premium ed …

4.5 6K+ 311K+
Multipart robots.txt editor

Multipart robots.txt editor

Customize your site's robots.txt and include remote content to it

3.3 2K+ 56K+
Block AI Crawlers

Block AI Crawlers

Tell AI (Artificial Intelligence) companies not to scrape your site for their AI products.

4.8 1K+ 14K+
Robots.txt rewrite

Robots.txt rewrite

Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

5 1K+ 36K+
Magic robots.txt

Magic robots.txt

This plugin automatically creates a robots.txt analyzing your site to improve your Google ranking and site performance.

5 1K+ 10K+
Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral Traffic

Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral Traffic

Track crawlers, scrapers, LLM assistants, and AI agents on your website. Generate a robots.txt that blocks AI bots. Formerly Dark Visitors.

4.8 1K+ 18K+
Robots.txt Quick Editor

Robots.txt Quick Editor

Plugin to edit robots.txt file

5 900 7K+
Block Archive.org via WordPress robots.txt

Block Archive.org via WordPress robots.txt

Blocks the archive.org bots through the WordPress virtual robots.txt file.

500 7K+
Search engines blocked warning

Search engines blocked warning

Shows a warning in the WordPress administration header when the option "Search Engine Visibility: Discourage search engines from indexing this si …

500 3K+
Bisteinoff SEO Robots.txt

Bisteinoff SEO Robots.txt

An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

5 500 10K+
AI Content Signals

AI Content Signals

Control how AI crawlers use your content with Cloudflare Content Signals in robots.txt. Includes EU Directive 2019/790 rights reservation.

5 400 2K+
i

iRobots.txt SEO

iRobots.txt SEO is a SEO optimized, secure and customizable robots.txt virtual file creator.

5 300 34K+
Admin Robots.txt Editor

Admin Robots.txt Editor

Easily create, edit, and manage your site's robots.txt file directly from the WordPress admin panel.

5 200 759
AI Scrape Protect

AI Scrape Protect

Protect your website from AI scraping by adding opt-out instructions to your robots.txt file and including meta tags in the HTML `` with this easy-to- …

4.7 200 3K+
R

Robots Meta Whiz

Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.

100 5K+
Block Chat GPT via robots.txt

Block Chat GPT via robots.txt

Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

5 100 2K+
M

MetaRobots by SEO-Sign

The easiest way to manage meta robots tag.

5 100 5K+
Block eCommerce Assets via robots.txt

Block eCommerce Assets via robots.txt

Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

100 3K+
Check Search Engine Visibility on Migration

Check Search Engine Visibility on Migration

Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.

5 80 5K+
AI Deny

AI Deny

Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

5 60 1K+
U

Unblock CSS & JS for Googlebot

Modifies robots.txt to allow Googlebot access JS and CSS files.

50 3K+