Generate a robots.txt to Block AI Crawlers Online
Add user-agent rules for AI crawlers like GPTBot and CCBot while keeping normal search engines allowed. Each bot gets the access level you choose.
Robots.txt Generator
Generate robots.txt files for your website with common presets
Block AI Crawlers
Check to add Disallow: / rules for AI bots
Generated robots.txt
URL Tester
Check whether a URL path would be blocked or allowed by your current rules
Quick Start
- 1Add a user-agent block for each AI crawler to block
- 2Set Disallow to the root path for those bots
- 3Keep Googlebot and Bingbot allowed as needed
- 4Copy the robots.txt to your site root
More Generate Tools
All generators →Generate CSS to Center a Div With Flexbox Online
Center any element horizontally and vertically with flexbox. Free online flexbox centering generator with copy-ready CSS.
Generate a Responsive CSS Grid Online
Build a responsive grid with auto-fit and minmax that wraps without media queries. Free online responsive CSS grid generator.
Generate Test Data Online
Generate realistic fake test data with names, emails, phones, and addresses. Free online test data generator with JSON and CSV export.
Generate Mock Data from a SQL Schema
Paste a CREATE TABLE statement and generate realistic mock data that matches your columns. Free online schema-aware mock data generator.
Generate SQL INSERT Statements Online
Generate ready-to-run SQL INSERT statements full of realistic test data. Free online tool for seeding a database from a schema or column builder.
Generate a 301 Redirect for .htaccess
Create Apache .htaccess 301 redirect rules to point old URLs to new ones. Free online 301 redirect generator with copy-ready output.
Looking for FAQs and advanced options? Visit the full Robots.txt Generator page →