Step 2 of 10Module 1 — AI Access
AI Robots.txt Generator
Generate a robots.txt that explicitly grants access to AI crawlers — and download it in one click.
+100 pts
Why this matters: An explicit Allow: / for each AI crawler removes ambiguity. Some AI systems respect robots.txt strictly — a missing or incorrect entry means they skip your content.
Configure Your robots.txt
GPTBot
ChatGPT
Allow
Google-Extended
Google AI
Allow
PerplexityBot
Perplexity
Allow
ClaudeBot
Claude
Allow
Advanced Directives
Crawl-delay by engineStarter
Regional robots.txt variantsStarter
One-click CMS deploymentStarter
Crawl-Delay Tuning, Geo-Specific Rules & Deployment Guide
Available on Citatra Starter and above
Unlock with Starter — 7-day free trial