robots.txt Generator
Create crawler rules and export a ready-to-use robots.txt
Quick templates
Rule 1
Additional settings
Generated robots.txt
txt
User-agent: *
Allow: /Place this file at your site root: example.com/robots.txt
Learn more
FAQ
Visible FAQ matches FAQPage schema for better SEO/AEO citations.