What is llms.txt used for?
llms.txt gives AI systems a short, structured overview of your website, including key pages, preferred citations, and content usage guidance.
AI Crawler Control
llms.txt Generator
Create llms.txt, llms-full.txt, crawler permission rules, and deployment snippets for WordPress, Nginx, Vercel, or static hosting.
Output files
llms.txt
llms-full.txt
FAQ
Common questions about publishing llms.txt files and AI crawler rules.
Do I still need robots.txt?
Yes. llms.txt explains your site to AI systems, while robots.txt is still the practical place to publish crawler allow or block directives.
Where should I upload the files?
Publish llms.txt and llms-full.txt at the root of your domain, such as example.com/llms.txt and example.com/llms-full.txt.
Can I allow only selected AI crawlers?
Yes. Use Selective Access to allow selected crawlers and generate matching robots.txt rules for other known AI crawlers.