What is llms.txt?
llms.txt is a simple text file intended to help AI systems understand the purpose, structure, and most important pages of a website.
What is llms-full.txt?
llms-full.txt is a longer companion file for richer context, documentation notes, editorial guidance, product descriptions, and other details that may be too long for the short file.
Does llms.txt replace robots.txt?
No. llms.txt is a guidance and discovery file. robots.txt remains the practical location for crawler allow and block rules.
Where should I publish these files?
Publish them at the root of your domain, such as https://example.com/llms.txt and https://example.com/llms-full.txt.
Can I block all AI crawlers?
The generator can create robots.txt snippets for known AI crawler user agents. However, crawler compliance depends on each third-party service.
Can I allow only selected AI providers?
Yes. Selective Access lets you choose specific AI crawler groups and generate matching allow/block rules.
Is the AI-readiness score a ranking factor?
No. It is a practical heuristic that checks public HTML structure, metadata, headings, canonical links, and structured data.