llms.txt
llms.txt is a markdown file at the root of a website that gives large language models a concise, structured index of the site's most important pages and content.
The llms.txt proposal, introduced in 2024, mirrors robots.txt and sitemap.xml — except its audience is LLMs, not search crawlers. The file lives at https://example.com/llms.txt and uses a simple H1 + blockquote + sectioned-list markdown format.
A good llms.txt names the company, summarizes what it does in a single quotable paragraph, and links the canonical pages an AI should read first (product, pricing, docs, about, key articles). It is short by design: LLMs are token-constrained, and a noisy file is ignored.
llms.txt is not yet an IETF standard, but it has been adopted by Anthropic, Cloudflare, and a growing number of developer-tooling companies. AgenticSEO generates one for every site it audits.
Related terms
Want to see how llms.txt applies to your site? Run a free 5-page AgenticSEO audit — no sign-up.
llms.txt is measured and fixed inside the agentic SEO platform — an AI visibility platform for answer engines.
Try the free preview