Definition
A convention, proposed by Jeremy Howard at answer.ai, for publishing a short plain-text or lightly-formatted Markdown file at /llms.txt that summarizes the site's purpose and lists the URLs most worth crawling. Analogous to robots.txt but aimed at LLM crawlers rather than search spiders.
Why it matters
LLM crawlers have smaller context budgets than classic search spiders. A structured summary lets them understand the site in one fetch and increases the odds of accurate citation. We see zero downside to publishing it.
How we think about it
Our llms.txt is dynamically generated on every deploy from the live site data, services, published case studies, blog posts, guides, glossary. Handwritten llms.txt goes stale fast. Data-driven ones don't.