Give AI crawlers a map of your site

llms.txt is a plain-text file, conventionally served at yourdomain.com/llms.txt, that gives AI crawlers a short map of your site: what it is, and links to the pages that matter most, grouped by section. It follows the llmstxt.org convention proposed for making sites easier for AI systems to understand quickly.

No major AI company has committed to reading or prioritizing llms.txt the way search engines committed to robots.txt or sitemap.xml. It is an emerging, community-driven convention. Some crawlers and tools do look for it; none are required to. Treat it as a helpful nicety, not infrastructure you can depend on.

No. It can make it faster for a supporting crawler to understand your site's structure. It has no bearing on whether an AI assistant chooses to cite you, which depends on the actual content quality and what other sites say about you. We would rather say that plainly than oversell a text file.

We fetch your live sitemap.xml (or the sitemap URL declared in your robots.txt), then fetch the individual pages to read their <title> and meta description. Where a page has no description, we generate a readable title from its URL slug instead.

Unlike the other tools, this one fetches your homepage, your robots.txt, your sitemap, and then a batch of individual pages to pull real titles and descriptions. That is several sequential network round-trips to your server, which is why it is slower than a single-page check.

Yes, the generated file loads directly into an editable text box. Reorder sections, rewrite descriptions, or trim pages you don't want listed, then copy or download the final version as llms.txt.

Upload it to your domain's root, so it is reachable at yourdomain.com/llms.txt, the same place robots.txt and sitemap.xml live.