llms.txt Generator
llms.txt is a plain-text file you publish at the root of your domain that hands AI crawlers a clean, curated map of your best content — a sitemap for answer engines. Paste a URL below and generate a ready-to-ship llms.txt so ChatGPT, Claude, Perplexity, and AI Overviews can find and cite your pages.
Your generated llms.txt will appear here
Enter a site URL above and we'll crawl it (sitemap-first), extract titles and descriptions, and assemble a ready-to-ship file.
What is llms.txt?
A short, link-first index of your site that LLMs can read in one fetch — so they cite the right pages instead of guessing from raw HTML.
A map, not a wall of text
It lists your key URLs under clear headings with one-line summaries — the table of contents an LLM uses to navigate your site.
Lives at the root
Published at /llms.txt, it is the de-facto convention (per llmstxt.org) that AI crawlers look for, just like robots.txt and sitemap.xml.
Built for context budgets
Models have limited context. A curated file surfaces canonical, high-value pages first, improving the odds your content is quoted accurately.
From URL to published file
Four steps, about two minutes — no account required.
- 1
Enter your site URL
Paste your homepage or any page on your domain. The generator normalizes the scheme and treats it as the crawl root.
- 2
Crawl and extract
We fetch your sitemap first (falling back to link discovery), then extract each page’s title and meta description so the file describes real, indexable content.
- 3
Review the output
A structured llms.txt is rendered in the panel — a curated, link-first map of your site grouped under clear headings, exactly as the llmstxt.org spec recommends.
- 4
Download and publish
Copy or download the file and host it at https://yourdomain.com/llms.txt (and optionally llms-full.txt) so AI crawlers can find your canonical content map.
Common questions
llms.txt is a plain-text file you publish at the root of your domain (/llms.txt) that gives large language models a clean, curated map of your most important content. It is to AI crawlers what a sitemap is to search engines: a concise, link-first guide that helps models find and quote the right pages instead of guessing from raw HTML.
It removes friction. AI crawlers and answer engines have limited context budgets, so a curated llms.txt makes your canonical, high-value pages easy to discover and extract — improving the odds your content is cited accurately in ChatGPT, Claude, Perplexity, and AI Overviews. It complements (does not replace) clean semantic HTML, structured data, and a regular sitemap.
llms.txt is a short index of links with one-line summaries — the table of contents. llms-full.txt is an expanded variant that inlines more of the underlying content so a model can ingest the substance in a single fetch. Ship llms.txt for everyone; add llms-full.txt when you want models to read full content without crawling each link.
Host it at the web root so it resolves at https://yourdomain.com/llms.txt. On most frameworks that means dropping it in your public/static directory or serving it from a route. Re-generate and re-publish whenever your site structure changes so the map stays accurate.
Yes. The llms.txt generator is part of the open-source AEO Toolkit and is free to use — no account required. It runs the crawl on demand and returns the file for you to copy or download.