My Tool Studio
SEO Tools·2 min read

How to Create an llms.txt File for Your Site

llms.txt is a short Markdown file at your site root that points AI assistants to the pages that explain what you do. The llms.txt Generator builds it from your sitemap: enter your site URL and it sorts your pages into sections and writes the file. A Full content mode builds the longer llms-full.txt instead.

llms.txt Generatormytoolstudio.com › tools<title>…</title><meta name="description">SEO ready

What llms.txt is

A reading list, not a rulebook.

The format was proposed in 2024 as a curated guide to a website for large language models. The file starts with your site name as an H1 and an optional description as a blockquote, then H2 sections with a Markdown link list under each.

It is not a replacement for robots.txt. robots.txt tells crawlers what they may fetch, while llms.txt cannot block anything; it only suggests what to read. It is also not an official standard. Some AI tools and developer platforms read it and many crawlers do not, so treat it as a low-cost extra, not a way to control how AI systems use your content.

How the generator builds it

From your sitemap.

Enter your domain and the tool finds the sitemap through robots.txt, common paths and sitemap index files. Pages are grouped by URL pattern: paths with /blog, /post or /news go under Blog, /docs, /guide and /help under Documentation, /product, /tools and /shop under Products, and /about, /team and /company under Company. The homepage goes under Home and the rest under Other.

Add a Site name and Short description, then press Generate llms.txt. Link text starts from each URL's last path segment, so /docs/getting-started becomes Getting started. Press Add page titles and descriptions and the tool fetches up to 150 pages, so each link uses the page title followed by its meta description after a colon.

Each section is capped at 50 links by default, and the tool shows when it left some out, because the file is meant as a short guide rather than a copy of your sitemap. You can turn the cap off if you really want every link.

Editing before you publish

A curated list, not a dump.

The editor lets you rename, reorder and remove sections, and edit, reorder, move or remove single links. Put the pages you most want AI tools to read first. Add an Optional section, as the proposal describes, for links a model can skip when it is short on space, and use Extra notes under the summary for key facts such as product names or pricing basics.

llms.txt or llms-full.txt

Short index or full text.

Choose Short (llms.txt) for an index of links. Choose Full content (llms-full.txt) to include the readable text of every page in one file, so a model can read your content without following each link. Full content fetches every page, so it is slower and does not work on sites that block automated requests.

When the site blocks the fetch

Paste mode.

Some sites block requests from our server. In that case, open the paste box, paste your sitemap XML or a list of URLs and press Generate from pasted list. This also works for sites without a sitemap.

Publishing and checking the file

One location, like robots.txt.

Copy or download the output and save it as llms.txt at your domain root so it loads at yoursite.com/llms.txt.

Open the URL to confirm it loads as plain text, then run it through the llms.txt Validator, which checks the structure and that the links resolve. Regenerate the file when you publish a batch of important pages.

Try it now

Open llms.txt Generator

The tool is one click away. No sign up, no upload, no payment.

Open llms.txt Generator