Answer

llms.txt: what it is, what is proven, and why we publish one anyway.

A small file at the root of your site that tells AI tools what matters. Real adoption, genuine uses, and no evidence at all that it affects search. All three are true at once.

llms.txt: what it is, what is proven, and why we publish one anyway.
Sources
  1. 1What is in the file?
  2. 2What is actually true about adoption?
  3. 3So why do we publish one?
  4. 4How to spot the overselling
  5. 5What do the statistics say about llms.txt adoption?
  6. 6Questions about llms.txt

Key takeaways

  • What is llms.txt? A Markdown file at the root of a website listing its most useful pages with short descriptions, so an AI tool can read a clean index instead of parsing navigation and ads.
  • Who proposed it and when? Jeremy Howard published the proposal in September 2024, with a second version in 2026. It is a community convention, not a standard from any search engine or standards body.
  • Does Google use it? No. Google has said plainly that it does not use llms.txt for Search, and no major search engine documents reading it as a ranking or citation signal.
  • So why publish one? Because it breaks nothing and some developer-facing tools do read it. We publish one and label it an emerging convention. We do not sell it as a ranking tactic.
What belongs in an llms.txt file at your site root

What is in the file?

An llms.txt is plain Markdown at the root of your domain. It opens with your business name, adds a sentence or two of context, then lists your most useful pages as links with a short description on each. That is the whole format.

The reasoning behind it is sound. An AI tool reading your site has to work through navigation, cookie banners, scripts and footers to find the content. A single clean index of what matters saves it the trouble and reduces the chance it describes you from your own menu labels.

What is actually true about adoption?

This is the part where most writing on the subject picks a side and overstates it. Both of these are true at the same time.

There is real adoption. The proposal was published by Jeremy Howard in September 2024 and revised in 2026. Documentation platforms now generate the file automatically, several AI companies publish one for their own developer docs, and thousands of sites have one. That is a genuine ecosystem in developer tooling.

No search engine has said it uses yours. Google has stated it does not use llms.txt for Search. Neither Microsoft nor the assistant vendors document consuming it when choosing sources for an answer. Every claim that publishing one improves your AI visibility is, at the time of writing, an assertion without published evidence behind it.

Those two facts are compatible. A convention can be widely published and not yet consumed by the systems you care about.

So why do we publish one?

Three reasons, none of them a ranking claim.

We write the file and publish it at the root of your site, so there is nothing for you to find, format or upload. It cannot hurt a site that is kept current, and we keep it current. It is read today by developer tooling, which matters if your buyers are technical. And if any engine does start consuming it, the file is already there and already accurate.

What we will not do is put it on an invoice as an AI visibility service. It is one line in a build, included and unpriced, and it sits last on our eight-point list because the evidence for it is the thinnest. The seven above it have far better reasons behind them.

Three claims made about llms.txt against what is actually true: it does not get you into ChatGPT

What do the statistics say about llms.txt adoption?

llms.txt was proposed in September 2024, and the HTTP Archive found valid files on about 2% of sites in its 2025 crawl. Google says Google Search ignores them.

Statistics last updated 10-30-2026. Each figure links to the organization that first published it.

  • Jeremy Howard published the llms.txt proposal on llmstxt.org on 09-03-2024. Source: llmstxt.org, 2024.
  • Valid llms.txt files appeared on 2.13% of desktop sites and 2.10% of mobile sites in the HTTP Archive Web Almanac 2025 crawl. Source: HTTP Archive Web Almanac, 2025.
  • The HTTP Archive Web Almanac 2025 counted 324,184 valid llms.txt files across mobile sites, and 39.6% of those files were related to the All in One SEO plugin. Source: HTTP Archive Web Almanac, 2025.
  • Google Search Central lists llms.txt files among the things site owners can ignore for Google Search. Source: Google Search Central, 2026.

Questions about llms.txt

Is llms.txt the same as robots.txt?

No, and the similar name causes real confusion. robots.txt controls access: it tells crawlers what they may and may not fetch, and the major crawlers obey it. llms.txt controls nothing. It is a suggested reading list, and nothing is obliged to look at it.

Will llms.txt get my site into ChatGPT answers?

There is no evidence that it does, and we would rather say so than take money for it. ChatGPT's web answers come from search results. Being indexed in Bing and having a page that answers the question are what decide that. The file is not a shortcut past either.

Who actually reads llms.txt today?

Documentation tooling, some coding assistants, and a growing set of developer platforms that generate the file automatically. The AI labs publish them for their own developer docs. That is genuine adoption in one niche, and it is not the same as search engines consuming yours.

Can it hurt my site?

Only in two ways, both self-inflicted. If you list pages you did not want surfaced, you have advertised them. And if you publish it once and never update it, you are handing out a stale index of your own site. Treat it as a file that needs maintaining or do not publish it.

How do I write one?

A heading with your business name, a one-line summary, then a short list of your important pages as Markdown links with a sentence each. Upload it to the root of your site so it sits at yourdomain.com/llms.txt.

Do you include it in your builds?

Yes, on every build and uplift, and it is one of the eight points the free score reports. It is also the one point on that list we tell you to care least about, which is the opposite of how it tends to get sold.

BitMap Media editorial team
Reviewed and curated by the BitMap Media team
Marketers with decades across print, TV, direct mail, email, web, video and CRM. Updated 10-30-2026. About the team

See whether your site has one, and the seven things that matter more.

The free AI Visibility Score checks for llms.txt alongside the seven points with better evidence behind them, and tells you which to fix first.

Get your Free AI Visibility Score