Skip to content
husky hamster

LLMs.txt (proposal and scepticism)

LLMs.txt is a proposed standard — a markdown file at a site's root listing and summarising its key content for language models — whose adoption by major AI systems remains unproven, making it a low-cost experiment rather than a confirmed lever.

People also ask

In practice

The proposal’s logic: models struggle to parse sprawling sites, so a curated file — the site’s key pages with concise descriptions — could serve as a table of contents for machines. The scepticism’s evidence: no major AI system has documented using llms.txt for retrieval or answers, the file sits outside the standards that demonstrably work (robots.txt for access, sitemaps for discovery, structured data for extraction), and the engines that comment on it describe sitemaps and clean HTML as the effective inputs.

The honest posture is therefore experimental and cheap: maintaining an llms.txt costs little (it is a curated index you should have anyway, in machine-readable form), it does nothing harmful, and if any engine adopts it, early adopters are ready — but no programme should claim it as a lever, budget around it, or let it substitute for the confirmed work: crawl access, extractable pages, entity clarity, placement on cited sources. The useful reframing: the exercise of writing it — choosing the site’s key pages and describing each in one honest sentence — is itself a content-architecture audit that pays regardless of the file’s fate.

The evaluation rule for buyers: when a vendor lists llms.txt as a GEO deliverable, ask what else is in the package — if the confirmed layers (access, extraction, entity, placement, measurement) are there too, the file is a harmless bonus; if it’s the headline, the programme is decoration.

See also: LLM optimisation, GEO checklist for SaaS sites, AI crawler access.

Related service: Brand mentions.

Tell us which pages need to win

Thirty minutes with Andreea. Bring your top three commercial pages, and we'll tell you what's standing between them and page one, whether or not you hire us.

Book a strategy meeting →