On this page
llms.txt is a proposed markdown file, placed at yoursite.com/llms.txt, that gives AI tools a curated map of your most important content. Jeremy Howard proposed it on September 3, 2024. Google says Search does not use llms.txt or similar AI files, though other AI services may read it. It’s cheap to add, but it isn’t an AI search strategy.
There is a lot of confident noise around llms.txt. Some vendors pitch llms.txt as the key to showing up in ChatGPT and AI Overviews, and some SEOs dismiss it as useless. The honest answer sits in between, and it matters for how you spend your time on AI search optimization.
Below: what the file is, what goes in it, what Google has actually said, whether you should add one, how to set it up in WordPress, and what deserves your attention first.
What is llms.txt?
llms.txt is a plain markdown file that sits at a known URL on your site and lists the pages you most want a language model to read, with a short description of each. It was proposed on llmstxt.org by Jeremy Howard on September 3, 2024, as a way to help language models use website content at inference time, meaning when someone asks a question rather than during training.
The reasoning behind it is practical. Web pages are full of navigation, scripts, cookie banners and layout code, and a model working inside a limited context window does better with a clean summary and direct links to the content that matters. Markdown is easy for both people and models to read, so the proposal uses it.
The proposal puts the file at the root path, /llms.txt, though it also allows the file at a subpath. It also recommends that sites offer clean markdown versions of individual pages at the same URL with .md appended, so page.html would have a companion at page.html.md. Very few sites do that second part, and it’s a bigger lift than the file itself.
Two things llms.txt is not. It isn’t a crawler control file like robots.txt, so it doesn’t allow or block anything. And it isn’t an adopted web standard; it’s a proposal that some tools and platforms have chosen to support. If you want to control which AI bots can crawl your site, that’s a robots.txt job, which we cover in our guide to AI crawlers and robots.txt.
What goes in an llms.txt file?
An llms.txt file contains a title, a one-paragraph summary of who you are, and grouped lists of links to your key pages, each with a short note. The spec on llmstxt.org lays out the order: an H1 with the site or project name (the only required element), a blockquote summary, optional detail paragraphs, then H2 sections containing markdown link lists.
Here’s a simplified example for a fictional regional HVAC company:
# Northfield Heating & Air
> Northfield Heating & Air installs, repairs and maintains residential
> and light commercial HVAC systems. We serve homeowners and property
> managers and offer same-week service appointments.
Pricing is quoted after an on-site assessment. We do not sell
equipment online.
## Services
- [Furnace repair](https://example.com/furnace-repair/): Diagnosis and repair for gas and electric furnaces
- [AC installation](https://example.com/ac-installation/): New central air and heat pump installs, including sizing
- [Maintenance plans](https://example.com/maintenance-plans/): What each annual plan covers and how visits are scheduled
## Guides
- [How to choose a heat pump](https://example.com/guides/heat-pump/): Sizing, efficiency ratings and when a heat pump makes sense
- [Furnace warning signs](https://example.com/guides/furnace-signs/): Symptoms that mean a repair call is worth it
## Optional
- [About us](https://example.com/about/): Company history and team
- [Careers](https://example.com/careers/): Open roles The “Optional” section has a specific meaning in the proposal: it marks links a tool can skip when it needs a shorter context. Put your secondary pages there.
A few practical rules from our own builds:
- Keep the summary factual. Say what you do, who you serve and any constraint a model should know, like “we don’t sell online.” Marketing adjectives add nothing a model can use.
- Link to pages that actually answer questions. Your service pages, your best guides and your pricing approach page belong here; your tag archives don’t.
- Write descriptions that state the page’s purpose in one line. If you can’t, the page itself may be trying to do too many jobs.
- Only list URLs that return a 200 status and are indexable. A file full of redirects or dead links is worse than no file.
Common llms.txt mistakes
The most common mistake we see is treating the file as a dumping ground. When every post, tag page and author archive goes in, the “curated” part of the idea disappears, and the file stops telling anyone what actually matters.
The second is stuffing it with claims that don’t appear anywhere on the site. If your llms.txt says you’re “the leading provider” of something and your pages don’t back that up, you’ve written marketing copy in a file nobody in marketing reads. Keep the file consistent with what your pages say, because AI tools will see both.
The third is letting it go stale. A hand-written file from last year that still links to a retired service page is a small thing, but it signals that nobody owns it. If no one will own it, use a generator.
Does Google use llms.txt?
No. Google says its Search systems don’t use llms.txt, and that adding it won’t help or hurt how your site appears in Google Search, including AI Overviews and AI Mode.
The clearest statement is in Google’s guide to optimizing your website for generative AI features on Google Search, updated July 10, 2026: “You don’t need to create new machine readable files, AI text files, markup, or Markdown to appear in Google Search.” The same guide says Google Search doesn’t use these files, they won’t help or hurt you in Search, and you may keep them if other services use them.
Google also posted a June 15, 2026 entry on its Search Central updates page titled “Clarifying guidance on llms.txt files.” So this isn’t an offhand comment someone made at a conference. It’s written guidance.
That lines up with how Google describes its AI features generally. AI Overviews and AI Mode draw on pages that are indexed and eligible to show with a snippet, and Google says there are no special optimizations required beyond that. Your Google AI visibility comes from the same place your organic visibility does: crawlable, indexable pages that answer the question well.
What about ChatGPT, Claude, Perplexity and other assistants? We haven’t seen any of the major AI search providers publicly commit to using llms.txt as a ranking or sourcing input for their search products. The proposal was originally written with software documentation in mind, and from what we’ve seen that’s still where the file gets the most attention. So “other AI services may read it” is fair; “it gets you cited in ChatGPT” is a claim nobody has shown us evidence for.
Should you add an llms.txt file anyway?
Yes, if it takes you less than an hour and your platform can keep it current. It’s low cost and harmless to Google, and some AI tools may use it. Just don’t expect any measurable Google upside, and don’t let it jump ahead of the work that actually moves AI visibility.
Here’s how I’d weigh it.
| Factor | What we know | What it means for you |
|---|---|---|
| Google Search, AI Overviews, AI Mode | Google says Search doesn’t use it, and it won’t help or hurt | No upside in Google; no risk either |
| Other AI tools and agents | Some services may read it; no major AI search provider has said it uses it for sourcing | Possible small benefit, unproven for brand visibility |
| Cost to create | A plugin can generate it, or you can write it by hand | Usually under an hour for a small or mid-size site |
| Cost to maintain | A hand-written file goes stale as pages change | Prefer an auto-generated file, or schedule a quarterly review |
| Side benefit | Writing it forces you to name your most important pages | Useful content audit exercise on its own |
The side benefit is the part I like most. If you sit down to write a one-line description for each key page and find you can’t, that’s a content problem worth knowing about, and it has nothing to do with the file.
Where I’d push back is on paying for it. If an agency sells llms.txt creation as a premium AI search deliverable, or tells you it’s the reason you’ll appear in AI answers, that’s a claim Google’s own documentation contradicts. The file is a reasonable housekeeping item, nothing more.
If you run a developer documentation site, API reference or software product with technical docs, the case is stronger. That’s the use case the proposal was written for, and it’s where a clean markdown map of your content is most likely to get used. Consider adding the .md page versions too.
How do you create an llms.txt file in WordPress?
The easiest route in WordPress is to let an SEO plugin generate it, then check the output at yoursite.com/llms.txt. On sentic.io, All in One SEO Pro generates our file automatically, so it updates as we publish without anyone remembering to edit it.
You can see ours at sentic.io/llms.txt. It follows the proposal’s structure: an H1 with our name, a blockquote summary of what we do, then sections for our sitemap, blog posts, pages and case studies, each with a link and a one-line description pulled from the page.
Here’s the general process, whichever route you take:
- Check whether your SEO plugin already supports it. All in One SEO Pro includes an llms.txt generator, and other plugins may too. Look in your plugin’s settings and turn it on if it’s there.
- Choose which content types to include. Most generators let you include or exclude posts, pages and custom post types. Leave out thin archives, thank-you pages and anything set to noindex.
- Review your meta descriptions. Generators usually pull each page’s description from its SEO metadata, so weak or missing descriptions show up as weak or missing lines in the file.
- Load yoursite.com/llms.txt in a browser. Confirm it returns plain text, lists the right pages and doesn’t include staging URLs or redirected pages.
- If you’re not using a plugin, write the file by hand and upload it to your site’s root directory over SFTP or your host’s file manager. Then put a quarterly reminder on the calendar to update it.
- Check that nothing blocks it. Make sure your robots.txt, security plugin or CDN rules aren’t returning an error for that URL.
Because a generated file pulls straight from your metadata, the quality of the file depends on the quality of your titles and descriptions. If those are generic, fix them first; that work also helps your regular search snippets, so it’s not wasted either way.
What matters more than llms.txt for AI visibility?
Almost everything else: crawlable and indexable pages, content that answers real questions directly, clean site structure, and accurate coverage of your brand on third-party sites. Those inputs drive whether AI tools mention and cite you, and they also drive your traditional search performance.
If you have limited time, here’s the order I’d work in.
- Make sure the right bots can reach you. Check robots.txt for accidental blocks on search crawlers like Googlebot, OAI-SearchBot and PerplexityBot. One bad line here costs more than any file can make up.
- Fix the infrastructure. Multiple H1s, thin pages, duplicate pages competing for the same question, broken internal links and pages that can’t show a snippet. It’s unglamorous work and it’s where most sites lose.
- Rewrite key pages to answer first. Put the direct answer at the top, then the supporting detail. Give each page one clear job.
- Research the questions people actually ask. Build a prompt set from sales calls, support tickets and search data, and revisit it every quarter.
- Earn accurate third-party coverage. AI tools describe your brand partly from what other sites say about you. Reviews, directories, industry publications and comparison articles all feed that picture.
- Measure mentions and citations separately. Without a baseline you can’t tell which of the above is working.
- Then add llms.txt. It’s a fine last step once the rest is in place.
Our complete guide to answer engine optimization walks through each of these steps in more depth, and our AI search glossary defines the terms if you’re building a case for your team.
FAQ
Is llms.txt an official web standard?
No. It’s a proposal published on llmstxt.org in September 2024. Some tools support it, but no standards body has adopted it.
Does llms.txt help with Google AI Overviews?
No. Google says Search doesn’t use llms.txt or similar AI files, and that they won’t help or hurt your appearance in Search features, including AI Overviews.
Can llms.txt block AI bots from my site?
No. llms.txt doesn’t control crawling. Use robots.txt to allow or block specific crawlers.
Where should the llms.txt file go?
The proposal puts it at the root of your site, at /llms.txt, though it allows other paths as well. The root location is what most tools will check.
Is it worth paying an agency to create llms.txt?
Not as a standalone deliverable. A plugin can generate one in minutes, and the strategic work is choosing and improving the pages it points to.
Not sure where your site stands with AI search?
If you want to know which of these steps would matter most for your site, request a free growth audit. In about five business days you’ll get 3 to 5 ranked opportunities and a 90-day roadmap, with llms.txt in its proper place on the list.