llms.txt for WordPress: What It Does, What It Doesn’t, and How to Add It

llms.txt is a plain Markdown file at yoursite.com/llms.txt that lists your most useful pages for AI tools, with a short summary of the site. You can add one to WordPress in a few minutes with Rank Math, Yoast SEO or All in One SEO. But be clear about what it does: Google says its Search features do not use llms.txt, and no major AI company has said its crawler reads it.

So it is cheap to add and unlikely to hurt, but it is not a ranking factor and not a shortcut into AI answers. This guide explains what the file is, what the evidence says, how to set it up in each plugin, and the mistakes I found in this site’s own file.

How I worked this out: this site has served an llms.txt file since at least August 2026, generated by Rank Math, plus a separate llms-full.txt. I checked both live files, their response headers and Rank Math’s settings screen on 23 October 2026. Statements from Google, the plugin makers and the llms.txt proposal were checked on their official pages the same day. I do not have server logs that show whether AI bots read this site’s file, so I make no claim either way.

What Is llms.txt?

llms.txt is a proposed file format for giving large language models (LLMs) a quick, clean map of a website. Jeremy Howard of Answer.AI published the proposal on 3 September 2024. The idea is simple: web pages are full of menus, ads and scripts, so a short Markdown file that points to the important pages is easier for an AI tool to read inside its limited context window.

The proposal lives at llmstxt.org, which now describes a second version (updated August 2026). It is not a standard from the IETF or W3C. It sits alongside robots.txt and your XML sitemap but does a different job:

What goes inside the file

The format is plain Markdown with a set order. Only the first line, an H1 with your site name, is required by the proposal.

• An H1 with the name of the site or project.
• A blockquote (a line starting with >) with a short summary.
• Optional paragraphs with more detail.
• H2 sections that each hold a list of links, written as - [Page name](URL): note.
• An “Optional” section for secondary links. Version 2 of the proposal keeps it as a convention for links an agent can skip, but it no longer has any special technical meaning.

Here is a small example for a made-up bakery:

# Example Bakery

> A family bakery in Leeds. We sell sourdough, cakes and custom
> wedding cakes, and we deliver within 10 miles.

## Main pages
- [Menu and prices](https://example.com/menu/): Breads, cakes and prices
- [Wedding cakes](https://example.com/wedding-cakes/): How ordering works
- [Delivery](https://example.com/delivery/): Areas, fees and times

## Optional
- [Our story](https://example.com/about/): Who runs the bakery

Does llms.txt Actually Work?

This is the part most guides skip. Here is what the main players have said on the record.

The best usage data so far is third-party. Ahrefs looked at bot traffic data for 137,210 domains from its own analytics tools in May 2026 and published the study in June 2026. About 28% of those sites had an llms.txt file, which Ahrefs calls an upper bound because its users are more SEO-aware than most. 97% of the files received no requests at all. Of the requests that did happen, SEO audit tools were the largest group (about 22%), and AI bots of all kinds made about 20%. Ahrefs also points out that a fetch does not prove a bot used what it fetched.

My honest reading: llms.txt does not help your Google rankings or your chance of appearing in AI Overviews. It may help an AI coding assistant or an agent that is pointed at your site on purpose, which is why software companies use it for their documentation. For a typical blog or business site, it is a small, optional extra.

Should You Add llms.txt to Your WordPress Site?

• Yes, if your SEO plugin already does it. It takes minutes, costs nothing and Rank Math sends it with a noindex header, so it will not show up in search results.
• Yes, if you run documentation, an API or a software product. Developers paste these files into AI coding tools, which is the use case the companies behind these files point to.
• Do not pay for it. A paid plugin or service sold as “AI visibility” through llms.txt is selling something that Google says it does not use.
• Neither applies? Then it is optional. Skip it, or switch it on in your SEO plugin later.
• Do not let it replace the basics. Clear pages, accurate facts, good internal links and a crawlable site matter far more for search and AI answers.

How to Add llms.txt in WordPress

All three big SEO plugins can create the file. Use the one you already have; there is no reason to install a second SEO plugin just for this.

Rank Math

1. If Rank Math is in Easy Mode, switch to Advanced Mode with the toggle at the top of the Rank Math dashboard. Easy Mode shows only the Summary field.
2. Go to Rank Math SEO → Dashboard and turn on the LLMS Txt module.
3. Go to Rank Math SEO → General Settings → Edit llms.txt.
4. Choose the post types and taxonomies to include, and the number of posts and terms to list.
5. Fill in Summary. Rank Math shows it as the blockquote under your site name.
6. Use Additional Content only for a few extra lines or links you want to add by hand.
7. Save, then open yoursite.com/llms.txt in a private window to check it.

That first step is the one that confused me on this site. The Edit llms.txt screen showed only the Summary field, as in the screenshot above, because Rank Math was in Easy Mode. For a wider look at the plugin, see my Rank Math review.

Yoast SEO

Go to Yoast SEO → Settings → Site features, find llms.txt in the AI tools group and turn it on. You can let Yoast pick the pages, which favours your cornerstone content, or select pages yourself. In automatic mode it lists a handful of recently updated posts per content type, cornerstone content first. Yoast writes a real file to your server and refreshes it weekly in automatic mode. It will not overwrite an llms.txt file that it did not create, and it is not available on multisite.

All in One SEO

Go to All in One SEO → Sitemaps and open the LLMs.txt tab. The feature is on by default in recent versions. You can set the title and description, choose post types and taxonomies, and exclude individual posts or terms. The full-content llms-full.txt file and Markdown versions of pages need AIOSEO Pro.

Without a plugin

You can write the file by hand and upload it to your site’s root folder with your host’s file manager or SFTP. The downside is upkeep: a static file does not change when you publish or delete posts. A physical file can also clash with a plugin that generates one, so pick one method.

SEOPress added llms.txt in version 9.5; its release post says you switch it on under SEO → PRO → llms.txt, and itself cautions that most AI systems do not yet rely on the file. With any other SEO plugin, check its settings first.

What to Put in Your llms.txt

Think of it as a short, honest guide to your site for someone in a hurry. A few rules work well:

• Start with the H1. The site name must be the first heading.
• Write a one-sentence summary of who you are and what the site covers.
• List your best pages, not all of them. Your sitemap already lists everything.
• Write a short, accurate note for each link. These notes often come from your meta descriptions, so outdated or salesy descriptions show up here too.
• Leave out thin, private or temporary pages, such as old promotions, thank-you pages or anything behind a login.
• Keep claims factual. Anything in this file is a statement about your site.

What I found in this site’s own file

Checking this site’s llms.txt for this guide turned up four things worth fixing, and they are common:

• The H1 is not the first line. Rank Math adds a “Generated by Rank Math SEO” credit line above it. The proposal expects the H1 first. Rank Math’s code includes a filter, rank_math/llms_txt/remove_credit: return true and the line disappears (see the snippet below).
• There is no summary. The Summary field was empty, so the file has no blockquote.
• Some notes are long article intros. Older posts without a tight meta description fall back to their opening paragraph.
• It is long, and not all of it is plain fact. At about 28 KB, it lists 50 posts, the site’s pages and a large block of extra text added by hand, some of which reads more like marketing than facts. A shorter, curated file is closer to what the proposal intends.

To remove Rank Math’s credit line, add this to a code snippets plugin or your child theme’s functions.php, then purge your caches:

add_filter( 'rank_math/llms_txt/remove_credit', '__return_true' );

What About llms-full.txt?

llms-full.txt is a single file that contains the full text of your key pages, not just links. It is not part of the llms.txt proposal. Mintlify, a documentation platform, says it started the format together with Anthropic, and it caught on for software documentation.

This site has one, built by a small custom plugin rather than by Rank Math. For most WordPress sites I would skip it. It duplicates your content in another place you have to keep accurate, and there is even less evidence that crawlers use it. It makes more sense for documentation that developers load into AI coding tools.

How to Check Your llms.txt Is Working

Run this in a terminal, replacing the domain with yours:

curl -sI https://example.com/llms.txt

• Status 200. A 404 means the module is off or the file is missing. Lighthouse treats a missing file as fine but flags server errors.
• Content-Type text/plain (or text/markdown).
• X-Robots-Tag: noindex (optional). Rank Math sends noindex, nofollow on this site, which keeps the file itself out of search results. Other plugins may not, and that is not an error. Google’s John Mueller has said noindexing it can make sense.

Then open the file in a private window and read it as a stranger would. Does the first heading name your site? Does the summary make sense? Do the links work?

Common llms.txt Problems in WordPress

The file returns a 404

Check that the feature is turned on in your SEO plugin. If it is, go to Settings → Permalinks and click Save without changing anything. That refreshes WordPress’s rewrite rules, which plugins such as Rank Math use to serve the file. Yoast writes a real file instead, so with Yoast check that the file exists in your site’s root folder.

My changes are not showing

Caching is the usual cause. Purge your page cache, and if your host has a CDN, purge that too. On this site, Hostinger‘s CDN kept serving an old copy of llms.txt after an edit until the CDN cache was cleared in hPanel. With Yoast in automatic mode, also remember it refreshes weekly. My LiteSpeed Cache settings guide shows how to check whether a page is being served from the cache.

Two plugins are fighting over the file

A physical llms.txt file in your site’s root folder is served before any plugin gets the chance. If you switch plugins, delete the old file. Yoast will not overwrite a file it did not create.

Pages I did not expect are listed

Plugins list published content from the post types you select. Remove post types you do not want, exclude individual posts if your plugin allows it, and noindex pages that should not be public. Rank Math leaves out password-protected and noindex posts.

llms.txt Checklist

Content

• The first line is the H1 with your site name.
• A one-sentence summary as a blockquote.
• Only your best pages, not every URL.
• A short, accurate note for each link.
• No private, thin or expired pages.

Technical

• It returns status 200 as text/plain or text/markdown.
• A noindex header is optional (Rank Math adds one).
• robots.txt does not block it.
• Page and CDN caches are purged after edits.
• Only one plugin or file creates it.

If you work on AI search visibility more broadly, the basics still decide most of the outcome: pages that answer the question clearly, facts you can back up and a site that is easy to crawl. Tools such as Semrush now track AI visibility, which is a better measure than whether a bot fetched one text file. You can also read how I review products.

Frequently Asked Questions

About the author

Harshil Barot

Digital Marketing Strategist & SEO Specialist

Harshil Barot is a digital marketing strategist focused on SEO, website growth and lead generation. He has built websites since 2012 and provided digital marketing services since 2016. His reviews of web hosting, WordPress, SEO and AI tools state whether they draw on personal use, hands-on testing or editorial research.

More about Harshil Barot →