Websites and marketing for businesses in all 50 statesFree consultation: 918-777-1011

AI Search

What llms.txt is, and whether your site needs one

llms.txt is a short text file some websites now publish for AI tools. It's a proposal, not a standard every AI company has agreed to read, so it's worth understanding before anyone charges you for one.

4 minute readUpdated November 2026All guides
The short version
  • llms.txt is a proposed file that gives AI tools a summary of your site and its key pages.
  • It's a proposal, not a standard, and not every AI company has committed to reading it.
  • Google says you don't need AI text files to appear in AI Overviews or AI Mode.
  • For a local business site, clear pages, listings and reviews matter far more.
  • If you add one, keep it short, accurate and up to date.

What llms.txt is

llms.txt is a plain text file that sits at the root of a website, in the same place a robots.txt file lives. It gives AI tools a short summary of what the site is, followed by a list of links to the site's most useful pages, each with a brief note on what that page covers. The proposal also allows a file for one section of a site, covering just the pages under it.

The idea behind it is practical. AI tools have limited room to read, and a typical web page is full of menus, scripts, pop-ups and ads. A clean summary and a map of the important pages could help a tool find the right information without wading through all of that.

It was proposed in 2024 by Jeremy Howard, co-founder of Answer.AI, and the proposal is published at llmstxt.org. The format is simple: a title, a short summary, then sections listing links with descriptions.

A proposal, not a standard

This is the most important thing to understand. llms.txt is a proposed convention. It is not a formal web standard like robots.txt, which has been around since the 1990s and which reputable crawlers follow. No rule requires an AI company to read an llms.txt file, and not every AI company has committed to doing so.

Where you'll mostly find it today is on developer documentation and software sites, where it helps coding assistants find the right docs. Some tools read it. Others don't, and an AI company can change its approach at any time.

Google has said plainly that you don't need to create new machine-readable files or AI text files to appear in its AI features, such as AI Overviews and AI Mode. So for Google, an llms.txt file isn't part of getting found.

None of that makes the file harmful. It means anyone selling it as a way into AI answers is overselling it.

If an agency pitches llms.txt as the centerpiece of an AI search plan, ask what else is in the plan. The file takes a short time to write. The work that actually helps takes much longer.

What it does and doesn't do

People sometimes mix it up with robots.txt. A robots.txt file tells crawlers which parts of a site they may visit, and well-behaved crawlers respect it. An llms.txt file is more like a reading guide. It points to content rather than setting rules.

  • It gives any tool that chooses to read it a tidy summary of your business and your key pages.
  • It doesn't block AI crawlers or control how your content is used. That's what robots.txt and your hosting settings are for.
  • It doesn't make an assistant recommend you, rank you higher or cite you more often.
  • It doesn't replace clear pages, structured data, listings or reviews.
  • It doesn't need frequent updates, but it does need to stay accurate when your services or pages change.

Whether a local business site needs one

For most local business websites, llms.txt sits low on the list. A plumber, dentist or salon with a well-built site of a few dozen pages doesn't have the problem the file was designed to solve. A site that size is small enough for any crawler to read in full.

It makes more sense for large sites with lots of documentation, help articles or technical content, such as software companies with thousands of pages of docs.

If your site is already in good shape, adding one is a small, cheap job with little downside. If your site is missing service pages or basic facts, fix those first. An llms.txt file that points to thin pages doesn't help anyone, human or machine.

What matters more for AI answers

AI assistants describe businesses based on what they can find and trust. The work that helps is mostly the same work that helps search in general.

On that last point, some hosting and security services now offer settings that block AI crawlers, and some switch them on by default. If you want to show up in AI answers, check this long before you think about llms.txt. A file that points AI tools to your pages does nothing if those same tools are turned away at the door.

  • Pages that say plainly what you do, where, and for whom.
  • LocalBusiness structured data with your name, address, phone, hours and services.
  • A complete Google Business Profile, plus Bing Places and Apple Business Connect.
  • The same name, address and phone on every listing.
  • Steady, genuine reviews.
  • Mentions on other trustworthy sites, like local news, trade associations and supplier directories.
  • A site that doesn't accidentally block the crawlers AI search tools use.

If you decide to add one

Keep it short and accurate. Start with your business name as the title, then a one-paragraph summary: what you do, the area you serve, and how to contact you. Then list your main pages, such as each service page, your service area pages, your about page and your contact page, with a sentence describing each.

For a plumbing company, that might mean a title with the business name, a summary saying it's a licensed plumber serving a handful of named towns with emergency service, then links to the water heater, drain cleaning, repiping and emergency pages, each with one line explaining what's there.

Don't stuff it with keywords or claims you wouldn't put on your site. Don't include anything you don't want public, because anyone can open the file. Update it when you add services or change page addresses.

Then forget about it and get back to the work above. If no AI tool ever reads the file, you've lost very little. If your service pages are thin, no file will make up for it.

Northward's SEO & AI Search plan covers the work that matters more, structuring your site so AI assistants can understand and cite your business, at $499 a month on a 30-day agreement.

Questions about this

Will adding llms.txt get my business into ChatGPT?

Not on its own. Not every AI company has committed to reading llms.txt files, and none is required to. What helps ChatGPT and other assistants describe your business is clear information on your site, consistent listings, reviews, and mentions elsewhere. As long as your site doesn't block the crawlers those tools use, they can read your normal pages without an llms.txt file.

Is llms.txt the same as robots.txt?

No. A robots.txt file tells crawlers which parts of your site they're allowed to visit, and it's a long-established standard that reputable crawlers follow. An llms.txt file doesn't set any rules. It's a suggested reading guide that points AI tools to your most useful pages. If you want to control AI crawlers, robots.txt and your hosting settings are where that happens.

Can llms.txt hurt my site?

It's unlikely to, as long as it's accurate. It's a small file that visitors don't normally see. The risks are minor: listing outdated pages, making claims that don't match your site, or including details you didn't mean to publish. The bigger risk is paying for one in place of the basic work that actually helps customers and AI tools find you.

Want us to do this for you?

Book a free consultation on Google Meet. We will look at your business and tell you plainly what we would do and what it costs.

Free call on Google Meet Plain answers about your market 30-day terms, no long contract
Book a free consultation Call