How to Add llms.txt to Your Website (Step-by-Step)

Short answer: To add llms.txt, create a plain-text Markdown file named llms.txt, list your most important pages as a curated, human-readable map of your site, and upload it to your domain root so it lives at https://yourdomain.com/llms.txt. It's a low-effort, low-risk addition, but treat it as a helpful hint for AI tools rather than a guaranteed ranking or citation lever — no major engine has confirmed using it to rank or cite content, and Google has said it doesn't support it.

TL;DR — Key Takeaways

• What it is: llms.txt is a Markdown file that gives AI models a clean, curated map of your most important content. It was proposed by Jeremy Howard (of fast.ai) in 2024.
• Where it goes: The root of your domain, at /llms.txt — the same place robots.txt lives.
• Format: Plain Markdown — an H1 with your site name, an optional summary, then linked sections.
• Adoption is partial: It's an emerging, community-driven proposal. No major AI engine has confirmed it changes rankings or citations, and Google has publicly said it doesn't support it.
• Why bother: It's fast to create, costs nothing, and can't hurt you — a sensible "belt and suspenders" move while the standard evolves.
• Shortcut: AlpynAI can auto-generate a valid llms.txt for your site from your existing pages.

What is llms.txt?

llms.txt is a proposed standard for a Markdown file that sits at your domain root and tells large language models which content on your site matters most and how it's organized. Think of it as a curated table of contents written for machines: instead of forcing an AI to crawl and guess at your site structure, you hand it a clean, prioritized list of links with short descriptions.

The proposal came from Jeremy Howard in 2024. The problem it addresses is real: LLMs have limited context windows and often struggle to extract the signal from a full HTML page cluttered with navigation, ads, scripts, and boilerplate. A llms.txt file points them straight at the important stuff.

It is worth being precise about status. llms.txt is a genuine published proposal with growing grassroots adoption, but it is not an official web standard, and no major AI provider has publicly confirmed that having the file changes whether or how you get ranked or cited. Google has said it does not support llms.txt. So the honest framing is: add it because it's cheap and harmless and may help AI tools parse your site — not because it's a proven visibility lever.

Is llms.txt the same as robots.txt?

No. They sit in the same place but do opposite jobs:

robots.txt is a gatekeeper. llms.txt is a concierge. You can and should have both.

What is the llms.txt file format?

The format is deliberately simple. It's Markdown, and it follows a loose convention:

1. An H1 with the name of the site or project (required).
2. An optional blockquote summary describing what the site is.
3. Optional free-form Markdown paragraphs with more context.
4. One or more H2 sections, each containing a Markdown list of links. Each link may have a short : description.
5. An optional section titled ## Optional, which signals lower-priority links an AI can skip if it's short on context.

How do I write a llms.txt file? (Copy-paste example)

Here's a complete, minimal example you can adapt. Replace the domain, names, and descriptions with your own:

# AlpynAI

> AI-powered brand visibility. AlpynAI measures how ChatGPT, Claude,
> Perplexity, and Gemini reference your brand and gives you an AI Citation
> Score, competitor benchmarking, and generated fixes like schema and llms.txt.

AlpynAI helps brands understand and improve how AI answer engines describe
and cite them. Below are the key resources for understanding the product.

## Core Pages
- [Home](https://alpynai.com): Overview of AI-powered brand visibility and the free brand check.
- [How the AI Citation Score works](https://alpynai.com/citation-score): How the 0–100 score is calculated.
- [Pricing](https://alpynai.com/pricing): Free, Monitor ($4.99/mo), and Starter ($29/mo) plans.

## Guides
- [What is GEO and AEO](https://alpynai.com/guides/geo-aeo): Getting cited by AI answer engines.
- [How to improve your AI Citation Score](https://alpynai.com/guides/improve-citation-score): Practical steps.

## Optional
- [Changelog](https://alpynai.com/changelog): Product updates.
- [Careers](https://alpynai.com/careers): Open roles.

A few rules of thumb: - Keep descriptions short and factual. One clause after the colon is plenty. - Prioritize ruthlessly. This is a highlight reel, not a full sitemap. Link the 10–30 pages that best explain who you are and what you do. - Link to clean content. Where possible, point to pages that are readable without heavy scripting.

Where do I host the llms.txt file?

Host it at the root of your domain, so the final URL is:

https://yourdomain.com/llms.txt

This is the same convention as robots.txt. AI tools that look for the file expect it there, so a file buried in a subfolder (like /docs/llms.txt) won't be found by convention.

Some teams also publish an llms-full.txt — a longer file (or a companion that inlines the actual page content in Markdown) for tools that want everything in one fetch. That's optional; start with llms.txt.

How do I add llms.txt step by step?

1. Draft the content. Use the example above as a template. List your key pages with short descriptions.
2. Save it as llms.txt. Plain text, UTF-8, no .md extension needed on the filename served at the root.
3. Upload to your domain root. How you do this depends on your stack: - Static site / plain hosting: Drop the file in your public root directory (e.g. /public or /www). - Next.js / Vite / similar: Place it in the public/ folder so it's served at /llms.txt. - WordPress: Upload it via SFTP to the site root, or use a plugin that manages root files. - CDN / static host (Netlify, Vercel, Cloudflare Pages): Add it to your published output directory.
4. Verify it loads. Visit https://yourdomain.com/llms.txt in a browser. You should see the raw Markdown.
5. Keep it current. Update it when you launch major pages or restructure your site.

Does llms.txt actually help AI visibility?

This is where honesty matters. As of now: - llms.txt is not confirmed as a ranking or citation signal by any major AI engine. - Google has stated it does not support llms.txt. - Adoption is emerging and partial — some AI-native tools and documentation platforms read it; most large consumer engines have not confirmed they do.

So why add it? Because the cost is near zero and the downside is nil. If AI tooling adoption grows, you're already prepared. In the meantime, the higher-leverage moves for AI visibility are things engines do demonstrably use: clear answer-first content, accurate structured data (schema), consistent entity information across the web, and not accidentally blocking AI crawlers in your robots.txt. Treat llms.txt as a complement to those, not a substitute.

How can AlpynAI generate a llms.txt for me?

If you'd rather not hand-write the file, AlpynAI can generate one for you. It uses its URL scraper to read your existing pages, identifies your most important content, and produces a valid llms.txt (and related fixes like schema markup) that you can download and drop into your site root. You can start with a free brand check at alpynai.com — no credit card required — and see your AI Citation Score alongside the generated fixes.

FAQ

Where do I put the llms.txt file?

At the root of your domain, so it's reachable at https://yourdomain.com/llms.txt — the same location as robots.txt. Files in subfolders won't be discovered by convention.

Does Google use llms.txt?

No. Google has publicly said it does not support llms.txt, and it does not affect Google Search rankings. The file is aimed at AI tools that choose to read it, and adoption is still emerging.

Is llms.txt required for AI visibility?

No. It's optional and unproven as a ranking or citation signal. Higher-impact steps include answer-first content, accurate schema markup, consistent entity data, and making sure you aren't blocking AI crawlers in robots.txt.

What's the difference between llms.txt and robots.txt?

robots.txt tells crawlers what they may not access (rules). llms.txt gives AI models a curated Markdown map of your most important content (a highlight reel). They serve opposite purposes and can coexist.

Can AlpynAI create my llms.txt automatically?

Yes. AlpynAI scrapes your existing pages, selects your key content, and generates a valid llms.txt plus other fixes like schema. Run a free brand check at alpynai.com to get started.