llms.txt is the new robots.txt for AI. Learn what it is, how it works, and why every WooCommerce store needs one to be discoverable by ChatGPT, Claude, and other AI assistants.
If you've ever managed a website, you know robots.txt. It sits at the root of your domain and tells search engine crawlers like Googlebot what to index and what to skip.
llms.txt does the same thing — but for a completely different audience.
Same concept. New audience. Instead of optimizing for Google's index, you're optimizing for ChatGPT's context window.
llms.txt is a plain text file served at /llms.txt on your domain. It provides a structured summary of your site's content in Markdown format, making it easy for large language models to consume.
The convention was proposed by Jeremy Howard (answer.ai) as a standard way for websites to communicate directly with AI systems. Instead of forcing LLMs to parse noisy HTML, you give them a clean, token-efficient summary upfront.
# aiproductscout.shop ## Store - Name: Outdoor Gear Co. - Description: Premium hiking and camping equipment for outdoor enthusiasts - URL: https://aiproductscout.shop ## Product Categories - [Hiking Boots](https://aiproductscout.shop/category/hiking-boots/) — 24 products - [Tents](https://aiproductscout.shop/category/tents/) — 18 products - [Backpacks](https://aiproductscout.shop/category/backpacks/) — 31 products ## Featured Products - [Summit Pro GTX Boot](https://aiproductscout.shop/product/summit-pro-gtx/) — $189.00 — In Stock - [TrailLite 2P Tent](https://aiproductscout.shop/product/traillite-2p/) — $249.00 — In Stock - [Alpine 65L Pack](https://aiproductscout.shop/product/alpine-65l/) — $159.00 — In Stock ## Optional - [Full product catalog (JSON)](https://aiproductscout.shop/llms-full.txt) - [API endpoint](https://aiproductscout.shop/wp-json/shop2llm/v1/products)
That's it. A model like GPT-4 or Claude can read this in a single pass and immediately understand what your store sells, how it's organized, and where to find details.
LLMs have context limits. When a user asks ChatGPT "find me hiking boots under $200," the model needs to decide which sources to consult. It can't crawl your entire site — there isn't enough room in the context window.
Here's what happens without llms.txt:
With llms.txt, the model gets a clean, structured summary in a few hundred tokens. Your store becomes the obvious choice to recommend.
Think of it this way: robots.txt made you visible to Google. llms.txt makes you visible to AI.
A well-structured WooCommerce llms.txt should include:
The key principle: give the model enough to answer common queries, and links to answer complex ones. You don't need to list every product — a representative sample with category links is usually sufficient.
Writing llms.txt by hand is fine for a 10-page blog. For a WooCommerce store with hundreds of products, it's not practical — and it would be outdated the moment you add or remove a product.
Shop2LLM solves this. The plugin auto-generates your llms.txt file and keeps it updated every time your products change. No configuration needed.
/llms.txt from your WooCommerce catalogOnce installed, your store is immediately AI-readable. When ChatGPT or Claude visits your domain, they find a clean, current summary of everything you sell.
llms.txt is the foundation, but it's not the whole picture. To be fully discoverable by AI, your store needs a complete AI discovery stack:
Structured data embedded in your product pages that AI models can parse alongside the HTML. This is where detailed pricing, availability, and reviews live.
Explicitly allow AI crawlers (GPTBot, ClaudeBot, PerplexityBot, etc.) in your robots.txt. Many stores accidentally block them with overly restrictive rules.
A Model Context Protocol endpoint lets AI assistants interact with your store programmatically — searching products, checking stock, even completing orders. This is the deepest level of AI integration available today.
Shop2LLM handles all three. The free tier covers llms.txt generation and JSON-LD schema. The Pro tier adds crawler analytics, search query insights, and the MCP API endpoint.
Install Shop2LLM and get your llms.txt auto-generated in under 60 seconds. Free, no configuration needed.