How It Works SEO Safety Pro Features Free vs Pro Pricing Documentation FAQ
Home / Docs / llms.txt & Corpus Generator (Pro)

llms.txt & llms-full.txt Standard (Pro)

Automate the generation of emerging AI discovery standards (/llms.txt and /llms-full.txt) directly from your WordPress content structure.

1. What is the llms.txt Standard?

llms.txt is a web standard proposal designed to provide Large Language Models and AI crawlers with a structured, high-signal index of a website's core documentation and content:

  • /llms.txt (Index Manifest): A concise overview containing your site's project title, summary, and organized markdown links to essential articles, guides, and pages.
  • /llms-full.txt (Full Corpus): A consolidated, continuous markdown text stream of all published articles for bulk AI ingestion or offline context training.

2. Automated Generation in WordPress

With the Pro add-on enabled, AI Markdown Generator automatically manages both files without requiring manual file uploads or static file edits:

1

Automated URL Discovery

The generator dynamically queries your published posts, pages, and enabled custom post types, generating standardized markdown links with post excerpts.

2

Auto-Discovery HTML Tags

The plugin injects standardized <link rel="alternate"> tags into your site's HTML header, allowing AI bots to automatically detect the manifest when visiting your homepage.

3

Intelligent Cache Layer

Both manifest files are cached in the local WordPress transient/disk store and automatically purged whenever a post is published, updated, or deleted.

3. Verifying llms.txt via curl

You can verify that the manifests are live using your terminal:

Terminal / Bash Verify Manifest Output
# Inspect the /llms.txt manifest
curl -i https://your-site.com/llms.txt

# Inspect the /llms-full.txt corpus
curl -i https://your-site.com/llms-full.txt
Expected Result
  • HTTP Status: 200 OK
  • Content-Type: text/plain; charset=UTF-8
  • Formatted H1 header with site name and organized markdown list of post links.
Common Mistakes
  • Creating physical llms.txt files in the web root directory (a physical file will override WordPress rewrite rules).
  • Including non-public custom post types in the manifest.