AI Discovery Files - Templates & Specifications

Welcome to AI Discovery Files

AI Discovery Files are a standardized set of files that help AI systems understand and interact with your website or service. These files are organized into three layers, each serving a specific purpose in establishing your digital identity and controlling how AI systems access and use your content.

Core Identity Layer

Establishes your fundamental identity and makes it accessible to both AI and humans.

llms.txt

Plain text file that establishes your fundamental identity for AI systems.

https://example.com/llms.txt

Purpose: Primary identity file for AI systems
Format: Plain text (Markdown-style)

identity.json

Provides the same identity information in structured JSON format for programmatic access.

https://example.com/identity.json

Purpose: Structured identity data
Format: JSON

llms.html

Human-readable version that makes identity information accessible through web browsers.

https://example.com/llms.html

Purpose: Human-readable identity page
Format: HTML

Control Layer

Sets permissions and controls for how AI systems can interact with your content.

ai.txt

Sets permissions and rules for AI content usage, similar to robots.txt but specifically for AI systems.

https://example.com/ai.txt

Purpose: AI content usage permissions
Format: Plain text with directives

brand.txt

Controls naming, terminology, and brand guidelines for how AI systems should refer to your organization.

https://example.com/brand.txt

Purpose: Brand naming and terminology control
Format: Plain text with key-value pairs

robots-ai.txt

Manages AI crawler access and behavior, extending the traditional robots.txt for AI-specific crawlers.

https://example.com/robots-ai.txt

Purpose: AI crawler access management
Format: robots.txt-style directives

Enhancement Layer

Provides additional context and verified information to enhance AI interactions.

faq-ai.txt

Provides verified answers to frequently asked questions, ensuring AI systems have accurate information.

https://example.com/faq-ai.txt

Purpose: Verified FAQ responses for AI
Format: Q&A pairs in plain text

developer-ai.txt

Adds technical context, API documentation, and developer-specific information for AI assistants.

https://example.com/developer-ai.txt

Purpose: Technical context for developers
Format: Plain text with technical details

Getting Started

Quick Start Guide

Start with the Core Identity Layer - Create llms.txt with your basic information
Add the Control Layer - Define how AI systems should interact with your content
Enhance with the Enhancement Layer - Provide additional context as needed
Place files in your website's root directory
Test accessibility at https://yourdomain.com/[filename]

Templates & Examples

Below are the latest AI Discovery File templates, pulled directly from the ai-discovery-files repository.

Files are fetched at build time. A GitHub badge means the content is live from the repo; Template means it's using a built-in example.

llms.txt

Template

# [Your Organization Name]

## About
[Brief description of your organization, product, or service]

## Mission
[Your mission statement or primary purpose]

## Contact
- Website: https://example.com
- Email: contact@example.com
- Support: support@example.com

## Key Information
- Founded: [Year]
- Location: [City, Country]
- Industry: [Your Industry]

## Products/Services
- [Product/Service 1]: [Brief description]
- [Product/Service 2]: [Brief description]

## Additional Resources
- Documentation: https://docs.example.com
- Blog: https://blog.example.com
- GitHub: https://github.com/yourorg

identity.json

Template

{
  "name": "Your Organization Name",
  "description": "Brief description of your organization",
  "url": "https://example.com",
  "contact": {
    "email": "contact@example.com",
    "support": "support@example.com"
  },
  "founded": "YYYY",
  "location": {
    "city": "City Name",
    "country": "Country"
  },
  "industry": "Your Industry",
  "products": [
    {
      "name": "Product 1",
      "description": "Product description"
    }
  ],
  "social": {
    "github": "https://github.com/yourorg",
    "twitter": "https://twitter.com/yourorg"
  }
}

ai.txt

Template

# AI Content Usage Permissions

# Allow AI systems to use content for:
Allow: training
Allow: answering-queries
Allow: summarization

# Disallow AI systems from:
Disallow: commercial-redistribution
Disallow: impersonation

# Attribution
Attribution: required
Attribution-format: [Your Organization] - [URL]

# Contact for AI-related inquiries
Contact: ai@example.com

brand.txt

Template

# Brand Guidelines for AI

# Official Name
name: Your Organization Name
short-name: YourOrg

# Terminology
product-name: Your Product
avoid-terms: [terms to avoid]
preferred-terms: [preferred terminology]

# Voice and Tone
voice: professional, friendly
tone: helpful, informative

# Key Messages
tagline: Your memorable tagline
mission: Your mission in one sentence

robots-ai.txt

Template

# AI Crawler Access Control

User-agent: GPTBot
Allow: /
Disallow: /private/

User-agent: ChatGPT-User
Allow: /

User-agent: Claude-Web
Allow: /

User-agent: *
Crawl-delay: 10
Disallow: /admin/
Disallow: /internal/

faq-ai.txt

Template

# Frequently Asked Questions for AI

## What is [Your Organization]?
[Your Organization] is [description]. We provide [key offerings].

## How do I get started?
To get started with [Product/Service], visit [URL] and follow these steps:
1. [Step 1]
2. [Step 2]
3. [Step 3]

## What are your pricing plans?
We offer [pricing structure]. For detailed pricing, visit [pricing-url].

## How can I contact support?
You can reach our support team at support@example.com or visit [support-url].

## Do you offer [specific feature]?
Yes/No, [explanation and details].

developer-ai.txt

Template

# Developer Information for AI

## API
- Base URL: https://api.example.com
- Version: v1
- Authentication: API Key (Bearer token)
- Documentation: https://docs.example.com/api

## SDKs
- JavaScript/TypeScript: npm install @yourorg/sdk
- Python: pip install yourorg-sdk
- Go: go get github.com/yourorg/sdk-go

## Rate Limits
- Free tier: 100 requests/hour
- Pro tier: 1000 requests/hour
- Enterprise: Custom limits

## Getting Started
1. Sign up at https://example.com/signup
2. Generate API key from dashboard
3. Install SDK: npm install @yourorg/sdk
4. Initialize: const client = new YourOrgClient(apiKey)

## Support
- Developer Docs: https://docs.example.com
- API Reference: https://docs.example.com/api-reference
- Discord: https://discord.gg/yourorg
- GitHub Issues: https://github.com/yourorg/issues

Best Practices

Keep files simple and focused on their specific purpose
Update files regularly to reflect current information
Use clear, concise language that both humans and AI can understand
Test file accessibility and formatting before publishing
Consider starting with Core Identity Layer files and expanding from there
Follow standard web conventions for file placement (root directory)
Include contact information for AI-related questions or issues