MCP LLMS.txt Explorer

@thedaviddias

About MCP LLMS.txt Explorer

MCP to explore websites with llms.txt files

#mcp #cursor #llmstxt #llms-txt #mcp-server

Config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "mcp-llms-txt-explorer": {
      "command": "npx",
      "args": [
        "-y",
        "@smithery/cli",
        "install",
        "@thedaviddias/mcp-llms-txt-explorer",
        "--client",
        "claude"
      ]
    }
  }
}

Tools

Check if a website has llms.txt files

List known websites with llms.txt files

Overview

What is MCP LLMS.txt Explorer?

A Model Context Protocol server for exploring websites that implement the llms.txt standard. It helps discover and analyze websites with llms.txt and llms-full.txt files.

How to use MCP LLMS.txt Explorer?

Install via Smithery (npx -y @smithery/cli install @thedaviddias/mcp-llms-txt-explorer --client claude) or manually (clone, pnpm install, pnpm run build). Configure in Claude Desktop’s JSON config. Use the tools check_website (domain URL → file locations and validation status) and list_websites (returns structured data, filterable by file type).

Key features of MCP LLMS.txt Explorer?

Checks websites for llms.txt and llms-full.txt files
Parses and validates llms.txt file contents
Accesses structured data about compliant websites
Provides check_website and list_websites tools
Supports filtering by file type (llms.txt / llms-full.txt)

Use cases of MCP LLMS.txt Explorer?

Discover websites that follow the llms.txt standard
Verify a domain’s llms.txt file presence and validity
Browse a curated list of llms.txt‑compliant websites
Integrate llms.txt detection into AI‑powered research workflows

FAQ from MCP LLMS.txt Explorer

What dependencies are required?

Node.js and pnpm (for building). The server communicates over stdio.

How do I configure it for Claude Desktop?

Add a llms-txt-explorer entry to the Claude Desktop config file (MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json; Windows: %APPDATA%/Claude/claude_desktop_config.json), specifying the command (node with path to build or npx -y @thedaviddias/mcp-llms-txt-explorer).

How can I debug the server?

Use the MCP Inspector by running pnpm run inspector from the project directory.

Can I install it automatically?

Yes, via Smithery: npx -y @smithery/cli install @thedaviddias/mcp-llms-txt-explorer --client claude.

What license is this server under?

MIT License.

Frequently asked questions

What dependencies are required?

Node.js and pnpm (for building). The server communicates over stdio.

How do I configure it for Claude Desktop?

Add a `llms-txt-explorer` entry to the Claude Desktop config file (MacOS: `~/Library/Application Support/Claude/claude_desktop_config.json`; Windows: `%APPDATA%/Claude/claude_desktop_config.json`), specifying the command (`node` with path to build or `npx -y @thedaviddias/mcp-llms-txt-explorer`).