HomeSearch & Research › crawl-readiness-mcp

crawl-readiness-mcp

Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.

TypeScript CloudLocal
★ 0 stars Last pushed 2026-09-22 License: MIT

Topics: Search & Data Extraction

Connect

Review any command before running it. Package names and URLs come from the server's own registry entry.

Package (npm 0.2.3)

npx -y [email protected]

Or add to your MCP client config:

{
  "mcpServers": {
    "crawl-readiness-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "[email protected]"
      ],
      "env": {
        "CRAWL_READINESS_API_KEY": "<YOUR_VALUE>",
        "CRAWL_READINESS_API_BASE": "<YOUR_VALUE>"
      }
    }
  }
}
  • CRAWL_READINESS_API_KEY secret — Free API key from https://www.crawlreadiness.com/dashboard. The four audit tools work without it; the three generators and get_monitor_trend need it.
  • CRAWL_READINESS_API_BASE — Override the API base URL. Only useful for testing against a preview deployment; defaults to https://www.crawlreadiness.com.

Related servers

Listed in punkpeye/awesome-mcp-servers (MIT)

Data from the Official MCP Registry