Robots.txt & AI Crawler Checker MCP Server

Install in Claude Code

claude mcp add --transport http robots-check https://robots-check.quietworklabs.workers.dev/mcp

Install in Cursor

{
  "mcpServers": {
    "robots-check": {
      "url": "https://robots-check.quietworklabs.workers.dev/mcp"
    }
  }
}

Install in Claude Desktop

{
  "mcpServers": {
    "robots-check": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://robots-check.quietworklabs.workers.dev/mcp"
      ]
    }
  }
}

Or add it as a custom connector under Settings → Connectors. The config above bridges via mcp-remote.

Install in VS Code

{
  "servers": {
    "robots-check": {
      "type": "http",
      "url": "https://robots-check.quietworklabs.workers.dev/mcp"
    }
  }
}

Install in Windsurf

{
  "mcpServers": {
    "robots-check": {
      "serverUrl": "https://robots-check.quietworklabs.workers.dev/mcp"
    }
  }
}