Robots Txt Checker MCP Server
io.github.ryuamarines/robots-txt-checkerv1.0.93057
Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).
context tax
queued
security
queued
cold start
queued
freshness
Maintained38d ago
Install Robots Txt Checker MCP server
Install in Claude Code
claude mcp add --transport http robots-txt-checker https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcpInstall in Cursor
{
"mcpServers": {
"robots-txt-checker": {
"url": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
}
}
}Install in Claude Desktop
{
"mcpServers": {
"robots-txt-checker": {
"command": "npx",
"args": [
"-y",
"mcp-remote",
"https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
]
}
}
}Or add it as a custom connector under Settings → Connectors. The config above bridges via mcp-remote.
Install in VS Code
{
"servers": {
"robots-txt-checker": {
"type": "http",
"url": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
}
}
}Install in Windsurf
{
"mcpServers": {
"robots-txt-checker": {
"serverUrl": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
}
}
}Remote endpoints
- streamable-http
https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp
Freshness
Maintained — last maintenance signal 38d ago. The newest of the signals below sets the band.
Last commit (default branch)
no data · GitHub
Latest release
no data · GitHub
Package published
no data · npm/PyPI
Registry entry updated
2026-09-02 · 38d ago · official registry · v1.0.93057
FAQ
›How do I install the Robots Txt Checker MCP server in Claude Code?
Run: claude mcp add --transport http robots-txt-checker https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp. For Cursor, VS Code, Claude Desktop and Windsurf, use the install tabs above.
›Does Robots Txt Checker require an API key?
No required environment variables are declared in its published metadata.
›Can I use Robots Txt Checker as a remote (hosted) MCP server?
Yes. It is a hosted MCP server; connect to its URL with any client that supports remote MCP.
›Is Robots Txt Checker in the official MCP registry?
Yes, as io.github.ryuamarines/robots-txt-checker.