RAGScore MCP Server

by hzyaiio.github.HZYAI/ragscorev0.8.6

Generate QA datasets & evaluate RAG systems with failure diagnosis. Any LLM.

15Pythonstdioofficial registry

context tax

queued

security

queued

cold start

queued

freshness

Slowing5mo ago

Install RAGScore MCP server

claude mcp add ragscore -e OPENAI_API_KEY='<openai-api-key>' -e ANTHROPIC_API_KEY='<anthropic-api-key>' -- uvx ragscore

{
  "mcpServers": {
    "ragscore": {
      "command": "uvx",
      "args": [
        "ragscore"
      ],
      "env": {
        "OPENAI_API_KEY": "<openai-api-key>",
        "ANTHROPIC_API_KEY": "<anthropic-api-key>"
      }
    }
  }
}

Add to ~/.cursor/mcp.json (global) or .cursor/mcp.json (project).

{
  "mcpServers": {
    "ragscore": {
      "command": "uvx",
      "args": [
        "ragscore"
      ],
      "env": {
        "OPENAI_API_KEY": "<openai-api-key>",
        "ANTHROPIC_API_KEY": "<anthropic-api-key>"
      }
    }
  }
}

Settings → Developer → Edit Config (claude_desktop_config.json), then restart.

{
  "servers": {
    "ragscore": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "ragscore"
      ],
      "env": {
        "OPENAI_API_KEY": "<openai-api-key>",
        "ANTHROPIC_API_KEY": "<anthropic-api-key>"
      }
    }
  }
}

Add to .vscode/mcp.json in your workspace.

{
  "mcpServers": {
    "ragscore": {
      "command": "uvx",
      "args": [
        "ragscore"
      ],
      "env": {
        "OPENAI_API_KEY": "<openai-api-key>",
        "ANTHROPIC_API_KEY": "<anthropic-api-key>"
      }
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json.

Configuration

Variable	Required	Secret	Description
OPENAI_API_KEY	—	yes	OpenAI API key (if using OpenAI provider)
ANTHROPIC_API_KEY	—	yes	Anthropic API key (if using Anthropic provider)

Freshness

Slowing — last maintenance signal 5mo ago. The newest of the signals below sets the band.

Last commit (default branch)
2026-05-25 · 5mo ago · GitHub
Latest release
2026-02-15 · 8mo ago · GitHub · v0.7.0
Package published
no data · npm/PyPI
Registry entry updated
2026-05-19 · 5mo ago · official registry · v0.8.6

FAQ

›How do I install the RAGScore MCP server in Claude Code?

Run: claude mcp add ragscore -e OPENAI_API_KEY='<openai-api-key>' -e ANTHROPIC_API_KEY='<anthropic-api-key>' -- uvx ragscore. For Cursor, VS Code, Claude Desktop and Windsurf, use the install tabs above.

›Does RAGScore require an API key?

Yes. It expects OPENAI_API_KEY, ANTHROPIC_API_KEY, of which 2 are secrets.

›Can I use RAGScore as a remote (hosted) MCP server?

No hosted endpoint is published; it runs locally over stdio.

›Is RAGScore in the official MCP registry?

Yes, as io.github.HZYAI/ragscore.