retriEVAL MCP Server

by hcarrillo001io.github.hcarrillo001/retrieval-mcpv1.0.0

LLM evals as MCP tools: score outputs for faithfulness, relevancy, and hallucination.

0Dockerstdioofficial registry

context tax

queued

security

queued

cold start

queued

freshness

Active12d ago

Install retriEVAL MCP server

claude mcp add retrieval-hcarrillo001 -e ANTHROPIC_API_KEY='<anthropic-api-key>' -- docker run -i --rm -e ANTHROPIC_API_KEY ghcr.io/hcarrillo001/retrieval-mcp:1.0.0

{
  "mcpServers": {
    "retrieval-hcarrillo001": {
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "-e",
        "ANTHROPIC_API_KEY",
        "ghcr.io/hcarrillo001/retrieval-mcp:1.0.0"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<anthropic-api-key>"
      }
    }
  }
}

Add to ~/.cursor/mcp.json (global) or .cursor/mcp.json (project).

{
  "mcpServers": {
    "retrieval-hcarrillo001": {
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "-e",
        "ANTHROPIC_API_KEY",
        "ghcr.io/hcarrillo001/retrieval-mcp:1.0.0"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<anthropic-api-key>"
      }
    }
  }
}

Settings → Developer → Edit Config (claude_desktop_config.json), then restart.

{
  "servers": {
    "retrieval-hcarrillo001": {
      "type": "stdio",
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "-e",
        "ANTHROPIC_API_KEY",
        "ghcr.io/hcarrillo001/retrieval-mcp:1.0.0"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<anthropic-api-key>"
      }
    }
  }
}

Add to .vscode/mcp.json in your workspace.

{
  "mcpServers": {
    "retrieval-hcarrillo001": {
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "-e",
        "ANTHROPIC_API_KEY",
        "ghcr.io/hcarrillo001/retrieval-mcp:1.0.0"
      ],
      "env": {
        "ANTHROPIC_API_KEY": "<anthropic-api-key>"
      }
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json.

Configuration

Variable	Required	Secret	Description
ANTHROPIC_API_KEY	—	yes	Judge model API key. Not needed if you set RETRIEVAL_JUDGE_BACKEND=ollama to run the judge locally.
RETRIEVAL_JUDGE_BACKEND	—	—	Which judge to score with: anthropic (default), openai, or ollama for a fully local judge.
RETRIEVAL_JUDGE_MODEL	—	—	Judge model id, e.g. claude-sonnet-4-6 or qwen2.5:14b for Ollama.
RETRIEVAL_BUDGET_USD	—	—	Spend cap for judge calls. Unset means no cap.

Freshness

Active — last maintenance signal 12d ago. The newest of the signals below sets the band.

Last commit (default branch)
2026-09-28 · 12d ago · GitHub
Latest release
no data · GitHub
Package published
no data · npm/PyPI
Registry entry updated
2026-08-24 · 47d ago · official registry · v1.0.0

FAQ

›How do I install the retriEVAL MCP server in Claude Code?

Run: claude mcp add retrieval-hcarrillo001 -e ANTHROPIC_API_KEY='<anthropic-api-key>' -- docker run -i --rm -e ANTHROPIC_API_KEY ghcr.io/hcarrillo001/retrieval-mcp:1.0.0. For Cursor, VS Code, Claude Desktop and Windsurf, use the install tabs above.

›Does retriEVAL require an API key?

Yes. It expects ANTHROPIC_API_KEY, of which 1 is a secret.

›Can I use retriEVAL as a remote (hosted) MCP server?

No hosted endpoint is published; it runs locally over stdio.

›Is retriEVAL in the official MCP registry?

Yes, as io.github.hcarrillo001/retrieval-mcp.