Evals MCP Server

by mclenhard

GitHub Action for evaluating MCP server tool calls using LLM-based scoring

134Node.jsstdio

context tax

pending

security

87/100

cold start

pending

freshness

Abandoned16mo ago

Our reading of Evals, from the data

Evals is a version control MCP server from mclenhard.

We haven't measured its tool list yet, so its token cost is unknown.

It looks abandoned: the newest commit, release or package publish we found was 16 months ago (2025-06-23). For comparison, 65% of version control servers are active or maintained.

With 134 GitHub stars it ranks #42 of 725 version control servers we index.

It runs locally on your machine over stdio.

Install Evals MCP server

claude mcp add evals-mclenhard -- npx -y mcp-evals

{
  "mcpServers": {
    "evals-mclenhard": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-evals"
      ]
    }
  }
}

Add to ~/.cursor/mcp.json (global) or .cursor/mcp.json (project).

{
  "mcpServers": {
    "evals-mclenhard": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-evals"
      ]
    }
  }
}

Settings → Developer → Edit Config (claude_desktop_config.json), then restart.

{
  "servers": {
    "evals-mclenhard": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "mcp-evals"
      ]
    }
  }
}

Add to .vscode/mcp.json in your workspace.

{
  "mcpServers": {
    "evals-mclenhard": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-evals"
      ]
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json.

Security signals

87/100 — no known issues found as of 2026-10-19, from the checks below. This is not a guarantee of safety; review what a server can do before connecting it.

Deductions

No commits in over 12 months-10
No security policy (SECURITY.md)-3

Checks

✓Repository hygiene (archived, activity, license, security policy)
○Package metadata (install scripts, provenance) — pending
○Tool descriptions (prompt-injection and hidden-text heuristics) — pending
○Source scan (secrets, CVEs, risky code) by vectra-guard — pending

Scan it yourself before installing with vectra-guard, the open-source agent security CLI. Scoring rules

Freshness

Abandoned — last maintenance signal 16mo ago. The newest of the signals below sets the band.

Last commit (default branch)
2025-06-23 · 16mo ago · GitHub
Latest release
2025-05-14 · 17mo ago · GitHub · v1.0.14
Package published
no data · npm/PyPI
Registry entry updated
no data · official registry

How it compares in Version Control

Against the most-starred version control servers we index. Token cost is per model turn, measured from each server's live tool list.

Server	Stars	Tools	Tokens / turn	Freshness	Runs
Evals (this)	134	—	not measured	Abandoned	local
Git	91,356	—	not measured	Active	local
PostHog	40,338	—	not measured	Active	local + hosted
GitHub	33,740	—	not measured	Active	local + hosted
GitDiagram	18,313	3	864	Active	hosted
Skill Seekers	15,180	—	not measured	Active	—

All version control MCP servers

FAQ

›How do I install the Evals MCP server in Claude Code?

Run: claude mcp add evals-mclenhard -- npx -y mcp-evals. For Cursor, VS Code, Claude Desktop and Windsurf, use the install tabs above.

›Does Evals require an API key?

No required environment variables are declared in its published metadata.

›Can I use Evals as a remote (hosted) MCP server?

No hosted endpoint is published; it runs locally over stdio.

›Is Evals in the official MCP registry?

No. It was indexed from npm.

Sources and method

GitHub repository: fetched 2026-10-19
Package registry (npm / PyPI): listed
Security signals, computed by us: 2026-10-19
Last checked against all sources: 2026-10-19

The description, packages and links come from the maintainer's own published metadata. Token cost, security signals, freshness and the reading above are MCPSkillHub's own measurements; see the methodology. Spot an error? Request a correction or claim the listing.