EvalForge Lite MCP Server
by thejaredchapmanio.github.thejaredchapman/evalforge-litev1.0.1
Compare text LLMs across OpenRouter, Bedrock, Vertex AI and Foundry with automated grading.
context tax
queued
security
queued
cold start
queued
freshness
Active8d ago
Install EvalForge Lite MCP server
Install in Claude Code
claude mcp add evalforge-lite -e OPENROUTER_API_KEY='<openrouter-api-key>' -- uvx evalforge-liteInstall in Cursor
{
"mcpServers": {
"evalforge-lite": {
"command": "uvx",
"args": [
"evalforge-lite"
],
"env": {
"OPENROUTER_API_KEY": "<openrouter-api-key>"
}
}
}
}Add to ~/.cursor/mcp.json (global) or .cursor/mcp.json (project).
Install in Claude Desktop
{
"mcpServers": {
"evalforge-lite": {
"command": "uvx",
"args": [
"evalforge-lite"
],
"env": {
"OPENROUTER_API_KEY": "<openrouter-api-key>"
}
}
}
}Settings → Developer → Edit Config (claude_desktop_config.json), then restart.
Install in VS Code
{
"servers": {
"evalforge-lite": {
"type": "stdio",
"command": "uvx",
"args": [
"evalforge-lite"
],
"env": {
"OPENROUTER_API_KEY": "<openrouter-api-key>"
}
}
}
}Add to .vscode/mcp.json in your workspace.
Install in Windsurf
{
"mcpServers": {
"evalforge-lite": {
"command": "uvx",
"args": [
"evalforge-lite"
],
"env": {
"OPENROUTER_API_KEY": "<openrouter-api-key>"
}
}
}
}Add to ~/.codeium/windsurf/mcp_config.json.
Configuration
| Variable | Required | Secret | Description |
|---|---|---|---|
| OPENROUTER_API_KEY | — | yes | Optional. OpenRouter API key held by the server so tool calls need no credentials for OpenRouter. If unset, pass creds in each tool call. |
Freshness
Active — last maintenance signal 8d ago. The newest of the signals below sets the band.
Last commit (default branch)
2026-10-02 · 8d ago · GitHub
Latest release
no data · GitHub
Package published
no data · npm/PyPI
Registry entry updated
2026-10-01 · 8d ago · official registry · v1.0.1
FAQ
›How do I install the EvalForge Lite MCP server in Claude Code?
Run: claude mcp add evalforge-lite -e OPENROUTER_API_KEY='<openrouter-api-key>' -- uvx evalforge-lite. For Cursor, VS Code, Claude Desktop and Windsurf, use the install tabs above.
›Does EvalForge Lite require an API key?
Yes. It expects OPENROUTER_API_KEY, of which 1 is a secret.
›Can I use EvalForge Lite as a remote (hosted) MCP server?
No hosted endpoint is published; it runs locally over stdio.
›Is EvalForge Lite in the official MCP registry?
Yes, as io.github.thejaredchapman/evalforge-lite.