Llmtest MCP Server
by tjacquessonio.github.tjacquesson/llmtest-mcpv0.6.1
Benchmark AI models on real prompts. Find cheaper, faster alternatives across 340+ models.
context tax
queued
security
queued
cold start
queued
freshness
Slowing5mo ago
Install Llmtest MCP server
Install in Claude Code
claude mcp add llmtest -e LLMTEST_API_KEY='<llmtest-api-key>' -- npx -y llmtest-mcpInstall in Cursor
{
"mcpServers": {
"llmtest": {
"command": "npx",
"args": [
"-y",
"llmtest-mcp"
],
"env": {
"LLMTEST_API_KEY": "<llmtest-api-key>"
}
}
}
}Add to ~/.cursor/mcp.json (global) or .cursor/mcp.json (project).
Install in Claude Desktop
{
"mcpServers": {
"llmtest": {
"command": "npx",
"args": [
"-y",
"llmtest-mcp"
],
"env": {
"LLMTEST_API_KEY": "<llmtest-api-key>"
}
}
}
}Settings → Developer → Edit Config (claude_desktop_config.json), then restart.
Install in VS Code
{
"servers": {
"llmtest": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"llmtest-mcp"
],
"env": {
"LLMTEST_API_KEY": "<llmtest-api-key>"
}
}
}
}Add to .vscode/mcp.json in your workspace.
Install in Windsurf
{
"mcpServers": {
"llmtest": {
"command": "npx",
"args": [
"-y",
"llmtest-mcp"
],
"env": {
"LLMTEST_API_KEY": "<llmtest-api-key>"
}
}
}
}Add to ~/.codeium/windsurf/mcp_config.json.
Configuration
| Variable | Required | Secret | Description |
|---|---|---|---|
| LLMTEST_API_KEY | yes | yes | Your LLMTest API key from https://llmtest.io/dashboard |
Freshness
Slowing — last maintenance signal 5mo ago. The newest of the signals below sets the band.
Last commit (default branch)
2026-05-22 · 5mo ago · GitHub
Latest release
no data · GitHub
Package published
no data · npm/PyPI
Registry entry updated
2026-05-22 · 5mo ago · official registry · v0.6.1
FAQ
›How do I install the Llmtest MCP server in Claude Code?
Run: claude mcp add llmtest -e LLMTEST_API_KEY='<llmtest-api-key>' -- npx -y llmtest-mcp. For Cursor, VS Code, Claude Desktop and Windsurf, use the install tabs above.
›Does Llmtest require an API key?
Yes. It expects LLMTEST_API_KEY, of which 1 is a secret.
›Can I use Llmtest as a remote (hosted) MCP server?
No hosted endpoint is published; it runs locally over stdio.
›Is Llmtest in the official MCP registry?
Yes, as io.github.tjacquesson/llmtest-mcp.