Skip to content
mcp/skillhub

Model Tested MCP Server

by jelly-hamcom.modeltested/llm-benchmarksv1.0.0

Independent test scores for open-weight LLMs: best model for your GPU or Mac, comparisons.

0remoteofficial registry

context tax

~942 tok/turn5 tools

security

92/100

cold start

hosted

freshness

Activetoday

Our reading of Model Tested, from the data

Model Tested is an MCP server from jelly-ham, listed in the official MCP Registry.

Its 5 tools add about 942 tokens to every model turn (measured 2026-10-19).

Maintenance is active: the last public signal was in the last day (2026-10-18).

It runs as a hosted endpoint, so there is nothing to install.

Install Model Tested MCP server

Install in Claude Code

claude mcp add --transport http worker-jelly-ham https://modeltested.com/mcp

Remote endpoints

  • streamable-httphttps://modeltested.com/mcp

Context tax

Connecting this server adds ~942 tokens of tool definitions to every model turn (lean, 5 tools). Measured 2026-10-19 via its hosted endpoint; o200k tokenizer, worst case for clients that load all tools up front. How we measure

ModelPer 1,000 turnsWith prompt caching
Claude Opus 5.5$3.77$0.188
Claude Sonnet 5.5$1.88$0.188
Claude Haiku 5.5$0.094—

Input prices as of 2026-10-06. Excludes your own prompt and output.

Tools (5)

  • find_models258 tok

    Use this whenever the user asks which local or open-weight LLM is best, overall or for coding, documents or decisions, or which model they can run on their graphics card (VRAM) or Mac. Returns tested models ranked by our own test scores, best first; with a GPU or Mac memory size it only returns models that fit, plus the quantization to download and the memory it needs. Examples: 'best model for a 16 GB GPU', 'best coding model on a 32 GB Mac', 'best small model under 10B'.

  • decision_models159 tok

    Use this whenever the user asks about decision models or LLMs for classification, routing, triage or yes/no calls. Accuracy on our decision test (routing tickets, applying rules, spotting phishing, flagging risky code changes), how well each model's confidence matches its accuracy (calibration), and API cost per 1,000 calls. Covers dedicated decision models and regular LLMs given the same tasks.

  • get_model147 tok

    Use this whenever the user asks about a specific open-weight model: how good it is, its benchmark scores, whether it's worth using, how much VRAM or memory it needs, or which quantization to download. Returns our test scores, rank, memory at each quantization, the smallest GPU and Mac it fits, decision accuracy and our Q4 run on a Mac when there is one. Accepts a name or slug, e.g. 'qwen3.5 9b' or 'gpt-oss-20b'.

  • search_articles108 tok

    Find Model Tested articles and ranking pages by keyword, newest first: news about newly tested models, guides on quantization, Ollama and memory. Returns title, summary, date and link.

  • compare_models97 tok

    Use this whenever the user asks how two or more open-weight models compare, or which of them to pick. Returns our test scores, rank and memory needs for 2 to 6 models side by side.

Security signals

92/100 — no known issues found as of 2026-10-19, from the checks below. This is not a guarantee of safety; review what a server can do before connecting it.

Deductions

  • No license detected-5
  • No security policy (SECURITY.md)-3

Checks

  • ✓Repository hygiene (archived, activity, license, security policy)
  • ✓Tool descriptions (prompt-injection and hidden-text heuristics)
  • ○Package metadata (install scripts, provenance) — pending
  • ○Source scan (secrets, CVEs, risky code) by vectra-guard — pending

Scan it yourself before installing with vectra-guard, the open-source agent security CLI. Scoring rules

Freshness

Active — last maintenance signal today. The newest of the signals below sets the band.

  1. Last commit (default branch)

    2026-10-18 · today · GitHub

  2. Latest release

    no data · GitHub

  3. Package published

    no data · npm/PyPI

  4. Registry entry updated

    2026-10-18 · 1d ago · official registry · v1.0.0

FAQ

›How do I install the Model Tested MCP server in Claude Code?

Run: claude mcp add --transport http worker-jelly-ham https://modeltested.com/mcp. For Cursor, VS Code, Claude Desktop and Windsurf, use the install tabs above.

›Does Model Tested require an API key?

No required environment variables are declared in its published metadata.

›Can I use Model Tested as a remote (hosted) MCP server?

Yes. It is a hosted MCP server; connect to its URL with any client that supports remote MCP.

›Is Model Tested in the official MCP registry?

Yes, as com.modeltested/llm-benchmarks.

›How many tokens does Model Tested add to my context?

Its tool definitions total about 942 tokens, resent on every turn.

Sources and method

Official MCP Registry entry
updated 2026-10-18
GitHub repository
fetched 2026-10-19
Last checked against all sources
2026-10-19

The description, packages and links come from the maintainer's own published metadata. Token cost, security signals, freshness and the reading above are MCPSkillHub's own measurements; see the methodology. Spot an error? Request a correction or claim the listing.