MCPBench
The evaluation benchmark on MCP servers
About
MCPBench is an evaluation framework for MCP Servers. It supports the evaluation of three types of servers: Web Search, Database Query and GAIA, and is compatible with both local and remote MCP Servers. The framework primarily evaluates different MCP Servers (such as Brave Search, DuckDuckGo, etc.) in terms of task completion accuracy, latency, and token consumption under the same LLM and Agent configurations. Here is the evaluation report.
Open Source Health
- Stars
- 251
- Forks
- 16
- License
- Apache-2.0
- Last commit
- 1 years ago
Related Categories
Vendor
ModelScope
Publisher of FunASR, Ms Swift and ClearerVoice-Studio
Quick Links
Open Source
More by ModelScope
Related Products
VictoriaMetrics
VictoriaMetrics: fast, cost-effective monitoring solution and time series database
Top category match
Redislite
Redis built into a python package
Top category match
Egads
A Java package to automatically detect anomalies in large scale time-series data
Top category match
libSQL
libSQL is a fork of SQLite that is both Open Source, and Open Contributions.
Top category match
TiKV
Distributed transactional key-value database, originally created to complement TiDB
Top category match