A
securityA
licenseA
qualityAn MCP server that provides LLMs access to other LLMs
Last updated -
28
66
MIT License
MCP vLLM 基准测试工具
这是关于如何使用 MCP 以交互方式对 vLLM 进行基准测试的概念证明。
我们对基准测试并不陌生，请阅读我们的博客：
这只是对 MCP 可能性的探索。
用法
克隆存储库
将其添加到您的 MCP 服务器：
{
"mcpServers": {
"mcp-vllm": {
"command": "uv",
"args": [
"run",
"/Path/TO/mcp-vllm-benchmarking-tool/server.py"
]
}
}
}
然后你可以像这样提示：
Do a vllm benchmark for this endpoint: http://10.0.101.39:8888
benchmark the following model: deepseek-ai/DeepSeek-R1-Distill-Llama-8B
run the benchmark 3 times with each 32 num prompts, then compare the results, but ignore the first iteration as that is just a warmup.
待办事项：
由于 vllm 的一些随机输出，它可能显示发现了一些无效的 json。我还没有深入研究过这个问题。
This server cannot be installed
remote-capable server
The server can be hosted and run remotely because it primarily relies on remote services or has no dependency on the local environment.
一种交互式工具，使用户能够通过 MCP 对 vLLM 端点进行基准测试，从而允许使用可自定义的参数对 LLM 模型进行性能测试。
Related MCP Servers
- -securityAlicense-qualityAn MCP server that allows agents to test and compare LLM prompts across OpenAI and Anthropic models, supporting single tests, side-by-side comparisons, and multi-turn conversations.Last updated -MIT License
- -securityFlicense-qualityAn MCP server that integrates various penetration testing tools, enabling security professionals to perform reconnaissance, vulnerability scanning, and API testing through natural language commands in compatible LLM clients like Claude Desktop.Last updated -4
- -securityAlicense-qualityConnects local LLMs to external tools (calculator, knowledge base) via MCP protocol, enabling automatic tool detection and execution to enhance query responses.Last updated -MIT License