11 open-source agents tracked · Ranked by trust score · Updated 2026-06-04 18:04 UTC
HVTracker independently evaluates 11 open-source llm gateways & infra using daily signals from GitHub, package registries, and security databases. Each agent is scored on activity, adoption, transparency, safety, and identity. The top-ranked llm gateways & infra is LiveKit Agents with a trust score of 91.2/100 (Grade A). Other leading projects include vLLM and LiteLLM.
| # | Agent | Trust | Stars | Language |
|---|---|---|---|---|
| 1 | LiveKit Agents A Listed A framework for building realtime voice AI agents 🤖🎙️📹 | 91.2 | 10.8k | Python |
| 2 | vLLM B Listed A high-throughput and memory-efficient inference and serving engine for LLMs | 78.1 | 81.9k | Python |
| 3 | LiteLLM B Listed Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails | 77.1 | 49.3k | Python |
| 4 | E2B B Listed Open-source, secure environment with real-world tools for enterprise-grade agents. | 72.5 | 12.5k | Python |
| 5 | Ollama B Listed Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. | 67.1 | 173.2k | Go |
| 6 | Portkey AI Gateway B Listed A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API | 66.7 | 12.0k | TypeScript |
| 7 | Jan B Listed Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. | 66.3 | 42.9k | TypeScript |
| 8 | Traceroot C Listed TraceRoot - open-source observability and self-healing layer for AI agents. YC S25 | 62.8 | 604 | TypeScript |
| 9 | Holmesgpt C Listed SRE Agent - CNCF Sandbox Project | 61.5 | 2.6k | Python |
| 10 | LocalAI D Listed LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU requir | 37.0 | 46.7k | Go |
| 11 | TEN Framework D Listed Open-source framework for conversational voice AI agents | 25.2 | 10.6k | Python |