Skip to content
Agent Search Engine.

Recorded software licenses

Best open-source agent infrastructure

Projects with recognized open-source software licenses recorded in the agent infrastructure index, ordered by recorded GitHub star count. Stars measure repository interest, not task performance, active users, or maintenance quality. Use this list to compare options, then check each project’s current license, activity, model requirements, and operating costs. Sponsorship never affects the order. Right now it's led by Ollama (187k stars), with mem0 and Langfuse following. Order follows the recorded star counts; repository activity is shown separately.

28 open-source records · all agent infrastructure · more best-of lists · how we rank

Tools in this collection

OllamaInfrastructureRun downloaded AI models locally, with a CLI, application and inference API.MIT runtime; local hardware/model costs; paid cloud useOpen sourcerecorded license: MITRecord checked · Recent push 187kGitHub starsmem0InfrastructureUniversal memory layer for AI AgentsCode and infrastructure/model costs; managed allowances then usageOpen sourcePython · recorded license: Apache-2.0Record checked · Recent push 69kGitHub starsLangfuseInfrastructureAn open-source LLM engineering platform for tracing, evaluation, prompt management and debugging.Costs not checkedOpen sourceTypeScript · recorded license: MITRecord checked · Recent push 37kGitHub starsCogneeInfrastructureAn open-source memory platform that turns documents, code and conversations into a knowledge graph for agents.Costs not checkedOpen sourcePython · recorded license: Apache-2.0Record checked · Recent push 33kGitHub starsGraphitiInfrastructureA framework for building temporal context graphs that give AI agents memory of how facts change.Costs not checkedOpen sourcePython · recorded license: Apache-2.0Record checked · Recent push 33kGitHub starscuaInfrastructureOpen-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and benchmarks to train and evaluate AI agents that can control full desktops (macOS, Linux, Windows).Costs not checkedOpen sourcePython · recorded license: MITRecord checked · Recent push 32kGitHub starsComposioInfrastructureSDKs that give AI agents 1,000+ pre-authenticated toolkits, per-user sessions, triggers and a sandbox.Costs not checkedOpen sourceTypeScript · recorded license: MITRecord checked · Recent push 31kGitHub starsPromptfooInfrastructureEvaluate prompts and AI applications, and generate configured red-team tests.Community software; model/target costs; paid enterprise optionsOpen sourcerecorded license: MITRecord checked · Recent push 27kGitHub starsGoogle AI Edge GalleryPlatformTry downloaded AI models and on-device chat or media search in an experimental app.Apache-licensed app; device and model requirementsOpen sourcerecorded license: Apache-2.0Record checked · Recent push 25kGitHub starsOpikInfrastructureComet's open-source platform for LLM and agent tracing, evaluation, prompt management and monitoring.Costs not checkedOpen sourcePython · recorded license: Apache-2.0Record checked · Recent push 23kGitHub starsE2BInfrastructureOpen-source infrastructure for running AI-generated code in secure, isolated cloud sandboxes.Costs not checkedOpen sourcePython · recorded license: Apache-2.0Record checked · Recent push 15kGitHub starsgatewayInfrastructureA blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.Costs not checkedOpen sourceTypeScript · recorded license: MITRecord checked 13kGitHub stars
For agent buildersMake your product part of the discovery.Explore advertising
bifrostInfrastructureFastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.Costs not checkedOpen sourceGo · recorded license: Apache-2.0Record checked · Recent push 9.6kGitHub starsosaurusInfrastructureOwn your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built in Swift. Fully offline. Open source.Costs not checkedOpen sourceSwift · recorded license: MITRecord checked · Recent push 8.2kGitHub starssteel-browserInfrastructureOpen Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure.Costs need recheckingOpen sourceTypeScript · recorded license: Apache-2.0Record checked · Recent push 8.0kGitHub starsAIO SandboxInfrastructureAn all-in-one Docker sandbox for AI agents with a browser, shell, files, VS Code server, Jupyter and MCP.Costs not checkedOpen sourcePython · recorded license: Apache-2.0Record checked 6.4kGitHub starsHeliconeInfrastructureAn open-source AI gateway and LLM observability platform: routing, fallbacks, tracing and cost tracking.Costs not checkedOpen sourceTypeScript · recorded license: Apache-2.0Record checked · Recent push 6.3kGitHub starslemonadeInfrastructureLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8ZkCosts not checkedOpen sourceC++ · recorded license: Apache-2.0Record checked · Recent push 6.2kGitHub starsklavisInfrastructureKlavis AI: MCP integration platforms that let AI agents use tools reliably at any scaleCosts not checkedOpen sourcePython · recorded license: Apache-2.0Record checked · Recent push 5.8kGitHub starsskillhubInfrastructureSelf-hosted, open-source agent skill registry for enterprises. Publish & version skill packages, govern with RBAC and audit logs, deploy on-premise with Docker or Kubernetes.Costs not checkedOpen sourceJava · recorded license: Apache-2.0Record checked · Recent push 5.4kGitHub starsmcpoInfrastructureA simple, secure MCP-to-OpenAPI proxy serverCosts not checkedOpen sourcePython · recorded license: MITRecord checked 4.4kGitHub starskagentInfrastructureA Kubernetes-native framework for building, deploying and managing AI agents as custom resources.Costs not checkedOpen sourceGo · recorded license: Apache-2.0Record checked · Recent push 4.4kGitHub starsmetamcpInfrastructureMCP Aggregator, Orchestrator, Middleware, Gateway in one dockerCosts not checkedOpen sourceTypeScript · recorded license: MITRecord checked · Recent push 2.8kGitHub starsmlx-serveInfrastructureNative LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.Costs not checkedOpen sourceZig · recorded license: MITRecord checked · Recent push 2.5kGitHub starstoolhiveInfrastructureToolHive is an enterprise-grade platform for running and managing Model Context Protocol (MCP) servers.Costs not checkedOpen sourceGo · recorded license: Apache-2.0Record checked · Recent push 2.3kGitHub starsai-devkitInfrastructureThe control plane for AI coding agents.Costs not checkedOpen sourceTypeScript · recorded license: MITRecord checked · Recent push 1.7kGitHub starsHOL GuardInfrastructureLocal policy checks, approval prompts and action receipts for supported agent tools.Costs not checkedOpen sourcePython · recorded license: Apache-2.0Record checked · Recent push 1.1kGitHub starsMCP-BridgeInfrastructureA middleware to provide an openAI compatible endpoint that can call MCP toolsCosts not checkedOpen sourcePython · recorded license: MITRecord checked 922GitHub stars

Frequently asked

What are the best open-source agent infrastructure?
Use the projects below as a comparison list ordered by recorded GitHub stars. A higher star count does not establish the best fit or prove continued maintenance; compare the project’s capabilities, license, and current activity for your task.
Are open-source agent infrastructure free?
An open-source software license does not make an entire deployment free. Check the license and any hosting, model, API, or managed-service costs; some projects require external accounts or providers.
Open-source or commercial agent infrastructure — which should I choose?
Compare source access, license obligations, deployment options, data handling, support, and total costs. An open-source client may still use a hosted model or service. Both open-source and commercial options appear in the full agent infrastructure category.