# mlx-serve

> Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.

## Facts
- **Category:** [Agent Infrastructure](https://agentsearchengine.app/category/agent-infrastructure)
- **Type:** Infrastructure
- **Pricing:** Open source
- **GitHub stars:** 405
- **Language:** Zig
- **License:** MIT
- **Last repo activity:** today (Aug 3, 2026)
- **Official site:** http://mlxserve.com/
- **Source code:** https://github.com/ddalcu/mlx-serve
- **Listing on Agent Search Engine:** https://agentsearchengine.app/agents/mlx-serve
- **Data verified:** July 2026

## About mlx-serve
OpenAI- and Anthropic-compatible local inference for Apple Silicon — MLX and GGUF — faster than LM Studio on the same file. No Python. No cloud. No Electron. mlx-serve is a native Zig server that runs any LLM on Apple Silicon — MLX-format models and every GGUF on HuggingFace (Qwen, Llama, Mistral, Gemma, DeepSeek V4 Flash, thousands more). It exposes OpenAI-compatible and Anthropic-compatible HTTP APIs out of the box, so the same http://localhost:11234 works with Claude Code, the OpenAI SDK, Continue, Cursor, Open WebUI, and anything else that speaks one of those wires. Ships with MLX Core, a macOS menu-bar app with chat, agent mode, MCP tool call… Short names, org/repo HuggingFace ids, and name:tag all work. And because mlx-serve speaks the Ollama API (/api/chat, /api/generate, /api/tags, /api/embed, /api/pull, …) alongside OpenAI and Anthropic, your existing Ollama-connected tools — Raycast, Obsidian, Enchanted, Open WebUI, ollama-python/js — work unchanged: point them at http://localhost:11234 and keep your workflow, on a faster engine.

_From the project's README._

## Install

```
brew install --cask mlx-core   # GUI menu bar app
```

## Alternatives
mlx-serve sits in agent infrastructure. Related tools indexed here:
- [daytona](https://agentsearchengine.app/agents/daytona) — Daytona is a Secure and Elastic Infrastructure for Running AI-Generated Code · Open source · Infrastructure · 72k★ · active 10 days ago
- [mem0](https://agentsearchengine.app/agents/mem0) — Universal memory layer for AI Agents · Open source · Infrastructure · 62k★ · Python · Apache-2.0 · active 2 days ago
- [cua](https://agentsearchengine.app/agents/cua) — Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and benchmarks to train and evaluate AI agents that can control full desktops (macOS, Linux, Windows). · Open source · Infrastructure · 21k★ · Python · MIT · active today
- [gateway](https://agentsearchengine.app/agents/gateway) — A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API. · Open source · Infrastructure · 13k★ · TypeScript · MIT · active 2 months ago
- [Bindu](https://agentsearchengine.app/agents/bindu) — Bindu: The identity, communication, and payments layer for AI agents. · Open source · Infrastructure · 8.0k★ · Python · active 14 days ago
- [osaurus](https://agentsearchengine.app/agents/osaurus) — Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built in Swift. Fully offline. Open source. · Open source · Infrastructure · 7.5k★ · Swift · MIT · active today
- [steel-browser](https://agentsearchengine.app/agents/steel-browser) — Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure. · Open source · Infrastructure · 7.4k★ · TypeScript · Apache-2.0 · active 6 days ago
- [registry](https://agentsearchengine.app/agents/registry) — A community driven registry service for Model Context Protocol (MCP) servers. · Open source · Infrastructure · 7.1k★ · Go · active 4 days ago

---
Source: [Agent Search Engine](https://agentsearchengine.app) — an independent, hand-curated index of AI agents, MCP servers, and frameworks. Rankings are never sold; sponsored placements are labeled and never numbered. Full directory: https://agentsearchengine.app/llms-full.txt