Documentation reviewed
Ollama
Checked
Recheck due
Ollama runs downloaded models through an application, command line and API. Its optional cloud service processes requests remotely and has separate billing.
- Availability
- Available. Runtime available; speech currently Apple Silicon only. Cloud model availability and model-specific terms are separate.
- How to use it
- Desktop app; API. General runtime: macOS, Windows and Linux. Current Phonon packages: Apple Silicon macOS only.
- Processing and data
- On-device option; Self-hosted option; Vendor cloud; Local and cloud options. Local inference and cloud inference have different destinations. Cloud features can be disabled; a local runtime does not make cloud calls local.
- Costs and limits
- MIT runtime; local hardware/model costs; paid cloud use
- Outputs
- Model responses and embeddings where supported; current speech models generate audio. Capabilities depend on the selected model.
The October speech release requires Apple Silicon macOS. Phonon 31M uses Apache 2.0; 40M variants use noncommercial CC BY-NC 4.0. Verify the exact model and hardware.