Documentation reviewed
Foundry Local
Checked
Recheck due
Foundry Local embeds model acquisition and inference in an application. Its SDK is generally available; the optional CLI is separately labeled public preview in the current repository.
- Availability
- Mixed feature stages. Core SDK GA; optional CLI public preview. Azure Local or other related product stages must be checked separately.
- How to use it
- Library / CLI; API. Supported Windows, Apple Silicon macOS and Linux configurations; model/hardware compatibility varies.
- Processing and data
- On-device option. The documented inference path runs on-device after model acquisition. Usage telemetry may be sent to Microsoft; inspect the SDK privacy and application configuration.
- Costs and limits
- Local inference without provider token billing; device/model costs
- Outputs
- Application chat responses and supported audio transcription through SDKs or an optional local API server.
Use supported catalog models and hardware. The MIT SDK, Microsoft-licensed CLI and downloaded model terms differ. It is intended for device applications, not a general multi-user inference server.