# Promptfoo alternatives

> These records overlap with Promptfoo's recorded tasks and have the same product type. The selection uses task text, then information completeness; stars and sponsorship do not set the order. Check the specific capability you need before switching.

Promptfoo's record says to avoid it if: You need a guarantee that an application is secure or cannot authorize scans against the target.

Browse on the web: https://agentsearchengine.app/alternatives/promptfoo

## Task-related research candidates

- [LangSmith](https://agentsearchengine.app/agents/langsmith) — Trace AI applications, evaluate outputs and compare changes using datasets and experiments. · Developer allowance; paid seats, usage and service entitlements · Infrastructure · License not checked · best for teams that need trace inspection, datasets and evaluations for an instrumented ai application
  - Shared terms in the records: evaluate, evaluation, prompt, team. These text matches do not establish equivalent capabilities.
  - **vs Promptfoo:** The recorded use cases differ: Promptfoo — Developers who can configure targets, assertions and model providers for repeatable evaluation or red-team runs; LangSmith — Teams that need trace inspection, datasets and evaluations for an instrumented AI application.
- [Opik](https://agentsearchengine.app/agents/opik) — Comet's open-source platform for LLM and agent tracing, evaluation, prompt management and monitoring. · Costs not checked · Infrastructure · 23k★ · Python · Open source · recorded license: Apache-2.0 · repository push 2 days ago · best for teams that want a fully self-hostable alternative to commercial llm observability tools
  - Shared terms in the records: evaluation, prompt, team. These text matches do not establish equivalent capabilities.
  - **vs Promptfoo:** The recorded use cases differ: Promptfoo — Developers who can configure targets, assertions and model providers for repeatable evaluation or red-team runs; Opik — Teams that want a fully self-hostable alternative to commercial LLM observability tools.
- [Langfuse](https://agentsearchengine.app/agents/langfuse) — An open-source LLM engineering platform for tracing, evaluation, prompt management and debugging. · Costs not checked · Infrastructure · 37k★ · TypeScript · Open source · recorded license: MIT · repository push 2 days ago · best for teams that want production-grade, self-hostable tracing and evals for llm apps
  - Shared terms in the records: evaluation, prompt, team. These text matches do not establish equivalent capabilities.
  - **vs Promptfoo:** The recorded use cases differ: Promptfoo — Developers who can configure targets, assertions and model providers for repeatable evaluation or red-team runs; Langfuse — Teams that want production-grade, self-hostable tracing and evals for LLM apps.
- [HOL Guard](https://agentsearchengine.app/agents/hol-guard) — Local policy checks, approval prompts and action receipts for supported agent tools. · Costs not checked · Infrastructure · 997★ · Python · Open source · recorded license: Apache-2.0 · repository push 2 days ago · best for developers evaluating action review and policy controls around supported coding agents
  - Shared terms in the records: developer, prompt, security. These text matches do not establish equivalent capabilities.
  - **vs Promptfoo:** The recorded use cases differ: Promptfoo — Developers who can configure targets, assertions and model providers for repeatable evaluation or red-team runs; HOL Guard — Developers evaluating action review and policy controls around supported coding agents.
- [APIClaw](https://agentsearchengine.app/agents/apiclaw) — Configure compatible coding clients to use an alternative hosted model gateway. · Paid product · Infrastructure · License not checked · best for developers evaluating a third-party model endpoint for a compatible coding client
  - Shared terms in the records: configure, developer. These text matches do not establish equivalent capabilities.
  - **vs Promptfoo:** The recorded use cases differ: Promptfoo — Developers who can configure targets, assertions and model providers for repeatable evaluation or red-team runs; APIClaw — Developers evaluating a third-party model endpoint for a compatible coding client.
- [FoxPhone](https://agentsearchengine.app/agents/foxphone) — Cloud Android environments for scripted mobile testing and automation. · Paid product · Infrastructure · License not checked · best for developers evaluating remote android environments for authorized mobile automation
  - Shared terms in the records: developer, testing. These text matches do not establish equivalent capabilities.
  - **vs Promptfoo:** The recorded use cases differ: Promptfoo — Developers who can configure targets, assertions and model providers for repeatable evaluation or red-team runs; FoxPhone — Developers evaluating remote Android environments for authorized mobile automation.
- [Ollama](https://agentsearchengine.app/agents/ollama) — Run downloaded AI models locally, with a CLI, application and inference API. · MIT runtime; local hardware/model costs; paid cloud use · Infrastructure · Open source · recorded license: MIT · best for developers and hands-on users who want a local model runtime and api
  - Shared terms in the records: developer, who. These text matches do not establish equivalent capabilities.
  - **vs Promptfoo:** The recorded use cases differ: Promptfoo — Developers who can configure targets, assertions and model providers for repeatable evaluation or red-team runs; Ollama — Developers and hands-on users who want a local model runtime and API.
- [Arize Phoenix](https://agentsearchengine.app/agents/arize-phoenix) — Arize's source-available AI observability platform for tracing, evaluation, datasets and experiments. · Self-host software; infrastructure and evaluator/model costs · Infrastructure · 12k★ · Python · Source available · recorded license: Elastic-2.0 · repository push 2 days ago · best for teams that want self-hosted tracing and evals built on opentelemetry standards
  - Shared terms in the records: evaluation, team. These text matches do not establish equivalent capabilities.
  - **vs Promptfoo:** The recorded use cases differ: Promptfoo — Developers who can configure targets, assertions and model providers for repeatable evaluation or red-team runs; Arize Phoenix — Teams that want self-hosted tracing and evals built on OpenTelemetry standards.

8 task-related records from 60 category candidates.

Complete category directory (not equivalent substitutes): https://agentsearchengine.app/category/agent-infrastructure

## FAQ

**How were alternatives to Promptfoo selected?**
Recorded task topics and meaningful shared terms qualify same-type candidates in the same category. Results are ordered by that overlap, then information completeness and a stable identifier. Sponsorship and GitHub stars do not participate. The method can miss suitable tools whose records lack task information.

**Does inclusion mean a tested replacement?**
No. These are catalogue-based research candidates. Check current sources, costs, permissions and deployment requirements, then test your own task. ASE has not run a performance benchmark of this shortlist.

---
Source: [Agent Search Engine](https://agentsearchengine.app) — https://agentsearchengine.app/alternatives/promptfoo
