Promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic. open source
Where it ranks
- Evals and prompt testing: Pick (78.2/100)
Pricing
Community edition free forever (open source); paid team plans.
Source: https://www.promptfoo.dev/pricing/, checked 2026-10-19
Public signals
| GitHub stars | 26.2ksource |
|---|---|
| Forks | 2.5k |
| Last push | Oct 19, 2026 |
| 7-day star change | unknown (needs 7 days of snapshots) |
| Latest stable release | 0.124.1 Oct 8, 2026 |
| Hacker News, last 30 days | 0 stories, 0 points query |
Matched by story title “promptfoo”. Title matches can include unrelated stories.
Recent releases
- code-scan-action: 0.2.2 Oct 8, 2026
0.2.2 (2026-10-08) Bug Fixes code-scan: mint OIDC after CLI installation ( #11467 ) ( 9a404c8 ) - 0.124.1 Oct 8, 2026
0.124.1 (2026-10-08) Features assertions: record cost without a threshold ( #11451 ) ( 037f1f6 ) providers: add OpenAI Decisions support ( #11454 ) ( 2dbf3ec ) providers: expose catalog text-token pricing ( #11452 ) ( 3ecce2e ) Bug Fixes assertions: preserve async expression grad - 0.124.0 Oct 6, 2026
0.124.0 (2026-10-06) ⚠ BREAKING CHANGES providers: remove hosted ChatKit provider ( #11434 ) providers: make WatsonX SDKs opt-in ( #11359 ) deps: make Langfuse SDK opt-in ( #11351 ) deps: make Slack SDK opt-in ( #11349 ) providers: make OpenAI Agents an explicit install ( #11177