Skip to content
Agents tracked: 501 Releases (7d): 777 Agent status: no reported issuesSince last limit reset: Claude 10d · Codex 8d For AI agents: Markdown Updated Nov 21, 2026

promptfoo

Tests, evaluates and red-teams LLM prompts and apps.

Prompts, structured output and evalsNPM

GitHubWebsite

1. License

License from npm.

github.com/promptfoo/promptfoo

From the package registry and GitHub, checked daily. Tap a verdict to see its source.How we checkedReport an error

What promptfoo does

Tests, evaluates and red-teams LLM prompts and apps.

promptfoo popularity

58 / 100
Gid Score, #1058 overall
1.2M
downloads a week, npm
27.4K
GitHub stars
9
agent projects use it
promptfoo: downloads per weeknpm, promptfoo 1,206,612
promptfoo: GitHub starspromptfoo/promptfoo 27,350

Gid Score measures public popularity and activity, not quality. How the Gid Score is calculated

How promptfoo is used

  • promptfoo is a dependency in 9 of the 6,255 public GitHub projects set up for AI coding agents that we scanned, too few to describe it from them alone. Our scan also samples projects by dependency (Solana 3,064, Ethereum and EVM 1,779, 3D and games 3,123, agent frameworks and SDKs 13,665); counting those, it appears in 35 projects, and what it is used with below comes from all of them.
  • The most used alternative in our scan is Evalite (2 projects).
  • Projects that use it most often also use tsx (82.9%), Playwright (JavaScript) (77.1%), Vitest (80.0%).

By coding agent

9 projects, 0.3%
6 projects, 0.2%
5 projects, 1.1%

Often used with

In 82.9% of its projects
In 77.1% of its projects
In 80.0% of its projects
In 85.7% of its projects
In 74.3% of its projects
In 68.6% of its projects
In 71.4% of its projects
In 71.4% of its projects

More about promptfoo

Funding
  • GitHub Sponsors: https://github.com/typpo
  • 3 GitHub sponsors

See all

Agent Skills for it
  • promptfoo-evaluation: Configures and runs LLM evaluation using Promptfoo framework. Use when setting up prompt testing, creating evaluation configs (promptfooconf

See all

More in Prompts, structured output and evals

Alternatives

promptfoo This page

MITGid 581.2M/wk

Evalite

TypeScript eval runner for LLM apps, built on Vitest.

MITGid 42483K/wk

Compare promptfoo with another tool

Get started

Install it.

npm install promptfoo

No step-by-step start for promptfoo yet: we have not written its hand-checked card.