Skip to content
Agents tracked: 502 Releases (7d): 613 Agent status: 4 with issuesSince last limit reset: Claude 7d · Codex 5d For AI agents: Markdown Updated Nov 18, 2026

Promptfoo

LLM evaluation and security testing tool for vulnerability scanning and red teaming.

LLM observability and evals

1. Price

Free tier: Free (open source). As reported on the official pricing page, checked Nov 8, 2026.

promptfoo.dev/pricing/

Checked against the maker's official pages, pricing on Nov 8, 2026. Tap a verdict to see its source.How we checkedReport an error

What Promptfoo does

LLM evaluation and security testing tool for vulnerability scanning and red teaming.

  • Promptfoo is one of 22 APIs in the LLM observability and evals category on AgentGid.
  • It is one of 20 that can be started for free.
  • 8 of them ship an official MCP server; Promptfoo does not.

Promptfoo popularity

No public usage numbers for Promptfoo yet: it has no official SDK on npm or PyPI that we track.

SDK downloads from npm and PyPI, weekly. Numbers as of Nov 17, 2026.

Pricing

Free tier

Free (open source)

Cheapest plan

No monthly plan

Usage price

—

As reported on the official pricing page, checked Nov 8, 2026. Prices change: confirm before you buy. promptfoo.dev/pricing

Use it from an agent

Our agent check

3 of 6: llms.txt yes, OpenAPI yes, SDK no, MCP no, status page no, AI assistants allowed yes

Checked Nov 15, 2026.

MCP server

None found

Alternatives

Promptfoo This page

Free (open source)Free tier

LangSmith

Tracing, evaluation and monitoring of LLM apps and agents, including prompt and dataset management.

from $39/seat perFree tierOfficial MCP

Pydantic Logfire

Observability platform for AI agents, services, and infrastructure with tracing, logging, and metrics.

from $2 per million recordsFree tier

Laminar

Trace intelligence platform for observing and debugging AI agent runs.

from $0.01/cached MtokFree tier

W&B Weave

Tracing, evaluation and monitoring of LLM apps and agents, logged from Python or TypeScript code.

Free (open source)Free tierOfficial MCP

All llm observability and evals APIs

Get started

No step-by-step start for Promptfoo yet: we have not written its hand-checked card. Its official docs are linked at the top.