Ragas by Vibrant Labs
Open-source Python library for evaluating RAG and LLM applications with metrics and test-data generation.
LLM observability and evals Open source
Price
Free (open source)
you pay only for the compute it runs on
Free tier
Open source
SDK downloads
—
PyPI ragas
Status
—
no public status page
Pricing
| Free tier | — |
|---|---|
| Cheapest paid plan | — |
| Usage price | — |
| Good to know | Library only; no hosted plan or pricing listed on the docs site. GitHub repo moved to vibrantlabsai/ragas. |
Open source: free to run on your own hardware; you pay only for the compute. Checked
Use it from an agent
| MCP server | None found |
|---|---|
| PyPI | pip install ragas |
Alternatives to Ragas
| API | Free | Price | SDK downloads / wk | GitHub stars | MCP |
|---|---|---|---|---|---|
| Opik Platform for tracing, testing, and evaluating AI agents and LLM applications. |
25k spans/month, 60-day retention | Free plan · paid from $19/mo | — | — | |
| Pydantic Logfire Observability platform for AI agents, services, and infrastructure with tracing, logging, and metrics. |
10 million spans, logs, or metrics per month | Free plan · paid from $49/mo | — | — | |
| Arize AX Observability and evaluation platform for AI agents and LLM applications. |
10 issues/month, 25k trace spans/month, 1 GB... | Free plan · paid from $50/mo | — | — | |
| Arthur AI Monitor AI model performance and ship trustworthy agents with governance and observability. |
4 use cases, 7-day data retention, 5k jobs,... | Free plan · paid from $60/mo | — | — | |
| Braintrust Observability platform for AI applications with tracing, evaluation, and storage infrastructure. |
1 GB processed data/month, 10k scores/month,... | Free plan · paid from $249/mo | — | — | |
| Confident AI LLM evaluation and observability platform for testing and monitoring AI applications. |
Free Forever: 5 test runs/week, 1 GB-month... | Free plan · paid from $200/mo | — | — |