LLMTest

Name: LLMTest
Author: PixelGrid

An OpenAI-compatible LLM proxy that routes your calls to 340+ models and adds per-feature cost tracking, automatic fallback to another model on errors or invalid JSON, model benchmarks with an AI judge, and optional weekly prompt and model optimization, plus an MCP server for your IDE.

A provider outage or a reply that is not valid JSON no longer breaks your feature, because the proxy retries on another model inside the same request, and you see what each AI feature costs.

API (paid)Commercial OK

Open llmtest.io ↗ agent.md

For your project

Official API: Official API · Paid
“Already calling an LLM API? Just swap your base URL to https://llmtest.io/v1 — the proxy is compatible with any OpenAI-format SDK.” llmtest.io/docs/quickstart
Key: Needed
“Sign up at llmtest.io/signup , add $5 in credits, and copy your API key from the dashboard. It starts with llmt_ .” llmtest.io/docs/quickstart
Formats: JSON
Data download: Not stated
Price: No free tier stated
License: LLMTest Terms & Conditions Use of the proxy, benchmarks and MCP server
Commercial use: Commercial use OK
“LLMTest provides an AI model proxy, benchmarking tools, and an MCP server that help developers optimise AI model usage.” llmtest.io/terms
Credit: Not stated
Embedding: Embedding unclear
Using the website: Paid

Read on LLMTest's own pages on Oct 24, 2026 · license or terms · API docs · pricing. Check the license page before you ship.

For your agent

Point any OpenAI SDK at base URL https://llmtest.io/v1 with an llmt_ API key; for IDE agents run 'npx -y llmtest-mcp' with LLMTEST_API_KEY set. Fallbacks show up in the x-llmtest-fallback-model response header.
Do not resell access to the proxy without written permission
Follow the terms of the underlying model providers
Calls are rejected when the prepaid credit balance reaches zero

llms.txt: llmtest.io/llms.txt · MCP: npm llmtest-mcp

Paste into your agent: Read https://agentgid.com/resources/llmtest/agent.md before using LLMTest.

Quick answers

Does LLMTest have an API?

Yes. LLMTest has an official API documented at https://llmtest.io/docs/quickstart.

Does the LLMTest API need a key?

Yes, you need an API key.

Can I use LLMTest in a commercial project?

Yes. Its terms say: "LLMTest provides an AI model proxy, benchmarking tools, and an MCP server that help developers optimise AI model usage."

What you can build

Route a production chatbot through the proxy so provider outages fall back to another model automatically
Benchmark candidate models for a new AI feature on generated test prompts before choosing one
A cost dashboard per feature for a multi-step content pipeline to find steps that can use cheaper models

Alternatives in Model APIs and gateways

All 7 →

Zro You can point an existing coding agent at cheaper open models by changing a base URL, without request bodies being stored or used for training. API (paid)Commercial OK Cohesor You can cut and cap agent model spend by swapping one base URL and key instead of rewriting code for each provider. API (paid)Commercial OK Nous Research (Nous Portal inference API) You can call Hermes models through a standard OpenAI client, or download the same weights from Hugging Face and run them yourself. APIDownloadFree tierCommercial: conditions Tokenwise You find out which prompts and models drive your LLM bill by changing one base URL, while your own provider keys pass through and are not stored. API (paid)Free tierCommercial OK Opper AI Switching or pooling model providers becomes a model-string change, and teams that must keep data in the EU get one sub-processor and one DPA instead of a contract per provider. APIFree tierCommercial OK RunInfra You can point Claude Code, Codex, Aider or an existing OpenAI/Anthropic SDK at open models by changing a base URL and key, without renting or tuning GPUs yourself. API (paid)Free tierCommercial OK

Something wrong or out of date? Tell us.