Groq (LLM inference) vs Together AI
Groq serves a short list of open models on its own LPU hardware, with a free plan and a Developer plan for higher limits. Together AI hosts a much larger serverless catalog across chat, image, audio and video, plus fine-tuning and GPU clusters. Both speak the OpenAI API format and list GPT-OSS 120B at the same per-token price.
API vs api · checked against the official pages on Oct 25, 2026
Side by side
| Groq (LLM inference) | Together AI | |
|---|---|---|
| What it is | Fast inference API for open models such as GPT-OSS and Llama, priced per 1M tokens. | API for inference on open-source and third-party language models, vision, audio, video, and embeddings. |
| Usage price | gpt-oss-120b $0.15 in / $0.60 out per 1M tokens; gpt-oss-20b $0.075 / $0.30 | varies by model and task; e.g., $0.30 per 1M input tokens (MiniMax M3), $0.053 per image (GPT Image 2), $0.0015 per audio minute (Whisper) |
| How an agent connects | API · npm groq-sdk · PyPI groq | API |
| SDK downloads, last 7 days | 4.9M | — |
From AgentGid's catalogs: prices and licenses as read on the official pages, downloads and stars from npm, PyPI and GitHub, "used in agent projects" from our scan of public repositories set up for AI coding agents. Each item's page has its sources and dates.
Key differences
- Groq (LLM inference)Groq runs inference on its own LPU chips, now alongside NVIDIA GPUs. Source
- Groq (LLM inference)Groq lists GPT-OSS 120B at $0.15 per million input tokens and $0.60 per million output tokens, at about 500 tokens per second. Source
- Together AITogether lists the same GPT-OSS 120B model at the same $0.15 input and $0.60 output per million tokens. Source
- Groq (LLM inference)Groq has a free plan with per-model rate limits; the paid Developer plan raises them and adds Batch and Flex processing. Source
- Together AITogether's serverless models are billed per token with no provisioning and no minimum cost. Source
- Groq (LLM inference)Groq's API is mostly OpenAI-compatible, though a few fields such as logprobs are not supported yet. Source
- Together AITogether's OpenAI compatibility covers chat, completions, vision, image generation, text-to-speech and embeddings. Source
Which one to pick
Sources
- groq.com/
- console.groq.com/docs/models
- console.groq.com/docs/rate-limits
- console.groq.com/docs/openai
- docs.together.ai/docs/serverless/models
- docs.together.ai/docs/inference/openai-compatibility
- www.together.ai/pricing
Vendor figures are as reported on their own pages; AgentGid did not test these products. Not legal advice: read the license before you ship.
Compare with another one → · All comparisons of libraries, APIs and assets
More comparisons
Apify vs Firecrawl · Browserbase vs Hyperbrowser · Browserbase vs Steel · Cartesia vs ElevenLabs · Clerk vs Auth0 · Deepgram vs AssemblyAI · E2B vs Daytona · ElevenLabs vs Kokoro-82M