Skip to content
Agents tracked: 492 Releases (7d): 545 Agent status: 1 with issuesSince last limit reset: Claude 9d · Codex 7d For AI agents: Markdown Updated Nov 20, 2026

Groq (LLM inference) vs Together AI

Groq serves a short list of open models on its own LPU hardware, with a free plan and a Developer plan for higher limits. Together AI hosts a much larger serverless catalog across chat, image, audio and video, plus fine-tuning and GPU clusters. Both speak the OpenAI API format and list GPT-OSS 120B at the same per-token price.

API vs api · checked against the official pages on Oct 25, 2026

Side by side

Groq (LLM inference)Together AI
What it isFast inference API for open models such as GPT-OSS and Llama, priced per 1M tokens.API for inference on open-source and third-party language models, vision, audio, video, and embeddings.
Usage pricegpt-oss-120b $0.15 in / $0.60 out per 1M tokens; gpt-oss-20b $0.075 / $0.30varies by model and task; e.g., $0.30 per 1M input tokens (MiniMax M3), $0.053 per image (GPT Image 2), $0.0015 per audio minute (Whisper)
How an agent connectsAPI · npm groq-sdk · PyPI groqAPI
SDK downloads, last 7 days4.9M—

From AgentGid's catalogs: prices and licenses as read on the official pages, downloads and stars from npm, PyPI and GitHub, "used in agent projects" from our scan of public repositories set up for AI coding agents. Each item's page has its sources and dates.

Key differences

  • Groq (LLM inference)Groq runs inference on its own LPU chips, now alongside NVIDIA GPUs. Source
  • Groq (LLM inference)Groq lists GPT-OSS 120B at $0.15 per million input tokens and $0.60 per million output tokens, at about 500 tokens per second. Source
  • Together AITogether lists the same GPT-OSS 120B model at the same $0.15 input and $0.60 output per million tokens. Source
  • Groq (LLM inference)Groq has a free plan with per-model rate limits; the paid Developer plan raises them and adds Batch and Flex processing. Source
  • Together AITogether's serverless models are billed per token with no provisioning and no minimum cost. Source
  • Groq (LLM inference)Groq's API is mostly OpenAI-compatible, though a few fields such as logprobs are not supported yet. Source
  • Together AITogether's OpenAI compatibility covers chat, completions, vision, image generation, text-to-speech and embeddings. Source

Which one to pick

Pick Groq (LLM inference) if…Choose Groq when output speed matters most and one of its supported models fits the job. The free plan is enough to test it before moving to the Developer plan.
Pick Together AI if…Choose Together AI when you need a wide choice of open models, including image, audio and video, or plan to fine-tune and later move to dedicated endpoints. Its serverless API has no minimum spend.

Sources

Vendor figures are as reported on their own pages; AgentGid did not test these products. Not legal advice: read the license before you ship.

Compare with another one → · All comparisons of libraries, APIs and assets

More comparisons

Apify vs Firecrawl · Browserbase vs Hyperbrowser · Browserbase vs Steel · Cartesia vs ElevenLabs · Clerk vs Auth0 · Deepgram vs AssemblyAI · E2B vs Daytona · ElevenLabs vs Kokoro-82M