Web data for agents
Scraping, search and browser automation APIs built for AI agents. 5 resources; API, key, license and embedding quoted from each site's own pages, checked Oct 24, 2026.
AgentKey
Instead of signing up for and wiring a separate paid API for search, scraping, social and market data, an agent gets all of them through one install and one bill, with fallback to a second provider when one fails.
APIOpen sourceFree tierLicense unclear
Context.dev
An agent or RAG pipeline gets clean page text from JavaScript-heavy or protected sites without you running headless browsers and proxy pools.
APICommercial: conditions
TinyFish
It gives an agent search, clean page text and a remote browser without running your own scrapers, proxies or headless Chrome fleet, and search and fetch cost nothing within rate limits.
APIFree tierCommercial: conditions
Notte
You get remote browsers that agents can log into and keep logged into, without running your own browser fleet, proxy pool or secret store.
APIFree tierCommercial OK
BrowserAct
You get a scraper that runs again on a schedule and is meant to adapt when the page layout changes, instead of hand-maintaining CSS or XPath selectors.
APIFree tierCommercial: conditions
Side by side
| Resource | API | Key | Data download | Commercial use | Embed |
|---|---|---|---|---|---|
| AgentKey An MCP server and REST gateway that routes an agent's calls to many third-party data APIs (web search, page extraction, social networks, e-commerce, finance and crypto data) behind one key and one monthly credit balance. |
Official API · Free tier | Yes | — | Commercial use unclear | Embedding unclear |
| Context.dev A paid REST API that turns any URL into Markdown, HTML, screenshots or schema-shaped JSON, crawls or maps whole sites, runs large URL batches, searches the web and news, watches pages for changes, and returns company brand data (logos, colors, fonts); formerly Brand.dev. |
Official API · Free tier | Yes | — | Commercial use with conditions | Embedding unclear |
| TinyFish An API for AI agents that covers web search with JSON results, page fetching into Markdown/JSON/HTML, hosted Playwright/Puppeteer/CDP browser sessions, and a goal-driven agent that clicks through sites and returns structured output, all under one API key. |
Official API · Free tier | Yes | — | Commercial use with conditions | Embedding unclear |
| Notte A cloud service for running headless browsers, AI browser agents and serverless browser scripts, with proxies, CAPTCHA handling, saved login profiles and a credential vault, driven by Python/TypeScript SDKs, a REST API, a CLI or an MCP server. |
Official API · Free tier | Yes | — | Commercial use OK | Embedding unclear |
| BrowserAct A scraping service where you describe the data you want in plain language and its agent builds, tests and saves a reusable scraper ('Bot') that runs in real cloud browsers, plus a local CLI that gives coding agents browser control; results come back as structured records via API, MCP, Make, n8n or Zapier. |
Official API · Free tier | Yes | — | Commercial use with conditions | Embedding unclear |