Firecrawl (Python)
Web scraping and crawling SDK with search over PubMed and arXiv research papers.
Scraping, browsers and parsing PyPI MIT HTML parsing and extraction
Website GitHub PyPI Its AgentGid profile Hosted service: prices
How Firecrawl (Python) is used
Firecrawl (Python) is a dependency in 9 of the 6,208 public GitHub projects set up for AI coding agents that we scanned, too few to describe it from them alone. Our scan also samples projects by dependency (Solana 2,661, Ethereum and EVM 1,496, 3D and games 2,818, agent frameworks and SDKs 10,983); counting those, it appears in 242 projects, and what it is used with below comes from all of them. The most used alternative in our scan is Beautiful Soup (134 projects). Projects that use it most often also use python-dotenv (79.3%), Pydantic (60.7%), Requests (58.7%).
Firecrawl (Python) popularity over time
Gid Score 72: downloads 66, use in agent projects 64, GitHub stars 99, downloads trend 55 (each 0-100). How it is calculated.
Often used with Firecrawl (Python)
| python-dotenv | 79.3% of Firecrawl (Python) projects · 8.7× more than average |
|---|---|
| Pydantic | 60.7% of Firecrawl (Python) projects · 7.0× more than average |
| Requests | 58.7% of Firecrawl (Python) projects · 8.6× more than average |
| OpenAI Python Library | 56.2% of Firecrawl (Python) projects · 14.2× more than average |
| LangChain | 49.6% of Firecrawl (Python) projects · 24.4× more than average |
| Beautiful Soup | 45.0% of Firecrawl (Python) projects · 20.9× more than average |
| pandas | 42.6% of Firecrawl (Python) projects · 9.9× more than average |
| FastAPI | 40.5% of Firecrawl (Python) projects · 5.4× more than average |
From all 242 projects in our scan that use Firecrawl (Python), including the dependency samples.
By coding agent
| Claude Code | 0.2% of projects set up for it |
|---|---|
| Cursor | 0.3% of projects set up for it |
Share of public repos configured for each agent that list Firecrawl (Python) as a dependency.
Install
| Package | pip install firecrawl-py |
|---|---|
| Main stacks | Python (240), Next.js (1), React Native / Expo (1) |
| Example projects | Paper2Poster/Paper2Poster, liyedanpdx/reddit-ai-trends, runningZ1/union-search-skill, YuhangChen1/Paper2All, ivebotunac/PrimoAgent |
Alternatives to Firecrawl (Python)
Tools that do the same job, so a project picks one or the other. Add-ons and libraries used alongside Firecrawl (Python) are not listed here; they are in "Often used with".
| Tool | Gid Score | Used in agent projects | Downloads / wk | GitHub stars | License |
|---|---|---|---|---|---|
| Beautiful Soup pypi Python HTML/XML parsing and screen-scraping library for web data extraction. |
77 | 134 (8.3%) | 70.4M | — | MIT |
| Playwright (Python) pypi High-level Python API for automating browser testing and web scraping. |
76 | 74 (4.6%) | 28.4M | 15.1K | Apache-2.0 |
| Selenium pypi Official Python bindings for browser automation and web scraping. |
62 | 27 (1.7%) | 7.3M | — | Apache-2.0 |
More in Scraping, browsers and parsing: Puppeteer lxml Playwright Core Cheerio fast-xml-parser jsonc-parser Mozilla Readability linkedom