Beautiful Soup
Python HTML/XML parsing and screen-scraping library for web data extraction.
Scraping, browsers and parsing PyPI MIT License
Used in agent projects
160
1.3% of 12,697 public repos built with AI coding agents
Rank in scraping, browsers and parsing
#1 of 16
by use in those projects
Downloads
69M
PyPI, last 7 days, beautifulsoup4
GitHub stars
—
no public repo found
How Beautiful Soup is used
Beautiful Soup is a dependency in 160 of the 12,697 public GitHub projects set up for AI coding agents that we scanned (1.3%), #1 of 16 in scraping, browsers and parsing. The most used alternative there is Puppeteer. Projects that use it most often also use Requests (76.9%), python-dotenv (66.9%), Pydantic (53.1%).
Often used with Beautiful Soup
| Requests | 76.9% of Beautiful Soup projects · 14.5× more than average |
|---|---|
| python-dotenv | 66.9% of Beautiful Soup projects · 10.3× more than average |
| Pydantic | 53.1% of Beautiful Soup projects · 10.4× more than average |
| NumPy | 45.6% of Beautiful Soup projects · 11.9× more than average |
| FastAPI | 45.0% of Beautiful Soup projects · 10.6× more than average |
| Uvicorn | 44.4% of Beautiful Soup projects · 10.4× more than average |
| lxml | 44.4% of Beautiful Soup projects · 57.5× more than average |
| aiohttp | 40.6% of Beautiful Soup projects · 17.5× more than average |
By coding agent
| Claude Code | 2.0% of projects set up for it |
|---|---|
| GitHub Copilot | 1.9% of projects set up for it |
| Cursor | 1.8% of projects set up for it |
| Gemini CLI | 1.6% of projects set up for it |
| OpenCode | 1.9% of projects set up for it |
| OpenAI Codex | 1.3% of projects set up for it |
| Kiro | 3.4% of projects set up for it |
Share of public repos configured for each agent that list Beautiful Soup as a dependency.
Install
| Package | pip install beautifulsoup4 |
|---|---|
| Main stacks | Python (154), Next.js (5), React Native / Expo (1) |
| Example projects | Josh-XT/AGiXT, manykarim/rf-mcp, microsoft/edge-ai, ZongziForu/cn-law-hub, XargonWan/Synthetic_Heart |
Alternatives to Beautiful Soup
| Tool | Used in agent projects | Downloads / wk | GitHub stars | License |
|---|---|---|---|---|
| Puppeteer npm Headless Chrome/Chromium automation for scraping, testing and screenshot generation. |
115 (0.9%) | 11.4M | 95.7K | Apache-2.0 |
| lxml pypi High-performance XML and HTML processing library combining libxml2/libxslt with Python. |
98 (0.8%) | 88.4M | 3,065 | BSD-3-Clause |
| Cheerio npm jQuery-like syntax for parsing and manipulating HTML/XML with server-side speed. |
94 (0.7%) | 26.6M | 30.5K | MIT |
| Playwright (Python) pypi High-level Python API for automating browser testing and web scraping. |
68 (0.5%) | 26M | 15K | — |
| fast-xml-parser npm High-performance XML parser and builder without native dependencies. |
58 (0.5%) | 83.3M | 3,139 | MIT |
| csv-parse npm Parse CSV files using Node.js streaming Transform API for memory-efficient processing. |
51 (0.4%) | 20.6M | 4,280 | MIT |
| Playwright Core npm Headless browser automation library for cross-browser testing and web scraping. |
49 (0.4%) | 122M | 97.4K | Apache-2.0 |
| soupsieve pypi CSS selector implementation for BeautifulSoup to query HTML and XML documents. |
39 (0.3%) | 70.4M | 271 | — |