Trafilatura
Extract text and metadata from web pages; tools for web scraping and content extraction.
3. Used by agents' projects
Dependency in 8 public GitHub projects set up for AI coding agents that we scanned (0.1%).
4. Agent access
Agent skills for this library in the skills catalog; community skills are written by others, read them before you install.
From the package registry and GitHub, checked daily. Tap a verdict to see its source.How we checkedReport an error
What Trafilatura does
Extract text and metadata from web pages; tools for web scraping and content extraction.
Trafilatura popularity
Gid Score measures public popularity and activity, not quality. How the Gid Score is calculated
How Trafilatura is used
- Trafilatura is a dependency in 8 of the 6,254 public GitHub projects set up for AI coding agents that we scanned, too few to describe it from them alone. Our scan also samples projects by dependency (Solana 3,063, Ethereum and EVM 1,777, 3D and games 3,120, agent frameworks and SDKs 13,629); counting those, it appears in 99 projects, and what it is used with below comes from all of them.
- The most used alternative in our scan is Beautiful Soup (135 projects).
- Projects that use it most often also use python-dotenv (75.8%), Pydantic (64.6%), Beautiful Soup (60.6%).
By coding agent
Often used with
More about Trafilatura
Funding
- GitHub Sponsors: https://github.com/adbar
- Ko-fi: https://ko-fi.com/adbarbaresi
More in Scraping, browsers and parsing
Alternatives
Trafilatura This page
Python HTML/XML parsing and screen-scraping library for web data extraction.
High-performance XML and HTML processing library combining libxml2/libxslt with Python.
High-level Python API for automating browser testing and web scraping.
Official Python bindings for browser automation and web scraping.
HTML parser based on WHATWG specification for parsing and processing HTML.
Get started
Install it.
pip install trafilaturaNo step-by-step start for Trafilatura yet: we have not written its hand-checked card.