trafilatura

A Python library for web page main-content extraction that extracts the primary text content from HTML, with output formats including markdown. It is commonly used for news and blog content extraction.