python3-w3lib

Collection of web-related functions (Python 3)

Description

Python module with simple, reusable functions to work with URLs, HTML, forms, and HTTP, that aren’t found in the Python standard library.

This module is used to, for example:

- remove comments, or tags from HTML snippets

- extract base url from HTML snippets

- translate entities on HTML strings

- encoding mulitpart/form-data

- convert raw HTTP headers to dicts and vice-versa

- construct HTTP auth header

- RFC-compliant url joining

- sanitize urls (like browsers do)

- extract arguments from urls

The code of w3lib was originally part of the Scrapy framework but was later stripped out of Scrapy, with the aim of make it more reusable and to provide a useful library of web functions without depending on Scrapy.

This is the Python 3 version of the package.

Upload more screenshots

Please help extend the collection of screenshots. Just make a screenshot and upload it here. You don't need to register or anything.

Upload a screenshot

Hint: upload an image here from your clipboard with Ctrl-V

Homepage

https://github.com/scrapy/w3lib

Install this software package

If the package is available for the distribution you are currently using on your computer then install the software by clicking on…

Install python3-w3lib