python3-indexed-gzip

fast random access of gzip files in Python

Description

Drop-in replacement `IndexedGzipFile` for the built-in Python `gzip.GzipFile` class that does not need to start decompressing from the beginning of the file when for every `seek()`. It gets around this performance limitation by building an index, which contains *seek points*, mappings between corresponding locations in the compressed and uncompressed data streams. Each seek point is accompanied by a chunk (32KB) of uncompressed data which is used to initialise the decompression algorithm, allowing to start reading from any seek point. If the index is built with a seek point spacing of 1MB, only 512KB (on average) of data have to be decompressed to read from any location in the file.

This package provides the Python 3 module.

Upload more screenshots

Please help extend the collection of screenshots. Just make a screenshot and upload it here. You don't need to register or anything.

Upload a screenshot

Hint: upload an image here from your clipboard with Ctrl-V


Homepage

https://github.com/pauldmccarthy/indexed_gzip


Install this software package

If the package is available for the distribution you are currently using on your computer then install the software by clicking on…

Install python3-indexed-gzip