python3-pathos

Framework for heterogeneous parallel computing

Description

Pathos provides a consistent high-level interface for configuring and launching parallel computations across heterogeneous resources. It provides configurable launchers for parallel and distributed computing, where each launcher contains the syntactic logic to configure and launch jobs in an execution environment. Examples of launchers include: "pyina", a queue-less MPI-based launcher; "pathos", an ssh-based launcher; "multiprocess", a multi-process launcher.

It provides a consistent interface for parallel and/or distributed versions of "map" and "apply" for each launcher; the guiding design principle is that "map" and "apply" should be drop-in replacements in otherwise serial code, reducing the time to conver a code to parallel, but also enabling a single code-base to be maintained instead of requiring serial, parallel and distributed versions of code.

The "pathos" framework consists of several interoperating packages:
 * "dill": serialize all of Python (python3-dill)
 * "pox": utilities for filesystem exploration and automated builds
   (python3-pox)
 * "klepto": persistent caching to memory, disk, or database
   (python3-klepto)
 * "multiprocess": better multiprocessing and multithreading in Python
   (python3-multiprocess)
 * "ppft": distributed and parallel Python (python3-ppft)
 * "pyina": MPI parallel "map" and cluster scheduling (python3-pyina)
 * "pathos": graph management and execution in heterogeneous computing
   (python3-pathos)

Upload more screenshots

Please help extend the collection of screenshots. Just make a screenshot and upload it here. You don't need to register or anything.

Upload a screenshot

Hint: upload an image here from your clipboard with Ctrl-V


Homepage

https://github.com/uqfoundation/pathos


Install this software package

If the package is available for the distribution you are currently using on your computer then install the software by clicking on…

Install python3-pathos