pympipool - scale functions over multiple compute nodes using mpi4py

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for jan-janssen from gravatar.com jan-janssen Avatar for pyiron from gravatar.com pyiron

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: BSD License (BSD)
  • Author:
Classifiers
Report project as malware

Project description

pympipool

Scale functions over multiple compute nodes using mpi4py

Write a python test file like pool.py:

from pympipool import Pool

def calc(i):
    import numpy as np
    return np.array(i ** 2)

with Pool(cores=2) as p:
    print(p.map(function=calc, lst=[1, 2, 3, 4]))

You can execute the python file pool.py in a serial python process:

python pool.py
>>> [array(1), array(4), array(9), array(16)]

Internally pympipool uses mpi4py to distribute the 4 calculation to two processors cores=2.

Alternatively, you can copy all lines to a jupyter notebook or an ipython shell and execute them directly. But this does not work with a regular python shell.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page