Skip to main content

Tool for writing large xarray datasets to zarr stores with independent processes

Project description


xpartition provides a way to split N-dimensional dask-backed arrays into
a user-specified number of blocks of dask chunks. This can be useful for
assigning work to batch jobs on HPC systems or Dataflow workers in an
Apache Beam pipeline in the cloud.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page