Hameer Abbasi
TU Darmstadt

Video: https://youtu.be/xH5eVcb1SlA

Abstract

This paper is about sparse multi-dimensional arrays in Python. We discuss their applications, layouts, and current implementations in the SciPy ecosystem along with strengths and weaknesses. We then introduce a new package for sparse arrays that builds on the legacy of the scipy.sparse implementation, but supports more modern interfaces, dimensions greater than two, and improved integration with newer array packages, like XArray and Dask. We end with performance benchmarks and notes on future work. Additionally, this work provides a concrete implementation of the recent NumPy array protocols to build generic array interfaces for improved interoperability, and so may be useful for broader community discussion.

Keywords

sparse, sparse arrays, sparse matrices, scipy.sparse, ndarray, ndarray interface

DOI

10.25080/Majora-4af1f417-00a

Bibtex entry

Full text PDF

Copyright © 2018 Hameer Abbasi. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.