Elemental is a modern C++ library for distributed-memory dense and sparse-direct linear algebra and optimization. The library was initially released in Elemental: A new framework for distributed memory dense linear algebra and absorbed, then greatly expanded upon, the functionality from the sparse-direct solver Clique, which was originally released during a project on Parallel Sweeping Preconditioners.
Please visit the download page for details about recent and upcoming releases.
The documentation for Elemental is built using Sphinx and the Read the Docs Theme
Elemental supports a wide collection of distributed-memory functionality, including:
Convex optimization:
- Dense and sparse Interior Point Methods for Linear, Quadratic, and Second-Order Cone Programs
- Basis Pursuit
- Chebyshev Points
- Dantzig selectors
- LASSO / Basis Pursuit Denoising
- Least Absolute Value regression
- Non-negative Least Squares
- Support Vector Machines
- (1D) Total Variation
- Distributed Jordan algebras over products of Second-Order Cones
- Various prototype dense Alternating Direction Method of Multipliers routines
- Sparse inverse covariance selection
- Robust Principal Component Analysis
- Prototype alternating direction Non-negative Matrix Factorization
Linear algebra:
- Dense and sparse-direct (generalized) Least Squares problems
- Least Squares / Minimum Length
- Tikhonov (and ridge) regression
- Equality-constrained Least Squares
- General (Gauss-Markov) Linear Models
- High-performance pseudospectral computation and visualization
- Quadratic-time low-rank Cholesky and LU modifications
- Bunch-Kaufman and Bunch-Parlett for accurate symmetric factorization
- LU and Cholesky with full pivoting
- Column-pivoted QR and interpolative/skeleton decompositions
- Quadratically Weighted Dynamic Halley iteration for the polar decomposition
- Many algorithms for Singular-Value soft-Thresholding (SVT)
- Tall-skinny QR decompositions
- Hermitian matrix functions
- Prototype Spectral Divide and Conquer Schur decomposition and Hermitian EVD
- Sign-based Lyapunov/Ricatti/Sylvester solvers
The vast majority of Elemental is distributed under the terms of the New BSD License, with the exceptions of METIS, which is distributed under the (equally permissive) Apache License, Version 2.0, ParMETIS, which can only be used for research purposes (and can be easily disabled), and libquadmath, which is distributed under the terms of the GPL (and can be similarly easily disabled).
Intranodal linear algebra
OpenBLAS is automatically downloaded and installed if no vendor/tuned BLAS/LAPACK is detected.
Intranodal graph partitioning
If ParMETIS is not disabled and cannot be found (including access to internal APIs), then it is automatically downloaded and installed; otherwise, if METIS support is not detected, METIS is downloaded and installed.
Internodal linear algebra
- Parallel MRRR (packaged with Elemental)
- ScaLAPACK (optional for Hessenberg QR algorithm)
If ScaLAPACK support is not explicitly disabled, then Elemental looks for a previous installation and, failing that, attempts to automatically download and install the library.
Internodal communication
Auxiliary libraries
- libquadmath for quad-precision support (especially for iterative refinement). (Note: Users who prefer to use Elemental under the terms of the New BSD License rather than the GPL should disable support for libquadmath during configuration)
Python interface
- matplotlib (optional for Python matrix visualization)
- NetworkX (optional for Python graph visualization)
- NumPy
C++ visualization
- Qt5 (optional for visualization from C++)
Build system
In addition to the C++11, C, and Python interfaces included within the project, three external interfaces are currently being externally developed:
-
R-El is an R interface to Elemental developed by Rodrigo Canales and Paolo Bientinesi
-
Elemental.jl is an (in-progress) Julia interface to Elemental being developed by Jake Bolewski, Jiahao Chen, and Andreas Noack.
-
CVXPY is a Python-embedded modeling language for convex optimization problems with an (in-progress) interface to Elemental's distributed Interior Point Methods. This effort is being led by Steven Diamond.
Distributed dense linear algebra:
Distributed sparse-direct linear algebra:
Distributed linear algebra Frameworks
Convex optimization