PaSTRI: Error-Bounded Lossy Compression for Two-Electron Integrals in Quantum Chemistry

Ali Murat Gok; Sheng Di; Yuri Alexeev; Dingwen Tao; Vladimir Mironov; Xin Liang; Franck Cappello

doi:10.1109/CLUSTER.2018.00013

PaSTRI: Error-Bounded Lossy Compression for Two-Electron Integrals in Quantum Chemistry

Ali Murat Gok, Sheng Di, Yuri Alexeev, Dingwen Tao, Vladimir Mironov, Xin Liang, Franck Cappello

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

35 Scopus citations

Abstract

Computation of two-electron repulsion integrals is the critical and the most time-consuming step in a typical parallel quantum chemistry simulation. Such calculations have massive computing and storage requirements, which scale as O(N-4) with the size of a chemical system. Compressing the integral's data and storing it on disk can avoid costly recalculation, significantly speeding the overall quantum chemistry calculations; but it requires a fast compression algorithm. To this end, we developed PaSTRI (Pattern Scaling for Two-electron Repulsion Integrals) and implemented the algorithm in the data compression package SZ. PaSTRI leverages the latent pattern features in the integral dataset and optimizes the calculation of the appropriate number of bits required for the storage of the integral. We have evaluated PaSTRI using integral datasets generated by the quantum chemistry program GAMESS. The results show an excellent 16.8 compression ratio with low overhead, while maintaining 10--10 absolute precision based on user's requirement.

Original language	English
Title of host publication	Proceedings - 2018 IEEE International Conference on Cluster Computing, CLUSTER 2018
Pages	1-11
Number of pages	11
ISBN (Electronic)	9781538683194
DOIs	https://doi.org/10.1109/CLUSTER.2018.00013
State	Published - Oct 29 2018
Event	2018 IEEE International Conference on Cluster Computing, CLUSTER 2018 - Belfast, United Kingdom Duration: Sep 10 2018 → Sep 13 2018

Publication series

Name	Proceedings - IEEE International Conference on Cluster Computing, ICCC
Volume	2018-September
ISSN (Print)	1552-5244

Conference

Conference	2018 IEEE International Conference on Cluster Computing, CLUSTER 2018
Country/Territory	United Kingdom
City	Belfast
Period	9/10/18 → 9/13/18

Bibliographical note

Publisher Copyright:
© 2018 IEEE.

Keywords

ERI
Lossy compression
Quantum chemistry
Two-electron repulsion integral

ASJC Scopus subject areas

Software
Hardware and Architecture
Signal Processing

Access to Document

10.1109/CLUSTER.2018.00013

Cite this

Gok, A. M., Di, S., Alexeev, Y., Tao, D., Mironov, V., Liang, X., & Cappello, F. (2018). PaSTRI: Error-Bounded Lossy Compression for Two-Electron Integrals in Quantum Chemistry. In Proceedings - 2018 IEEE International Conference on Cluster Computing, CLUSTER 2018 (pp. 1-11). Article 8514854 (Proceedings - IEEE International Conference on Cluster Computing, ICCC; Vol. 2018-September). https://doi.org/10.1109/CLUSTER.2018.00013

@inproceedings{40863e2397284b068c6d19c1ec1ad8f6,

title = "PaSTRI: Error-Bounded Lossy Compression for Two-Electron Integrals in Quantum Chemistry",

abstract = "Computation of two-electron repulsion integrals is the critical and the most time-consuming step in a typical parallel quantum chemistry simulation. Such calculations have massive computing and storage requirements, which scale as O(N-4) with the size of a chemical system. Compressing the integral's data and storing it on disk can avoid costly recalculation, significantly speeding the overall quantum chemistry calculations; but it requires a fast compression algorithm. To this end, we developed PaSTRI (Pattern Scaling for Two-electron Repulsion Integrals) and implemented the algorithm in the data compression package SZ. PaSTRI leverages the latent pattern features in the integral dataset and optimizes the calculation of the appropriate number of bits required for the storage of the integral. We have evaluated PaSTRI using integral datasets generated by the quantum chemistry program GAMESS. The results show an excellent 16.8 compression ratio with low overhead, while maintaining 10--10 absolute precision based on user's requirement.",

keywords = "ERI, Lossy compression, Quantum chemistry, Two-electron repulsion integral",

author = "Gok, {Ali Murat} and Sheng Di and Yuri Alexeev and Dingwen Tao and Vladimir Mironov and Xin Liang and Franck Cappello",

note = "Publisher Copyright: {\textcopyright} 2018 IEEE.; 2018 IEEE International Conference on Cluster Computing, CLUSTER 2018 ; Conference date: 10-09-2018 Through 13-09-2018",

year = "2018",

month = oct,

day = "29",

doi = "10.1109/CLUSTER.2018.00013",

language = "English",

series = "Proceedings - IEEE International Conference on Cluster Computing, ICCC",

pages = "1--11",

booktitle = "Proceedings - 2018 IEEE International Conference on Cluster Computing, CLUSTER 2018",

}

Gok, AM, Di, S, Alexeev, Y, Tao, D, Mironov, V, Liang, X & Cappello, F 2018, PaSTRI: Error-Bounded Lossy Compression for Two-Electron Integrals in Quantum Chemistry. in Proceedings - 2018 IEEE International Conference on Cluster Computing, CLUSTER 2018., 8514854, Proceedings - IEEE International Conference on Cluster Computing, ICCC, vol. 2018-September, pp. 1-11, 2018 IEEE International Conference on Cluster Computing, CLUSTER 2018, Belfast, United Kingdom, 9/10/18. https://doi.org/10.1109/CLUSTER.2018.00013

PaSTRI: Error-Bounded Lossy Compression for Two-Electron Integrals in Quantum Chemistry. / Gok, Ali Murat; Di, Sheng; Alexeev, Yuri et al.
Proceedings - 2018 IEEE International Conference on Cluster Computing, CLUSTER 2018. 2018. p. 1-11 8514854 (Proceedings - IEEE International Conference on Cluster Computing, ICCC; Vol. 2018-September).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - PaSTRI

T2 - 2018 IEEE International Conference on Cluster Computing, CLUSTER 2018

AU - Gok, Ali Murat

AU - Di, Sheng

AU - Alexeev, Yuri

AU - Tao, Dingwen

AU - Mironov, Vladimir

AU - Liang, Xin

AU - Cappello, Franck

PY - 2018/10/29

Y1 - 2018/10/29

N2 - Computation of two-electron repulsion integrals is the critical and the most time-consuming step in a typical parallel quantum chemistry simulation. Such calculations have massive computing and storage requirements, which scale as O(N-4) with the size of a chemical system. Compressing the integral's data and storing it on disk can avoid costly recalculation, significantly speeding the overall quantum chemistry calculations; but it requires a fast compression algorithm. To this end, we developed PaSTRI (Pattern Scaling for Two-electron Repulsion Integrals) and implemented the algorithm in the data compression package SZ. PaSTRI leverages the latent pattern features in the integral dataset and optimizes the calculation of the appropriate number of bits required for the storage of the integral. We have evaluated PaSTRI using integral datasets generated by the quantum chemistry program GAMESS. The results show an excellent 16.8 compression ratio with low overhead, while maintaining 10--10 absolute precision based on user's requirement.

AB - Computation of two-electron repulsion integrals is the critical and the most time-consuming step in a typical parallel quantum chemistry simulation. Such calculations have massive computing and storage requirements, which scale as O(N-4) with the size of a chemical system. Compressing the integral's data and storing it on disk can avoid costly recalculation, significantly speeding the overall quantum chemistry calculations; but it requires a fast compression algorithm. To this end, we developed PaSTRI (Pattern Scaling for Two-electron Repulsion Integrals) and implemented the algorithm in the data compression package SZ. PaSTRI leverages the latent pattern features in the integral dataset and optimizes the calculation of the appropriate number of bits required for the storage of the integral. We have evaluated PaSTRI using integral datasets generated by the quantum chemistry program GAMESS. The results show an excellent 16.8 compression ratio with low overhead, while maintaining 10--10 absolute precision based on user's requirement.

KW - ERI

KW - Lossy compression

KW - Quantum chemistry

KW - Two-electron repulsion integral

UR - http://www.scopus.com/inward/record.url?scp=85057277295&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85057277295&partnerID=8YFLogxK

U2 - 10.1109/CLUSTER.2018.00013

DO - 10.1109/CLUSTER.2018.00013

M3 - Conference contribution

AN - SCOPUS:85057277295

T3 - Proceedings - IEEE International Conference on Cluster Computing, ICCC

SP - 1

EP - 11

BT - Proceedings - 2018 IEEE International Conference on Cluster Computing, CLUSTER 2018

Y2 - 10 September 2018 through 13 September 2018

ER -

PaSTRI: Error-Bounded Lossy Compression for Two-Electron Integrals in Quantum Chemistry

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this