Abstract
Long-term time-series forecasting remains challenging due to the difficulty in capturing long-term dependencies, achieving linear scalability, and maintaining computational efficiency.We introduce TimeMachine, an innovative model that leverages Mamba, a state-space model, to capture long-term dependencies in multivariate time series data while maintaining linear scalability and small memory footprints.TimeMachine exploits the unique properties of time series data to produce salient contextual cues at multi-scales and leverage an innovative integrated quadruple-Mamba architecture to unify the handling of channel-mixing and channel-independence situations, thus enabling effective selection of contents for prediction against global and local contexts at different scales.Experimentally, TimeMachine achieves superior performance in prediction accuracy, scalability, and memory efficiency, as extensively validated using benchmark datasets.Code availability: https://github.com/Atik-Ahamed/TimeMachine.
Original language | English |
---|---|
Title of host publication | ECAI 2024 - 27th European Conference on Artificial Intelligence, Including 13th Conference on Prestigious Applications of Intelligent Systems, PAIS 2024, Proceedings |
Editors | Ulle Endriss, Francisco S. Melo, Kerstin Bach, Alberto Bugarin-Diz, Jose M. Alonso-Moral, Senen Barro, Fredrik Heintz |
Publisher | IOS Press BV |
Pages | 1688-1695 |
Number of pages | 8 |
ISBN (Electronic) | 9781643685489 |
DOIs | |
State | Published - Oct 16 2024 |
Event | 27th European Conference on Artificial Intelligence, ECAI 2024 - Santiago de Compostela, Spain Duration: Oct 19 2024 → Oct 24 2024 |
Publication series
Name | Frontiers in Artificial Intelligence and Applications |
---|---|
Volume | 392 |
ISSN (Print) | 0922-6389 |
ISSN (Electronic) | 1879-8314 |
Conference
Conference | 27th European Conference on Artificial Intelligence, ECAI 2024 |
---|---|
Country/Territory | Spain |
City | Santiago de Compostela |
Period | 10/19/24 → 10/24/24 |
Bibliographical note
Publisher Copyright:© 2024 The Authors.
Funding
This research is supported in part by the NSF under Grants 2327113 and 2433190 and the NIH under Grants R21AG070909, P30AG072946, and R01HD101508-01.We would like to thank the University of Kentucky Center for Computational Sciences and Information Technology Services Research Computing for their support and use of the Lipscomb Compute Cluster and associated research computing resources.
Funders | Funder number |
---|---|
Kentucky Transportation Center, University of Kentucky | |
National Institutes of Health (NIH) | R01HD101508-01, P30AG072946, R21AG070909 |
National Institutes of Health (NIH) | |
U.S. Department of Energy Chinese Academy of Sciences Guangzhou Municipal Science and Technology Project Oak Ridge National Laboratory Extreme Science and Engineering Discovery Environment National Science Foundation National Energy Research Scientific Computing Center National Natural Science Foundation of China | 2327113, 2433190 |
U.S. Department of Energy Chinese Academy of Sciences Guangzhou Municipal Science and Technology Project Oak Ridge National Laboratory Extreme Science and Engineering Discovery Environment National Science Foundation National Energy Research Scientific Computing Center National Natural Science Foundation of China |
ASJC Scopus subject areas
- Artificial Intelligence