Hausdorff metric based training of kernels to learn attractors with application to 133 chaotic dynamical systems
Abstract
Kernel methods have been successfully used to learn surrogate models for dynamical systems by regressing the vector field of such systems. However, choosing an appropriate kernel for a specific problem is an essential challenge in practice. Kernel Flows (KFs) have emerged as an effective tool for learning data-adaptive kernels used to interpolate dynamical systems. In this paper, we introduce Hausdorff Metric based Kernel Flows (HMKFs) to discover a’good’ kernel from time series when a system under consideration has an attractor. First, under the premise that a kernel is good if there is no significant loss in accuracy when half of the data is used to reconstruct the attractor, we design an objective function based on the distance between true and forecasted attractors. Then, we optimize the proposal by adding an ℓ₁ penalty term when the base kernel contains many terms, thereby generating sparse HMKFs. Furthermore, we apply HMKFs and its sparse version to a library of 133 chaotic systems from various fields such as biochemistry, fluid mechanics, and astrophysics. The results showcase the potential of HMKFs in accurately modeling complex dynamical systems using data-driven kernels.
Copyright and License
© 2024 Elsevier.
Acknowledgement
This research was completed during the first author’s visit to Imperial College London; L.Y. thanks Boumediene Hamzi and Jeroen Lamb for hosting the visit. L.Y. thanks the Nanjing University of Aeronautics and Astronautics for funding through Interdisciplinary Innovation Fund for Doctoral Students KXKCXJJ202208. Naiming Xie acknowledges support from the National Natural Science Foundation of China (72171116), and the Fundamental Research Funds for the Central Universities of China (NP2020022). HO acknowledges support from the Air Force Office of Scientific Research under MURI award number FA9550-20-1-0358 (Machine Learning and Physics-Based Modeling and Simulation) and the Department of Energy under the MMICCs SEA-CROGS award. BH acknowledges support from the Air Force Office of Scientific Research (award number FA9550-21-1-0317) and the Department of Energy (award number SA22-0052-S001). HO and BH acknowledge support from JPL/NASA under the AIST award “Kernel Flows: Emulating Complex Models for Massive Data Sets”.
Contributions
Boumediene Hamzi: Supervision, Project administration, Methodology, Investigation, Funding acquisition, Formal analysis, Conceptualization, Validation, Writing – original draft, Writing – review & editing. Houman Owhadi: Conceptualization, Writing – review & editing.
Data Availability
Data and codes are available at https://github.com/Yanglu0319/Sparse_Kernel_Flows
Files
1-s2.0-S016727892400143X-main.pdf
Additional details
Funding
- Nanjing University of Aeronautics and Astronautics
- KXKCXJJ202208
- National Natural Science Foundation of China
- 72171116
- Fundamental Research Funds for the Central Universities
- NP2020022
- United States Air Force Office of Scientific Research
- FA9550-20-1-0358
- United States Department of Energy
- MMICCs SEA-CROGS
- United States Air Force Office of Scientific Research
- FA9550-21-1-0317
- United States Department of Energy
- SA22-0052-S001
- Jet Propulsion Laboratory