Published May 25, 2024 | Version Accepted
Journal Article Open

Hausdorff metric based training of kernels to learn attractors with application to 133 chaotic dynamical systems

Abstract

Kernel methods have been successfully used to learn surrogate models for dynamical systems by regressing the vector field of such systems. However, choosing an appropriate kernel for a specific problem is an essential challenge in practice. Kernel Flows (KFs) have emerged as an effective tool for learning data-adaptive kernels used to interpolate dynamical systems. In this paper, we introduce Hausdorff Metric based Kernel Flows (HMKFs) to discover a’good’ kernel from time series when a system under consideration has an attractor. First, under the premise that a kernel is good if there is no significant loss in accuracy when half of the data is used to reconstruct the attractor, we design an objective function based on the distance between true and forecasted attractors. Then, we optimize the proposal by adding an ℓ₁ penalty term when the base kernel contains many terms, thereby generating sparse HMKFs. Furthermore, we apply HMKFs and its sparse version to a library of 133 chaotic systems from various fields such as biochemistry, fluid mechanics, and astrophysics. The results showcase the potential of HMKFs in accurately modeling complex dynamical systems using data-driven kernels.

Copyright and License

© 2024 Elsevier.

Acknowledgement

This research was completed during the first author’s visit to Imperial College London; L.Y. thanks Boumediene Hamzi and Jeroen Lamb for hosting the visit. L.Y. thanks the Nanjing University of Aeronautics and Astronautics for funding through Interdisciplinary Innovation Fund for Doctoral Students KXKCXJJ202208. Naiming Xie acknowledges support from the National Natural Science Foundation of China (72171116), and the Fundamental Research Funds for the Central Universities of China (NP2020022). HO acknowledges support from the Air Force Office of Scientific Research under MURI award number FA9550-20-1-0358 (Machine Learning and Physics-Based Modeling and Simulation) and the Department of Energy under the MMICCs SEA-CROGS award. BH acknowledges support from the Air Force Office of Scientific Research (award number FA9550-21-1-0317) and the Department of Energy (award number SA22-0052-S001). HO and BH acknowledge support from JPL/NASA under the AIST award “Kernel Flows: Emulating Complex Models for Massive Data Sets”.

Contributions

Boumediene Hamzi: Supervision, Project administration, Methodology, Investigation, Funding acquisition, Formal analysis, Conceptualization, Validation, Writing – original draft, Writing – review & editing. Houman Owhadi: Conceptualization, Writing – review & editing.

Data Availability

Data and codes are available at https://github.com/Yanglu0319/Sparse_Kernel_Flows

Files

1-s2.0-S016727892400143X-main.pdf

Files (12.5 MB)

Name Size
md5:5e080efbf779715e34ce8d737f9175ed
12.5 MB Preview Download

Additional details

Funding

Nanjing University of Aeronautics and Astronautics
KXKCXJJ202208
National Natural Science Foundation of China
72171116
Fundamental Research Funds for the Central Universities
NP2020022
United States Air Force Office of Scientific Research
FA9550-20-1-0358
United States Department of Energy
MMICCs SEA-CROGS
United States Air Force Office of Scientific Research
FA9550-21-1-0317
United States Department of Energy
SA22-0052-S001
Jet Propulsion Laboratory