Published March 8, 2019 | Version Supplemental Material + Published
Journal Article Open

Analyzing machine learning models to accelerate generation of fundamental materials insights

  • 1. ROR icon Joint Center for Artificial Photosynthesis
  • 2. ROR icon Toyota Motor Corporation (United States)

Abstract

Machine learning for materials science envisions the acceleration of basic science research through automated identification of key data relationships to augment human interpretation and gain scientific understanding. A primary role of scientists is extraction of fundamental knowledge from data, and we demonstrate that this extraction can be accelerated using neural networks via analysis of the trained data model itself rather than its application as a prediction tool. Convolutional neural networks excel at modeling complex data relationships in multi-dimensional parameter spaces, such as that mapped by a combinatorial materials science experiment. Measuring a performance metric in a given materials space provides direct information about (locally) optimal materials but not the underlying materials science that gives rise to the variation in performance. By building a model that predicts performance (in this case photoelectrochemical power generation of a solar fuels photoanode) from materials parameters (in this case composition and Raman signal), subsequent analysis of gradients in the trained model reveals key data relationships that are not readily identified by human inspection or traditional statistical analyses. Human interpretation of these key relationships produces the desired fundamental understanding, demonstrating a framework in which machine learning accelerates data interpretation by leveraging the expertize of the human scientist. We also demonstrate the use of neural network gradient analysis to automate prediction of the directions in parameter space, such as the addition of specific alloying elements, that may increase performance by moving beyond the confines of existing data.

Additional Information

© 2019 The Author(s). Open Access - This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. Received 22 October 2018. Accepted 06 February 2019. Published 08 March 2019. This study is based upon work performed by the Joint Center for Artificial Photosynthesis, a DOE Energy Innovation Hub, supported through the Office of Science of the U.S. Department of Energy (Award No. DE-SC0004993). Development of the algorithm for automating the model interpretation (J.M.G. and H.S.S.) was funded by Toyota Research Institute through the Accelerated Materials Design and Discovery program. Author Contributions: M.U. performed model training and gradient analysis. H.S.S. and D.G. assisted with design of the model and comparisons to other techniques. P.F.N., D.G. and D.A.B. performed all experiments. M.U., H.S.S., D.G. and J.M.G. interpreted model outputs and created data visualization schemes. J.M.G. created algorithm for automated relationship identification with assistance from M.U. and H.S.S. M.U., H.S.S. and J.M.G. were the primary authors of the manuscript. Code availability: The authors declare that the code used to perform the analysis is provided at https://github.com/johnmgregoire/CNN_Gradient_Analysis. The authors declare no competing interests.

Attached Files

Published - s41524-019-0172-5.pdf

Supplemental Material - 41524_2019_172_MOESM1_ESM.pdf

Supplemental Material - 41524_2019_172_MOESM2_ESM.csv

Files

41524_2019_172_MOESM1_ESM.pdf

Files (23.4 MB)

Name Size
md5:94350d66c1b27ec90d18408991ecd65e
485.4 kB Preview Download
md5:223aaf5da3fd01a2ff6f2159971f2c83
16.7 MB Preview Download
md5:be528e9f7a4b84e0f1ba77c8d06f9b90
6.2 MB Preview Download

Additional details

Identifiers

Eprint ID
93644
Resolver ID
CaltechAUTHORS:20190308-084331413

Funding

Department of Energy (DOE)
DE-SC0004993
Toyota Research Institute

Dates

Created
2019-03-08
Created from EPrint's datestamp field
Updated
2021-11-16
Created from EPrint's last_modified field

Caltech Custom Metadata

Caltech groups
JCAP