Towards Physically-Consistent, Data-Driven Models of Convection

Type: Article

Publication Date: 2020-09-26

Citations: 42

DOI: https://doi.org/10.1109/igarss39084.2020.9324569

Abstract

Data-driven algorithms, in particular neural networks, can emulate the effect of sub-grid scale processes in coarse-resolution climate models if trained on high-resolution climate simulations. However, they may violate key physical constraints and lack the ability to generalize outside of their training set. Here, we show that physical constraints can be enforced in neural networks, either approximately by adapting the loss function or to within machine precision by adapting the architecture. As these physical constraints are insufficient to guarantee generalizability, we additionally propose to physically rescale the training and validation data to improve the ability of neural networks to generalize to unseen climates. Code-github.com/theucler/CBRAIN-CAM.

Locations

  • arXiv (Cornell University) - View - PDF
  • IGARSS 2022 - 2022 IEEE International Geoscience and Remote Sensing Symposium - View

Similar Works

Action Title Year Authors
+ Towards Physically-consistent, Data-driven Models of Convection 2020 Tom Beucler
Michael S. Pritchard
Pierre Gentine
Stephan Rasp
+ Towards Physically-consistent, Data-driven Models of Convection 2020 Tom Beucler
Michael S. Pritchard
Pierre Gentine
Stephan Rasp
+ PDF Chat Towards Physically Consistent Deep Learning For Climate Model Parameterizations 2024 Birgit KĂŒhbacher
Fernando Iglesias‐Suarez
Niki Kilbertus
Veronika Eyring
+ PDF Chat Use of Neural Networks for Stable, Accurate and Physically Consistent Parameterization of Subgrid Atmospheric Processes With Good Performance at Reduced Precision 2021 Janni Yuval
Paul A. O’Gorman
Chris Hill
+ Deep learning to represent sub-grid processes in climate models 2018 Stephan Rasp
Michael S. Pritchard
Pierre Gentine
+ Capturing missing physics in climate model parameterizations using neural differential equations 2022 Ali Ramadhan
John Marshall
Andre N. Souza
X Lee
Ulyana Piterbarg
Adeline Hillier
Gregory LeClaire Wagner
Christopher Rackauckas
Chris Hill
Jean‐Michel Campin
+ Achieving Conservation of Energy in Neural Network Emulators for Climate Modeling 2019 Tom Beucler
Stephan Rasp
Michael S. Pritchard
Pierre Gentine
+ Capturing missing physics in climate model parameterizations using neural differential equations 2020 Ali J. Ramadhan
John C. Marshall
André M. C. Souza
Gregory LeClaire Wagner
Manvitha Ponnapati
Christopher Rackauckas
+ PDF Chat Deep learning to represent subgrid processes in climate models 2018 Stephan Rasp
Michael S. Pritchard
Pierre Gentine
+ Multiscale Neural Operator: Learning Fast and Grid-independent PDE Solvers 2022 Björn LĂŒtjens
Catherine H. Crawford
Campbell D Watson
C. Hill
Dava Newman
+ Could machine learning break the convection parametrization deadlock? 2018 Pierre Gentine
Mike Pritchard
Stephan Rasp
G. Reinaudi
Galen Yacalis
+ PDF Chat A Fortran-Keras Deep Learning Bridge for Scientific Computing 2020 Jordan Ott
Mike Pritchard
Natalie Best
Erik Linstead
Milan Curcic
Pierre Baldi
+ A Fortran-Keras Deep Learning Bridge for Scientific Computing 2020 Jordan Ott
Mike Pritchard
Natalie M. Best
Erik Linstead
Milan Curcic
Pierre Baldi
+ A Fortran-Keras Deep Learning Bridge for Scientific Computing 2020 Jordan Ott
Mike Pritchard
Natalie Best
Erik Linstead
Milan Curcic
Pierre Baldi
+ Gradient-free online learning of subgrid-scale dynamics with neural emulators 2023 Hugo Frezat
Guillaume Balarac
Julien Le Sommer
Ronan Fablet
+ Data Imbalance, Uncertainty Quantification, and Generalization via Transfer Learning in Data-driven Parameterizations: Lessons from the Emulation of Gravity Wave Momentum Transport in WACCM 2023 Y. Qiang Sun
Hamid A. Pahlavan
Ashesh Chattopadhyay
Pedram Hassanzadeh
Sandro W. Lubis
M. Joan Alexander
Edwin P. Gerber
Aditi Sheshadri
Yifei Guan
+ PDF Chat Data Imbalance, Uncertainty Quantification, and Generalization via Transfer Learning in Data-driven Parameterizations: Lessons from the Emulation of Gravity Wave Momentum Transport in WACCM 2023 Y. Qiang Sun
Hamid Pahlavan
Ashesh Chattopadhyay
Pedram Hassanzadeh
Sandro W. Lubis
M. Joan Alexander
Edwin P. Gerber
Aditi Sheshadri
Yifei Guan
+ PDF Chat Assessing the Potential of Deep Learning for Emulating Cloud Superparameterization in Climate Models With Real‐Geography Boundary Conditions 2021 Griffin Mooers
Michael S. Pritchard
Tom Beucler
Jordan Ott
Galen Yacalis
Pierre Baldi
Pierre Gentine
+ Interpreting and Stabilizing Machine-Learning Parametrizations of Convection 2020 Noah Brenowitz
Tom Beucler
Michael S. Pritchard
Christopher S. Bretherton
+ PDF Chat Interpretable multiscale Machine Learning-Based Parameterizations of Convection for ICON 2024 H Heuer
Mierk Schwabe
Pierre Gentine
M. A. Giorgetta
Veronika Eyring

Works Cited by This (10)

Action Title Year Authors
+ PDF Chat Physics-Guided Neural Networks (PGNN): An Application in Lake Temperature Modeling 2022 Arka Daw
Anuj Karpatne
W D Watkins
Jordan S. Read
Vipin Kumar
+ PDF Chat Prognostic Validation of a Neural Network Unified Physics Parameterization 2018 Noah Brenowitz
Christopher S. Bretherton
+ Deep learning to represent sub-grid processes in climate models 2018 Stephan Rasp
Michael S. Pritchard
Pierre Gentine
+ Achieving Conservation of Energy in Neural Network Emulators for Climate Modeling 2019 Tom Beucler
Stephan Rasp
Michael S. Pritchard
Pierre Gentine
+ Adam: A Method for Stochastic Optimization 2014 Diederik P. Kingma
Jimmy Ba
+ PDF Chat Enforcing Analytic Constraints in Neural Networks Emulating Physical Systems 2021 Tom Beucler
Michael S. Pritchard
Stephan Rasp
Jordan Ott
Pierre Baldi
Pierre Gentine
+ PDF Chat Deep learning to represent subgrid processes in climate models 2018 Stephan Rasp
Michael S. Pritchard
Pierre Gentine
+ PDF Chat Physics Guided RNNs for Modeling Dynamical Systems: A Case Study in Simulating Lake Temperature Profiles 2019 Xiaowei Jia
Jared Willard
Anuj Karpatne
Jordan S. Read
Jacob A. Zwart
Michael Steinbach
Vipin Kumar
+ PDF Chat Spatially Extended Tests of a Neural Network Parametrization Trained by Coarse‐Graining 2019 Noah Brenowitz
Christopher S. Bretherton
+ PDF Chat Using Machine Learning to Parameterize Moist Convection: Potential for Modeling of Climate, Climate Change, and Extreme Events 2018 Paul A. O’Gorman
J. G. Dwyer