Advancing Parsimonious Deep Learning Weather Prediction using the HEALPix Mesh

Matthias Karlbauer, Nathaniel Cresswell-Clay, Dale R. Durran, Raul A. Moreno, Thorsten Kurth +3 more
9/11/2023
physics.ao-phcs.LG

Official code: NVIDIA/physicsnemo (3,103 stars, Apache-2.0, PyTorch, last commit 2026-05-01).

Abstract

We present a parsimonious deep learning weather prediction model to forecast seven atmospheric variables with 3-h time resolution for up to one-year lead times on a 110-km global mesh using the Hierarchical Equal Area isoLatitude Pixelization (HEALPix). In comparison to state-of-the-art (SOTA) machine learning (ML) weather forecast models, such as Pangu-Weather and GraphCast, our DLWP-HPX model uses coarser resolution and far fewer prognostic variables. Yet, at one-week lead times, its skill is only about one day behind both SOTA ML forecast models and the SOTA numerical weather prediction model from the European Centre for Medium-Range Weather Forecasts. We report several improvements in model design, including switching from the cubed sphere to the HEALPix mesh, inverting the channel depth of the U-Net, and introducing gated recurrent units (GRU) on each level of the U-Net hierarchy. The consistent east-west orientation of all cells on the HEALPix mesh facilitates the development of location-invariant convolution kernels that successfully propagate weather patterns across the globe without requiring separate kernels for the polar and equatorial faces of the cube sphere. Without any loss of spectral power after the first two days, the model can be unrolled autoregressively for hundreds of steps into the future to generate realistic states of the atmosphere that respect seasonal trends, as showcased in one-year simulations.

View on arXivView PDF

Code Implementations(1)

NVIDIA/physicsnemoOfficial100%
PyTorchApache-2.0

Open-source deep-learning framework for building, training, and fine-tuning deep learning models using state-of-the-art Physics-ML methods

3,103743Shell, PythonJan 26, 20235 months agoApache-2.0
deep-learningmachine-learningnvidia-gpunvidia-warpphysics+1 more

Similar Papers

Cite this paper

@article{karlbauer2023advancing,
  title  = {Advancing Parsimonious Deep Learning Weather Prediction using the HEALPix Mesh},
  author = {Matthias Karlbauer and Nathaniel Cresswell-Clay and Dale R. Durran and Raul A. Moreno and Thorsten Kurth and Boris Bonev and Noah Brenowitz and Martin V. Butz},
  year   = {2023},
  eprint = {2311.06253},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2311.06253v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2311.06253.svg)](https://codeofpaper.com/paper/2311.06253)

Discussion