Gaussianizing the Earth: Multidimensional Information Measures for Earth Data Analysis

J. Emmanuel Johnson, Valero Laparra, Maria Piles, Gustau Camps-Valls
10/13/2020
stat.APstat.ML

Official code: IPL-UV/rbig (18 stars, MIT, last commit 2023-03-18). 1 more implementation below.

Abstract

Information theory is an excellent framework for analyzing Earth system data because it allows us to characterize uncertainty and redundancy, and is universally interpretable. However, accurately estimating information content is challenging because spatio-temporal data is high-dimensional, heterogeneous and has non-linear characteristics. In this paper, we apply multivariate Gaussianization for probability density estimation which is robust to dimensionality, comes with statistical guarantees, and is easy to apply. In addition, this methodology allows us to estimate information-theoretic measures to characterize multivariate densities: information, entropy, total correlation, and mutual information. We demonstrate how information theory measures can be applied in various Earth system data analysis problems. First we show how the method can be used to jointly Gaussianize radar backscattering intensities, synthesize hyperspectral data, and quantify of information content in aerial optical images. We also quantify the information content of several variables describing the soil-vegetation status in agro-ecosystems, and investigate the temporal scales that maximize their shared information under extreme events such as droughts. Finally, we measure the relative information content of space and time dimensions in remote sensing products and model simulations involving long records of key variables such as precipitation, sensible heat and evaporation. Results confirm the validity of the method, for which we anticipate a wide use and adoption. Code and demos of the implemented algorithms and information-theory measures are provided.

View on arXivView PDF

Code Implementations(2)

IPL-UV/rbigOfficial100%
MIT

Rotation-Based Iterative Gaussianization algorithm.

182Python, MakefileJun 3, 20203 years agoMIT
deep-learningdensity-estimationestimationinformation-theoryiterative+5 more
IPL-UV/rbig_jaxOfficial100%
JAXMIT

Iterative and Parametric Gaussianization with JAX.

51Python, MakefileSep 6, 20203 years agoMIT
density-estimationgaussianizationgenerative-modelinformation-theoryjax+2 more

Similar Papers

Cite this paper

@article{johnson2020gaussianizing,
  title  = {Gaussianizing the Earth: Multidimensional Information Measures for Earth Data Analysis},
  author = {J. Emmanuel Johnson and Valero Laparra and Maria Piles and Gustau Camps-Valls},
  year   = {2020},
  eprint = {2010.06476},
  archivePrefix = {arXiv},
  url    = {https://arxiv.org/abs/2010.06476}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2010.06476.svg)](https://codeofpaper.com/paper/2010.06476)

Discussion