GeoPT: Scaling Physics Simulation via Lifted Geometric Pre-Training

Haixu Wu, Minghao Guo, Zongyi Li, Zhiyang Dou, Mingsheng Long +2 more
2/23/2026
cs.LG

Official code: Physics-Scaling/GeoPT (219 stars, last commit 2026-04-27).

Abstract

Neural simulators promise efficient surrogates for physics simulation, but scaling them is bottlenecked by the prohibitive cost of generating high-fidelity training data. Pre-training on abundant off-the-shelf geometries offers a natural alternative, yet faces a fundamental gap: supervision on static geometry alone ignores dynamics and can lead to negative transfer on physics tasks. We present GeoPT, a unified pre-trained model for general physics simulation based on lifted geometric pre-training. The core idea is to augment geometry with synthetic dynamics, enabling dynamics-aware self-supervision without physics labels. Pre-trained on over one million samples, GeoPT consistently improves industrial-fidelity benchmarks spanning fluid mechanics for cars, aircraft, and ships, and solid mechanics in crash simulation, reducing labeled data requirements by 20-60% and accelerating convergence by 2$\times$. These results show that lifting with synthetic dynamics bridges the geometry-physics gap, unlocking a scalable path for neural simulation and potentially beyond. Code is available at https://github.com/Physics-Scaling/GeoPT.

View on arXivView PDF

Code Implementations(1)

Official Code for "GeoPT: Scaling Physics Simulation via Lifted Geometric Pre-Training" https://arxiv.org/pdf/2602.20399

21929Shell, PythonFeb 9, 20265 months ago
foundation-modelsphysics-simulationpretrainingself-supervised-learning

Cite this paper

@article{wu2026geopt,
  title  = {GeoPT: Scaling Physics Simulation via Lifted Geometric Pre-Training},
  author = {Haixu Wu and Minghao Guo and Zongyi Li and Zhiyang Dou and Mingsheng Long and Kaiming He and Wojciech Matusik},
  year   = {2026},
  eprint = {2602.20399},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2602.20399v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2602.20399.svg)](https://codeofpaper.com/paper/2602.20399)

Discussion