Escaping limit cycles: Global convergence for constrained nonconvex-nonconcave minimax problems

Thomas Pethick, Puya Latafat, Panagiotis Patrinos, Olivier Fercoq, Volkan Cevher
2/20/2023
math.OCcs.LG

No official code found. Best implementation: LIONS-EPFL/weak-minty-code (5 stars, MIT, last commit 2022-03-01).

Abstract

This paper introduces a new extragradient-type algorithm for a class of nonconvex-nonconcave minimax problems. It is well-known that finding a local solution for general minimax problems is computationally intractable. This observation has recently motivated the study of structures sufficient for convergence of first order methods in the more general setting of variational inequalities when the so-called weak Minty variational inequality (MVI) holds. This problem class captures non-trivial structures as we demonstrate with examples, for which a large family of existing algorithms provably converge to limit cycles. Our results require a less restrictive parameter range in the weak MVI compared to what is previously known, thus extending the applicability of our scheme. The proposed algorithm is applicable to constrained and regularized problems, and involves an adaptive stepsize allowing for potentially larger stepsizes. Our scheme also converges globally even in settings where the underlying operator exhibits limit cycles.

View on arXivView PDF

Code Implementations(1)

MIT
50MathematicaFeb 24, 20224 years agoMIT

Similar Papers

Cite this paper

@article{pethick2023escaping,
  title  = {Escaping limit cycles: Global convergence for constrained nonconvex-nonconcave minimax problems},
  author = {Thomas Pethick and Puya Latafat and Panagiotis Patrinos and Olivier Fercoq and Volkan Cevher},
  year   = {2023},
  eprint = {2302.09831},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2302.09831v1},
  journal = {ICLR 2023 2023}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2302.09831.svg)](https://codeofpaper.com/paper/2302.09831)

Discussion