On the Optimization and Generalization of Two-layer Transformers with Sign Gradient Descent

Bingrui Li, Wei Huang, Andi Han, Zhanpeng Zhou, Taiji Suzuki +2 more
2/12/2026

No confident code implementation found for this paper. 2 possible matches can be shown below.

Semantic Scholar

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{li2026optimization,
  title  = {On the Optimization and Generalization of Two-layer Transformers with Sign Gradient Descent},
  author = {Bingrui Li and Wei Huang and Andi Han and Zhanpeng Zhou and Taiji Suzuki and Jun Zhu and Jianfei Chen},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:7ded6bd5113d712c981a5e80e3c630ec1c93a668},
  journal = {ICLR 2025 2025}
}

Discussion