Weighted-Reward Preference Optimization for Implicit Model Fusion

Ziyi Yang, Fanqi Wan, Longguang Zhong, Tianyuan Shi, Xiaojun Quan
2/12/2026

No official code found. Best implementation: yangzy39/WRPO (3 stars, last commit 2025-03-17).

Semantic Scholar

Code Implementations(1)

yangzy39/WRPOCommunity60%

[ICLR 2025] Weighted-Reward Preference Optimization for Implicit Model Fusion

32PythonDec 4, 20241 years ago

Cite this paper

@article{yang2026weightedreward,
  title  = {Weighted-Reward Preference Optimization for Implicit Model Fusion},
  author = {Ziyi Yang and Fanqi Wan and Longguang Zhong and Tianyuan Shi and Xiaojun Quan},
  year   = {2026},
  url    = {https://api.semanticscholar.org/CorpusID:fd70a52a9db002f22794b60fb29e132c38c8bad0},
  journal = {ICLR 2025 2025}
}

Discussion