MoRE: A Mixture of Reflectors Framework for Large Language Model-Based Sequential Recommendation

Weicong Qin, Yi Xu, Weijie Yu, Chenglei Shen, Xiao Zhang +3 more
9/10/2024
cs.IRcs.CL

Official code: E-qin/MoRE-Rec (3 stars, MIT, last commit 2025-01-21).

Abstract

Large language models (LLMs) have emerged as a cutting-edge approach in sequential recommendation, leveraging historical interactions to model dynamic user preferences. Current methods mainly focus on learning processed recommendation data in the form of sequence-to-sequence text. While effective, they exhibit three key limitations: 1) failing to decouple intra-user explicit features (e.g., product titles) from implicit behavioral patterns (e.g., brand loyalty) within interaction histories; 2) underutilizing cross-user collaborative filtering (CF) signals; and 3) relying on inefficient reflection update strategies. To address this, We propose MoRE (Mixture of REflectors), which introduces three perspective-aware offline reflection processes to address these gaps. This decomposition directly resolves Challenges 1 (explicit/implicit ambiguity) and 2 (CF underutilization). Furthermore, MoRE's meta-reflector employs a self-improving strategy and a dynamic selection mechanism (Challenge 3) to adapt to evolving user preferences. First, two intra-user reflectors decouple explicit and implicit patterns from a user's interaction sequence, mimicking traditional recommender systems' ability to distinguish surface-level and latent preferences. A third cross-user reflector captures CF signals by analyzing user similarity patterns from multiple users' interactions. To optimize reflection quality, MoRE's meta-reflector employs a offline self-improving strategy that evaluates reflection impacts through comparisons of presence/absence and iterative refinement of old/new versions, with a online contextual bandit mechanism dynamically selecting the optimal perspective for recommendation for each user. Code: https://github.com/E-qin/MoRE-Rec.

View on arXivView PDF

Code Implementations(1)

E-qin/MoRE-RecOfficial100%
MIT
30Shell, PythonJan 21, 20251 years agoMIT

Similar Papers

Cite this paper

@article{qin2024more,
  title  = {MoRE: A Mixture of Reflectors Framework for Large Language Model-Based Sequential Recommendation},
  author = {Weicong Qin and Yi Xu and Weijie Yu and Chenglei Shen and Xiao Zhang and Ming He and Jianping Fan and Jun Xu},
  year   = {2024},
  eprint = {2409.06377},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2409.06377v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2409.06377.svg)](https://codeofpaper.com/paper/2409.06377)

Discussion