Multimodal Recommendation Dialog with Subjective Preference: A New Challenge and Benchmark

Yuxing Long, Binyuan Hui, Caixia Yuan1, Fei Huang, Yongbin Li +1 more
5/26/2023
cs.IRcs.AIcs.CL

No confident code implementation found for this paper.

Abstract

Existing multimodal task-oriented dialog data fails to demonstrate the diverse expressions of user subjective preferences and recommendation acts in the real-life shopping scenario. This paper introduces a new dataset SURE (Multimodal Recommendation Dialog with SUbjective PREference), which contains 12K shopping dialogs in complex store scenes. The data is built in two phases with human annotations to ensure quality and diversity. SURE is well-annotated with subjective preferences and recommendation acts proposed by sales experts. A comprehensive analysis is given to reveal the distinguishing features of SURE. Three benchmark tasks are then proposed on the data to evaluate the capability of multimodal recommendation agents. Based on the SURE, we propose a baseline model, powered by a state-of-the-art multimodal model, for these tasks.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Personalization Matters: Long-Horizon Conversation Agent with User-Centric Information in Online Shopping Interactions

86% match1 repo2026

U-NEED: A Fine-grained Dataset for User Needs-Centric E-commerce Conversational Recommendation

83% match2023

Where and What: Reasoning Dynamic and Implicit Preferences in Situated Conversational Recommendation

82% match2 repos12026

INSPIRED2: An Improved Dataset for Sociable Conversational Recommendation

81% match1 repo82022

Salespeople vs SalesBot: Exploring the Role of Educational Value in Conversational Recommender Systems

81% match1 repo42023

ATFLRec: A Multimodal Recommender System with Audio-Text Fusion and Low-Rank Adaptation via Instruction-Tuned Large Language Model

80% match2024

Cite this paper

@article{long2023multimodal,
  title  = {Multimodal Recommendation Dialog with Subjective Preference: A New Challenge and Benchmark},
  author = {Yuxing Long and Binyuan Hui and Caixia Yuan1 and Fei Huang and Yongbin Li and Xiaojie Wang},
  year   = {2023},
  eprint = {2305.18212},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2305.18212v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2305.18212.svg)](https://codeofpaper.com/paper/2305.18212)

Discussion