Deep Learning Recommendation Model for Personalization and Recommendation Systems

Maxim Naumov, Dheevatsa Mudigere, Hao-Jun Michael Shi, Jianyu Huang, Narayanan Sundaraman +19 more
5/31/2019
cs.IRcs.LG

Official code: facebookresearch/dlrm (4,075 stars, MIT, last commit 2026-01-12).

Abstract

With the advent of deep learning, neural network-based recommendation models have emerged as an important tool for tackling personalization and recommendation tasks. These networks differ significantly from other deep learning networks due to their need to handle categorical features and are not well studied or understood. In this paper, we develop a state-of-the-art deep learning recommendation model (DLRM) and provide its implementation in both PyTorch and Caffe2 frameworks. In addition, we design a specialized parallelization scheme utilizing model parallelism on the embedding tables to mitigate memory constraints while exploiting data parallelism to scale-out compute from the fully-connected layers. We compare DLRM against existing recommendation models and characterize its performance on the Big Basin AI platform, demonstrating its usefulness as a benchmark for future algorithmic experimentation and system co-design.

View on arXivView PDF

Code Implementations(1)

facebookresearch/dlrmOfficial100%
MIT

An implementation of a deep learning recommendation model (DLRM)

4,075858Shell, PythonMay 14, 20199 months agoMIT

Similar Papers

The Architectural Implications of Facebook's DNN-based Personalized Recommendation

87% match1 repo4.1k2019

Representation Learning with Large Language Models for Recommendation

85% match1 repo4622023

Emerging Synergies Between Large Language Models and Machine Learning in Ecommerce Recommendations

85% match2024

Knowledge Graph Driven Recommendation System Algorithm

84% match2023

DQRM: Deep Quantized Recommendation Models

84% match1 repo52024

Request-Only Optimization for Recommendation Systems

84% match2025

Cite this paper

@article{naumov2019deep,
  title  = {Deep Learning Recommendation Model for Personalization and Recommendation Systems},
  author = {Maxim Naumov and Dheevatsa Mudigere and Hao-Jun Michael Shi and Jianyu Huang and Narayanan Sundaraman and Jongsoo Park and Xiaodong Wang and Udit Gupta and Carole-Jean Wu and Alisson G. Azzolini and Dmytro Dzhulgakov and Andrey Mallevich and Ilia Cherniavskii and Yinghai Lu and Raghuraman Krishnamoorthi and Ansha Yu and Volodymyr Kondratenko and Stephanie Pereira and Xianjie Chen and Wenlin Chen and Vijay Rao and Bill Jia and Liang Xiong and Misha Smelyanskiy},
  year   = {2019},
  eprint = {1906.00091},
  archivePrefix = {arXiv},
  url    = {https://arxiv.org/abs/1906.00091}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/1906.00091.svg)](https://codeofpaper.com/paper/1906.00091)

Discussion