RTMPose: Real-Time Multi-Person Pose Estimation based on MMPose

Tao Jiang, Peng Lu, Li Zhang, Ningsheng Ma, Rui Han +3 more
3/13/2023
cs.CV

Official code: open-mmlab/mmpose (7,782 stars, Apache-2.0, PyTorch, last commit 2025-08-04). 1 more implementation below.

Abstract

Recent studies on 2D pose estimation have achieved excellent performance on public benchmarks, yet its application in the industrial community still suffers from heavy model parameters and high latency. In order to bridge this gap, we empirically explore key factors in pose estimation including paradigm, model architecture, training strategy, and deployment, and present a high-performance real-time multi-person pose estimation framework, RTMPose, based on MMPose. Our RTMPose-m achieves 75.8% AP on COCO with 90+ FPS on an Intel i7-11700 CPU and 430+ FPS on an NVIDIA GTX 1660 Ti GPU, and RTMPose-l achieves 67.0% AP on COCO-WholeBody with 130+ FPS. To further evaluate RTMPose's capability in critical real-time applications, we also report the performance after deploying on the mobile device. Our RTMPose-s achieves 72.2% AP on COCO with 70+ FPS on a Snapdragon 865 chip, outperforming existing open-source libraries. Code and models are released at https://github.com/open-mmlab/mmpose/tree/1.x/projects/rtmpose.

View on arXivView PDF

Code Implementations(2)

open-mmlab/mmposeOfficial100%
PyTorchApache-2.0

OpenMMLab Pose Estimation Toolbox and Benchmark.

7,7821,515C++, ShellJul 8, 20201 years agoApache-2.0
animal-pose-estimationbenchmarkcpmcrowdposeface-keypoint+15 more
MVIG-SJTU/AlphaPoseCommunity73%
PyTorch

Real-Time and Accurate Full-Body Multi-Person Pose Estimation&Tracking System

8,5932,028C, C++Jan 17, 20182 years agoNOASSERTION
accuratealpha-posealphaposecrowdposefull-body+15 more

Similar Papers

Efficient Human Pose Estimation: Leveraging Advanced Techniques with MediaPipe

87% match2024

DIR-BHRNet: A Lightweight Network for Real-time Vision-based Multi-person Pose Estimation on Smartphones

87% match2024

RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimation

86% match1 repo7.8k2023

ER-Pose: Rethinking Keypoint-Driven Representation Learning for Real-Time Human Pose Estimation

86% match2026

UniPose: Unified Human Pose Estimation in Single Images and Videos

86% match1 repo2232020

Improving Real-Time Omnidirectional 3D Multi-Person Human Pose Estimation with People Matching and Unsupervised 2D-3D Lifting

85% match2024

Cite this paper

@article{jiang2023rtmpose,
  title  = {RTMPose: Real-Time Multi-Person Pose Estimation based on MMPose},
  author = {Tao Jiang and Peng Lu and Li Zhang and Ningsheng Ma and Rui Han and Chengqi Lyu and Yining Li and Kai Chen},
  year   = {2023},
  eprint = {2303.07399},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2303.07399v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2303.07399.svg)](https://codeofpaper.com/paper/2303.07399)

Discussion