MultiPoseNet: Fast Multi-Person Pose Estimation using Pose Residual Network

@article{Kocabas2018MultiPoseNetFM,
  title={MultiPoseNet: Fast Multi-Person Pose Estimation using Pose Residual Network},
  author={Muhammed Kocabas and Salih Karagoz and Emre Akbas},
  journal={ArXiv},
  year={2018},
  volume={abs/1807.04067}
}
In this paper, we present MultiPoseNet, a novel bottom-up multi-person pose estimation architecture that combines a multi-task model with a novel assignment method. MultiPoseNet can jointly handle person detection, person segmentation and pose estimation problems. The novel assignment method is implemented by the Pose Residual Network (PRN) which receives keypoint and person detections, and produces accurate poses by assigning keypoints to person instances. On the COCO keypoints dataset, our… 
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
We present an approach to efficiently detect the 2D pose of multiple people in an image. The approach uses a nonparametric representation, which we refer to as Part Affinity Fields (PAFs), to learn
An Attention Module for Multi-Person Pose Estimation
TLDR
This work proposes and attention module that could let the model get global receptive field at the shallow layer of the network and pay more attention to the key areas which is more important to pose estimation.
OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
TLDR
OpenPose is released, the first open-source realtime system for multi-person 2D pose detection, including body, foot, hand, and facial keypoints, and the first combined body and foot keypoint detector, based on an internal annotated foot dataset.
PandaNet: Anchor-Based Single-Shot Multi-Person 3D Pose Estimation
TLDR
PandaNet surpasses previous single-shot methods on several challenging datasets: a multi-person urban virtual but very realistic dataset (JTA Dataset), and two real world 3D multi- person datasets (CMU Panoptic and MuPoTS-3D).
PoseDet: Fast Multi-Person Pose Estimation Using Pose Embedding
TLDR
A novel framework PoseDet (Estimating Pose by Detection) to localize and associate body joints simultaneously at higher inference speed is presented and the keypoint-aware pose embedding to represent an object in terms of the locations of its keypoints is proposed.
Multi-person Pose Estimation with Object Occlusion Information
TLDR
Two novel modules to group invisible keypoints occluded by various objects into the right body part are presented and experimental results show that the model has greater performance and faster inference speed compared to most of previous methods.
Unsupervised Cross-Modal Alignment for Multi-Person 3D Pose Estimation
TLDR
A novel neural representation of multi-person 3D pose which unifies the position of person instances with their corresponding3D pose representation is adopted which yields a superior trade-off between speed and performance, compared to prior top-down approaches.
PoseFix: Model-Agnostic General Human Pose Refinement Network
TLDR
This paper proposes a human pose refinement network that estimates a refined pose from a tuple of an input image and input pose and shows that the proposed approach achieves better performance than the conventional multi-stage refinement models and consistently improves the performance of various state-of-the-art pose estimation methods on the commonly used benchmark.
Fast and Robust Multi-Person 3D Pose Estimation From Multiple Views
TLDR
This paper addresses the problem of 3D pose estimation for multiple people in a few calibrated camera views by using a multi-way matching algorithm to cluster the detected 2D poses in all views and proposes to combine geometric and appearance cues for cross-view matching.
HMOR: Hierarchical Multi-Person Ordinal Relations for Monocular Multi-Person 3D Pose Estimation
TLDR
This paper attempts to address the lack of a global perspective of the top-down approaches to 3D human pose estimation by introducing a novel form of supervision - Hierarchical Multi-person Ordinal Relations (HMOR).
...
...

References

SHOWING 1-10 OF 56 REFERENCES
RMPE: Regional Multi-person Pose Estimation
TLDR
This paper proposes a novel regional multi-person pose estimation (RMPE) framework to facilitate pose estimation in the presence of inaccurate human bounding boxes and can achieve 76:7 mAP on the MPII (multi person) dataset.
DeeperCut: A Deeper, Stronger, and Faster Multi-person Pose Estimation Model
The goal of this paper is to advance the state-of-the-art of articulated pose estimation in scenes with multiple people. To that end we contribute on three fronts. We propose (1) improved body part
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
We present an approach to efficiently detect the 2D pose of multiple people in an image. The approach uses a nonparametric representation, which we refer to as Part Affinity Fields (PAFs), to learn
PoseTrack: Joint Multi-person Pose Estimation and Tracking
TLDR
This work proposes a novel method that jointly models multi-person pose estimation and tracking in a single formulation and introduces a challenging Multi-Person PoseTrack dataset, and proposes a completely unconstrained evaluation protocol that does not make any assumptions about the scale, size, location or the number of persons.
Multi-person Pose Estimation with Local Joint-to-Person Associations
TLDR
This work proposes a method that estimates the poses of multiple persons in an image in which a person can be occluded by another person or might be truncated, and considers multi-person pose estimation as a joint-to-person association problem.
DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimation
TLDR
An approach that jointly solves the tasks of detection and pose estimation: it infers the number of persons in a scene, identifies occluded body parts, and disambiguates body parts between people in close proximity of each other is proposed.
Cascaded Pyramid Network for Multi-person Pose Estimation
TLDR
A novel network structure called Cascaded Pyramid Network (CPN) is presented which targets to relieve the problem from these "hard" keypoints, with state-of-art results on the COCO keypoint benchmark, with average precision at 73.0.
Towards Accurate Multi-person Pose Estimation in the Wild
TLDR
This work proposes a method for multi-person detection and 2-D pose estimation that achieves state-of-art results on the challenging COCO keypoints task by using a novel form of keypoint-based Non-Maximum-Suppression (NMS), instead of the cruder box-level NMS, and by introducing a novel aggregation procedure to obtain highly localized keypoint predictions.
Human Pose Estimation Using Deep Consensus Voting
TLDR
This paper proposes a novel approach where each location in the image votes for the position of each keypoint using a convolutional neural net, which produces good keypoint predictions and enables us to compute image-dependent joint keypoint probabilities by looking at consensus voting.
Joint Multi-person Pose Estimation and Semantic Part Segmentation
TLDR
This paper proposes to solve the two tasks jointly for natural multi-person images, in which the estimated pose provides object-level shape prior to regularize part segments while the part-level segments constrain the variation of pose locations.
...
...