Unsupervised Learning of Long-Term Motion Dynamics for Videos

@article{Luo2017UnsupervisedLO,
  title={Unsupervised Learning of Long-Term Motion Dynamics for Videos},
  author={Zelun Luo and Boya Peng and De-An Huang and Alexandre Alahi and Li Fei-Fei},
  journal={2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
  year={2017},
  pages={7101-7110}
}
We present an unsupervised representation learning approach that compactly encodes the motion dependencies in videos. Given a pair of images from a video clip, our framework learns to predict the long-term 3D motions. To reduce the complexity of the learning framework, we propose to describe the motion as a sequence of atomic 3D flows computed with RGB-D modality. We use a Recurrent Neural Network based Encoder-Decoder framework to predict these sequences of flows. We argue that in order for… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 64 CITATIONS, ESTIMATED 98% COVERAGE

Pattern Recognition

  • Lecture Notes in Computer Science
  • 2018
VIEW 10 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Unsupervised Learning of View-invariant Action Representations

VIEW 8 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

RGB-D-based human motion recognition with deep learning: A survey

  • Computer Vision and Image Understanding
  • 2017
VIEW 9 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

Forecasting Hand and Object Locations in Future Frames

  • ArXiv
  • 2017
VIEW 4 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Forecasting Hands and Objects in Future Frames

VIEW 5 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

3D Motion Decomposition for RGBD Future Dynamic Scene Synthesis

Xiaojuan Qi, Zhengzhe Liu, Qifeng Chen, Jiaya Jia
  • CVPR
  • 2019
VIEW 2 EXCERPTS
CITES BACKGROUND

FILTER CITATIONS BY YEAR

2017
2019

CITATION STATISTICS

  • 7 Highly Influenced Citations

  • Averaged 21 Citations per year from 2017 through 2019

References

Publications referenced by this paper.
SHOWING 1-10 OF 52 REFERENCES

NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis

  • 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2016
VIEW 6 EXCERPTS
HIGHLY INFLUENTIAL

Dense Optical Flow Prediction from a Static Image

  • 2015 IEEE International Conference on Computer Vision (ICCV)
  • 2015
VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL

Action recognition based on a bag of 3D points

  • 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops
  • 2010
VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL

Action Recognition with Improved Trajectories

  • 2013 IEEE International Conference on Computer Vision
  • 2013
VIEW 7 EXCERPTS
HIGHLY INFLUENTIAL

3D Action Recognition from Novel Viewpoints

  • 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2016
VIEW 1 EXCERPT