• Corpus ID: 1337178

How Robots Can Recognize Activities and Plans Using Topic Models

  title={How Robots Can Recognize Activities and Plans Using Topic Models},
  author={Richard Gabriel Freedman and Hee-Tae Jung and Roderic A. Grupen and Shlomo Zilberstein},
  booktitle={AAAI 2014},
The ability to identify what humans are doing in the environment is a crucial element of successful responsive behavior in human-robot interaction. We examine new ways to perform plan recognition (PR) using natural language processing (NLP) techniques. PR often focuses on the structural relationships between consecutive observations and ordered activities that comprise plans. However, NLP commonly treats text as a bag-of-words, omitting such structural relationships and using topic models to… 

Figures from this paper

Directional Multi-Scale Stationary Wavelet-Based Representation for Human Action Classification
A stationary wavelet-based representation of natural human actions in realistic videos that utilizes the 3D Stationary Wavelet Transform to encode the directional multi-scale spatiotemporal characteristics of the motion available in a frame sequence is proposed.
Human-Robot Emergency Response - Experimental Platform and Preliminary Dataset
The results suggest that the human-robot team of asymmetric roles can significantly outperform individual agents in laboratory emergency response scenarios and a preliminary dataset.
Human action recognition via multi-scale 3D stationary wavelet analysis
The 3D multi-scale stationary wavelet analysis is used to build a view-based multi- scale spatio-temporal representation of the human actions, which benefits from the ability of the 3D stationary wavelets transform to fuse the spatio/temporal information highlighted at different scales and orientations.
Fusing directional wavelet local binary pattern and moments for human action recognition
A new method for human action representation and description is proposed that combines the advantages of local and global descriptions and is verified using standard datasets, achieving high accuracy in comparison with state-of-the-art methods.
Towards Intelligent Decision Support in Human Team Planning
This paper highlights an emerging research area of IDS for human team planning, i.e. environments where the agent works with a team of human planners to enhance the quality of their plans and the ease of making them.


Human Action Recognition by Semilatent Topic Models
  • Yang Wang, Greg Mori
  • Computer Science
    IEEE Transactions on Pattern Analysis and Machine Intelligence
  • 2009
Two new models for human action recognition from video sequences using topic models differ from previous latent topic models for visual recognition in two major aspects: first of all, the latent topics in the models directly correspond to class labels; second, some of the latent variables in previous topic models become observed in this case.
Human Action Recognition by Semi-Latent Topic Models
Two new models for human action recognition from video sequences using topic models based on a novel “bag-of-words” representation, where each frame corresponds to a “word”, are proposed.
Using Dependent Regions for Object Categorization in a Generative Framework
  • G. Wang, Ye Zhang, Li Fei-Fei
  • Computer Science
    2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06)
  • 2006
This paper relaxes the independence assumption and model explicitly the inter-dependency of the local regions of the "bag of words" models, and introduces a linkage structure over the latent themes to encode the dependencies of the patches.
On Natural Language Processing and Plan Recognition
The relations between natural language processing and plan recognition are outlined, it is argued that each of them can effectively inform the other, and key recent research results in NLP are focused on and argued for their applicability to PR.
Accounting for Context in Plan Recognition, with Application to Traffic Monitoring
A general Bayesian framework encompassing this view is presented, and it is shown how context can be exploited in plan recognition on a problem in traffic monitoring.
The Hierarchical Hidden Markov Model: Analysis and Applications
This work introduces, analyzes and demonstrates a recursive hierarchical generalization of the widely used hidden Markov models, which is motivated by the complex multi-scale structure which appears in many natural sequences, particularly in language, handwriting and speech.
Plan Recognition (Dagstuhl Seminar 11141)
This Dagstuhl seminar brought together researchers with a wide range of interests and backgrounds and featured a substantial set of longer tutorials on aspects of plan and activity recognition, and related topics and useful methods, as a way of establishing a common vocabulary and shared basis of understanding.
Latent Dirichlet Allocation
Feature Set Selection and Optimal Classifier for Human Activity Recognition
A thorough analysis of features and classifiers aimed at human activity recognition is presented, based on a set of 10 activities, and the interdependency between feature selection method and chosen classifier is investigated.
Unstructured human activity detection from RGBD images
This paper uses a RGBD sensor as the input sensor, and compute a set of features based on human pose and motion, as well as based on image and point-cloud information, based on a hierarchical maximum entropy Markov model (MEMM).