Recognition of human activity through hierarchical stochastic learning

  title={Recognition of human activity through hierarchical stochastic learning},
  author={Sebastian L{\"u}hr and Hung Hai Bui and Svetha Venkatesh and Geoff A. W. West},
  journal={Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003).},
  • Sebastian Lühr, H. Bui, G. West
  • Published 23 March 2003
  • Computer Science
  • Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003).
Seeking to extend the functional capability of the elderly, we explore the use of probabilistic methods to learn and recognise human activity in order to provide monitoring support. We propose a novel approach to learning the hierarchical structure of sequences of human actions through the application of the hierarchical hidden Markov model (HHMM). Experimental results are presented for learning and recognising sequences of typical activities in a home. 

Figures and Tables from this paper

Hierarchical-HMM Based Recognition of Human Activity
The hierarchical hidden Markov model (HHMM) is employed to represent the models, in which each model is composed of a submodel of the target action and submodels which can represent any action, and they are connected appropriately.
Hierarchical Activity Recognition Using Automatically Clustered Actions
This paper presents a two-layer hierarchical model in which activities consist of a sequence of actions, which outperforms the non-hierarchical models in all datasets and does so significantly in two of the three datasets.
Learning Hierarchical Models of Complex Daily Activities from Annotated Videos
A novel approach for building models of complex long-term activities by automatically learning the hierarchical structure of activities by learning about the 'parent-child' relation of activity components from a video using the variability in annotations acquired using multiple annotators.
Activity recognition and abnormality detection with the switching hidden semi-Markov model
The switching hidden semi-markov model (S-HSMM) is introduced, a two-layered extension of thehidden semi-Markov model for the modeling task and an effective scheme to detect abnormality without the need for training on abnormal data is proposed.
Identification and prediction of abnormal behaviour activities of daily living in intelligent environments
This thesis investigates methods for supporting independent living of the elderly by means of equipping their home with a simple sensor network to monitor their behaviour and identify their Activities of Daily Living (ADL).
Duration Abnormality Detection in Sequences of Human Activity
This paper shows how the application of the explicit state duration HMM can alleviate the problem of highly unusual duration failure, enabling us to distinguish between sequences of activity in which the order of observations is identical but the duration of activities is different and to identify the presence of abnormal activity duration.
PREDIcting inhabitant action using action and task models with application to smart homes
This paper model inhabitant actions as states in a simple Markov model, and introduces an enhancement to this basic approach, the Task-basedMarkov model (TMM) method, which discovers high-level inhabitant tasks using the supplied unlabeled data.
Behaviour Recognition in Smart Homes
This doctoral study takes several steps towards addressing the problem of finding an approximation to this mapping, beginning with separate investigations on current methods proposed in the literature, identifying useful sensory outputs for behaviour recognition, and concluding by proposing two directions: one using supervised learning on annotated sensory stream and one using unsupervised learning on unannotated ones.
Activity knowledge transfer in smart environments


Recognition of Visual Activities and Interactions by Stochastic Parsing
A probabilistic syntactic approach to the detection and recognition of temporally extended activities and interactions between multiple agents and how the system correctly interprets activities of multiple interacting objects is demonstrated.
Hierarchical monitoring of people's behaviors in complex environments using multiple cameras
The novelty of the paper lies in the implementation of a scalable framework in the context of both the scale of behaviors and the size of the environment, making it ideal for distributed surveillance.
Learning Patterns of Activity Using Real-Time Tracking
This paper focuses on motion tracking and shows how one can use observed motion to learn patterns of activity in a site and create a hierarchical binary-tree classification of the representations within a sequence.
The Hierarchical Hidden Markov Model: Analysis and Applications
This work introduces, analyzes and demonstrates a recursive hierarchical generalization of the widely used hidden Markov models, which is motivated by the complex multi-scale structure which appears in many natural sequences, particularly in language, handwriting and speech.
Hierarchical learning and planning in partially observable markov decision processes
A Hierarchical POMDP (HPOMDP) model to scale learning and planning to large scale partially observable environments and the results show that the planning algorithms are very successful in taking the robot to any environment state starting from no positional knowledge, and use significantly less number of steps than flat approaches.
A tutorial on hidden Markov models and selected applications in speech recognition
The fabric comprises a novel type of netting which will have particular utility in screening out mosquitoes and like insects and pests. The fabric is defined of voids having depth as well as width
A New Approach to Linear Filtering and Prediction Problems
The clssical filleting and prediclion problem is re-examined using the Bode-Shannon representation of random processes and the ?stat-tran-sition? method of analysis of dynamic systems. New result
Tracking and Surveillance in Wide-Area Spatial Environments Using the Abstract Hidden Markov Model
This paper describes an application for tracking human movement in an office-like spatial layout where the AHMM is used to track and predict the evolution of object trajectories at different levels of detail.
Policy Recognition in the Abstract Hidden Markov Model
This paper introduces the Abstract Hidden Markov Model (AHMM), a novel type of stochastic processes, provide its dynamic Bayesian network (DBN) structure and analyse the properties of this network, and proposes a novel plan recognition framework based on the AHMM as the plan execution model.
IEEE Transactions on Pattern Analysis and Machine Intelligence
  • K. Fu
  • Computer Science
  • 2004