# Joint Modeling of Multiple Related Time Series via the Beta Process

@article{Fox2011JointMO, title={Joint Modeling of Multiple Related Time Series via the Beta Process}, author={Emily B. Fox and Erik B. Sudderth and Michael I. Jordan and Alan S. Willsky}, journal={arXiv: Methodology}, year={2011} }

We propose a Bayesian nonparametric approach to the problem of jointly modeling multiple related time series. Our approach is based on the discovery of a set of latent, shared dynamical behaviors. Using a beta process prior, the size of the set and the sharing pattern are both inferred from data. We develop efficient Markov chain Monte Carlo methods based on the Indian buffet process representation of the predictive distribution of the beta process, without relying on a truncated model. In…

## 42 Citations

### Segmenting Time Series Data Using GP-HSMM with Nonparametric Bayesian Model

- Computer Science
- 2018

The proposed hierarchical Dirichlet processes-Gaussian process-hidden semi-Markov model (HDP-GP-HSMM) can estimate more correct number of classes and achieve more accurate segmentation than baseline methods.

### Introduction to Bayesian Nonparametric Methods for Clustering and Time Series Analysis

- Computer Science
- 2015

This tutorial is to provide a conceptual introduction to Bayesian nonparametrics that assumes only basic knowledge of standard Bayesian statistics, while also containing a few key derivations that provide mathematical insight into the presented methods.

### Modeling and recognizing human trajectories with beta process hidden Markov models

- Computer SciencePattern Recognit.
- 2015

### Sequence Pattern Extraction by Segmenting Time Series Data Using GP-HSMM with Hierarchical Dirichlet Process

- Computer Science2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
- 2018

The proposed method for dividing continuous time-series data into segments in an unsupervised manner based on a hidden semi-Markov model with Gaussian process (GP-HSMM) is extended to a nonparametric Bayesian model by introducing a hierarchical Dirichlet process (HDP), and the parameters of the proposed HDP-GP- HSMM are estimated by applying slice sampling.

### Human activity recognition with beta process hidden Markov models

- Computer Science2013 International Conference on Machine Learning and Cybernetics
- 2013

This work proposes a new method for modeling human trajectories based on the beta process hidden Markov models (BP-HMM), and develops an efficient Markov chain Monte Carlo algorithm for model training.

### HUMAN ACTIVITY RECOGNITIONWITH BETA PROCESS HIDDEN MARKOVMODELS

- Computer Science
- 2012

This work proposes a new method for modeling human trajectories based on the beta process hidden Markov models (BPHMM), and develops an efficient Markov chain Monte Carlo algorithm for model training.

### Variational hidden conditional random fields with beta processes

- Computer Science2017 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)
- 2017

A novel Bayesian nonparametric version of the HCRF referred as BP-HCRF is proposed, which takes the advantages of the BPs on modeling hidden states, and the modeled sequences can have different state spaces with infinite hidden states.

### HVGH: Unsupervised Segmentation for High-Dimensional Time Series Using Deep Neural Compression and Statistical Generative Model

- Computer ScienceFront. Robot. AI
- 2019

A hierarchical Dirichlet process–variational autoencoder–Gaussian process–hidden semi-Markov model (HVGH) is proposed that can extract features from high-dimensional time-series data while simultaneously dividing it into segments in an unsupervised manner.

### High-dimensional Motion Segmentation by Variational Autoencoder and Gaussian Processes

- Computer Science2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
- 2019

A hierarchical Dirichlet process–variational autoencoder–Gaussian process–hidden semi-Markov model (HVGH) is proposed that can extract features from high-dimensional time-series data, while simultaneously dividing it into segments in an unsupervised manner.

### A Bayesian Nonparametric Topic Model for User Interest Modeling

- Computer Science2014 IEEE 17th International Conference on Computational Science and Engineering
- 2014

This work proposes a Bayesian nonparametric approach to the problem of modeling user interests in recommender systems using implicit feedback like user navigations and clicks on items and develops a Markov chain Monte Carlo inference method based on the Indian buffet process representation of the beta process.

## References

SHOWING 1-10 OF 44 REFERENCES

### Sharing Features among Dynamical Systems with Beta Processes

- Computer ScienceNIPS
- 2009

This work develops an efficient Markov chain Monte Carlo inference method that is based on the Indian buffet process representation of the predictive distribution of the beta process, and uses the sum-product algorithm to efficiently compute Metropolis-Hastings acceptance probabilities.

### Discovering shared and individual latent structure in multiple time series

- Computer ScienceArXiv
- 2010

A nonparametric Bayesian method for exploratory data analysis and feature construction in continuous time series and applies this model to the task of tracking the physiological signals of premature infants, which obtains clinically significant insights as well as useful features for supervised learning tasks.

### Bayesian Nonparametric Methods for Learning Markov Switching Processes

- Computer ScienceIEEE Signal Processing Magazine
- 2010

A Bayesian nonparametric approach to learning Markov switching processes requires one to make fewer assumptions about the underlying dynamics, and thereby allows the data to drive the complexity of the inferred model.

### Order-Based Dependent Dirichlet Processes

- Mathematics, Computer Science
- 2006

This article allows the nonparametric distribution to depend on covariates through ordering the random variables building the weights in the stick-breaking representation and derives the correlation between distributions at different covariate values.

### Gaussian Process Dynamical Models for Human Motion

- Computer ScienceIEEE Transactions on Pattern Analysis and Machine Intelligence
- 2008

This work marginalize out the model parameters in closed form by using Gaussian process priors for both the dynamical and the observation mappings, which results in a nonparametric model for dynamical systems that accounts for uncertainty in the model.

### MULTIVARIATE KERNEL PARTITION PROCESS MIXTURES.

- MathematicsStatistica Sinica
- 2010

A kernel partition process (KPP) in which the cluster allocation varies for different parameters is proposed, shown to be the driving measure for a multivariate ordered Chinese restaurant process that induces a highly-flexible dependence structure in local clustering.

### Discovering clusters in motion time-series data

- Computer Science2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings.
- 2003

An approach is proposed for clustering time-series data that allows each sequence to belong to more than a single HMM with some probability, and the hard decision about the sequence class membership can be deferred until a later time when such a decision is required.

### Nonparametric Bayes local partition models for random effects.

- Mathematics, Computer ScienceBiometrika
- 2009

A local partition process prior is proposed, which induces dependent local clustering in a Bayesian hierarchical model, and a slice sampler is developed which bypasses the need to approximate the countably infinite random measure in performing posterior computation.

### Infinite latent feature models and the Indian buffet process

- Computer Science, MathematicsNIPS
- 2005

We define a probability distribution over equivalence classes of binary matrices with a finite number of rows and an unbounded number of columns. This distribution is suitable for use as a prior in…

### Mixed Hidden Markov Models

- Computer Science
- 2007

A new class of models, mixed HMMs (MHMMs), where both covariates and random effects are used to capture differences among processes, are presented, and it is shown that the model can describe the heterogeneity among patients.