Corpus ID: 61058350

Connectionist Speech Recognition: A Hybrid Approach

@inproceedings{Bourlard1993ConnectionistSR,
  title={Connectionist Speech Recognition: A Hybrid Approach},
  author={H. Bourlard and N. Morgan},
  year={1993}
}
From the Publisher: Connectionist Speech Recognition: A Hybrid Approach describes the theory and implementation of a method to incorporate neural network approaches into state-of-the-art continuous speech recognition systems based on Hidden Markov Models (HMMs) to improve their performance. In this framework, neural networks (and in particular, multilayer perceptrons or MLPs) have been restricted to well-defined subtasks of the whole system, i.e., HMM emission probability estimation and… Expand

Topics from this paper

The 1994 Abbot hybrid connectionist-HMM large vocabulary recognition system.
TLDR
The emphasis of the paper is on the differences between the 1993 and 1994 versions of the ABBOT system, which includes the utilization of a larger training corpus, the extension of the lexicon, the application of a trigram language model, and the development of a near-realtime single-pass decoder well suited for the hybrid approach. Expand
A New Approach to Hybrid HMM/ANN Speech Recognition using Mutual Information Neural Networks
TLDR
It is shown that the resulting hybrid system achieves very high recognition rates, which are now already on the same level as the best conventional HMM systems with continuous parameters, and the capabilities of the mutual information neural networks are not yet entirely exploited. Expand
Robust combination of neural networks and hidden Markov models for speech recognition
TLDR
Experimental results in speaker-independent, continuous speech recognition over Italian digit-strings validate the novel hybrid framework, allowing for improved recognition performance over HMMs with mixtures of Gaussian components, as well as over Bourlard and Morgan's paradigm. Expand
Predictive Connectionist Approach to Speech Recognition
  • B. Petek
  • Computer Science
  • Summer School on Neural Networks
  • 2004
TLDR
This tutorial describes a context-dependent Hidden Control Neural Network architecture for large vocabulary continuous speech recognition that belongs to a family of Hidden Markov Model/Multi-Layer Perceptron (HMM/MLP) hybrids, usually referred to as Predictive Neural Networks. Expand
Tied posteriors: an approach for effective introduction of context dependency in hybrid NN/HMM LVCSR
  • J. Rottland, G. Rigoll
  • Computer Science
  • 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100)
  • 2000
TLDR
The approach is based on a standard hybrid connectionist/HMM recognizer, in which the neural nets are trained to estimate the a posteriori probabilities for all phones in each input frame, and the resulting system is called tied posterior. Expand
Hybrid HMM / Neural Network based Speech Recognition in Loquendo ASR
This paper describes hybrid Hidden Markov Models / Artificial Neural Networks (HMM/ANN) models devoted to speech recognition, and in particular Loquendo HMM/ANN, that is the core of Loquendo ASR.Expand
Modular Neural Networks for Speech Recognition.
TLDR
A hybrid speech recognition system based on modular neural networks and the state-of-the-art continuous density IIMM speech recognizer JANUS is developed, shown that modularity and the principle of divide-and-conquer applied to neural network learning reduces training times significantly. Expand
Hybrid Models for Automatic Speech Recognition: A Comparison of Classical ANN and Kernel Based Methods
TLDR
This paper has recalled the hybrid (ANN/HMM) solutions provided in the past for ANNs and applied them to SVMs performing a comparison between them and found that the ANN/H MM system provides better results than the HMM-based system. Expand
Comparison of a new hybrid connectionist-SCHMM approach with other hybrid approaches for speech recognition
  • H. Hutter
  • Computer Science
  • 1995 International Conference on Acoustics, Speech, and Signal Processing
  • 1995
TLDR
This approach compared favorably with other proposed hybrid systems and classical approaches on an isolated German digit recognition task over telephone lines, and exhibited the highest recognition rate and followed by an approach using LVQ3 optimization of the codebook. Expand
Continuous speech recognition
TLDR
The authors focus on a tutorial description of the hybrid HMM/ANN method, which provides a mechanism for incorporating a range of sources of evidence without strong assumptions about their joint statistics, and may have applicability to much more complex systems that can incorporate deep acoustic and linguistic context. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 196 REFERENCES
Statistical Inference in Multilayer Perceptrons and Hidden Markov Models with Applications in Continuous Speech Recognition
TLDR
The statistical use of a particular classic form of a connectionist system, the Multilayer Perceptron (MLP), is described in the context of the recognition of continuous speech. Expand
A Continuous Speech Recognition System Embedding MLP into HMM
TLDR
It is shown here that word recognition performance for a simple discrete density HMM system appears to be somewhat better when MLP methods are used to estimate the emission probabilities. Expand
Continuous speech recognition using segmental neural nets
TLDR
A novel hybrid SNN/HMM system that combines the advantages of both types of approaches is developed, made of the N-best paradigm to generate likely phonetic segmentations, which are then scored by the SNN. Expand
Links Between Markov Models and Multilayer Perceptrons
TLDR
It is shown theoretically and experimentally that the outputs of the MLP approximate the probability distribution over output classes conditioned on the input, i.e. the maximum a posteriori probabilities. Expand
Connectionist probability estimation in the DECIPHER speech recognition system
TLDR
Results indicate that connectionist probability estimation can improve performance of a context-independent maximum-likelihood-trained HMM system; performance of the connectionist system is close to what can be achieved using (context-dependent) HMM systems of much higher complexity. Expand
The HARPY speech recognition system
TLDR
The HARPY system is the result of an attempt to understand the relative importance of various design choices of two earlier speech recognition systems developed at Carnegie-Mellon University, in which knowledge is represented as a finite state transition network but without the a-priori transition probabilities. Expand
Hybrid neural network/hidden Markov model continuous-speech recognition
TLDR
A hybrid multilayer perceptron (MLP)/hidde arkov model (HMM) speaker-independent continuous-speech recogni-b tion system, in which the advantages of both approaches are combined using MLPs to estimate the state-dependent observation probabilities of an HMM. Expand
Review of Neural Networks for Speech Recognition
TLDR
Further work is necessary for large-vocabulary continuous-speech problems, to develop training algorithms that progressively build internal word models, and to develop compact VLSI neural net hardware. Expand
Phoneme recognition using time-delay neural networks
The authors present a time-delay neural network (TDNN) approach to phoneme recognition which is characterized by two important properties: (1) using a three-layer arrangement of simple computingExpand
Speech and neural network dynamics
TLDR
The radial basis functions (RBF) network is introduced and its properties related to other statistical and neural network classifiers and the dynamics of a recurrent neural network model are investigated. Expand
...
1
2
3
4
5
...