Optimizing neural network hyperparameters with Gaussian processes for dialog act classification

@article{Dernoncourt2016OptimizingNN,
  title={Optimizing neural network hyperparameters with Gaussian processes for dialog act classification},
  author={Franck Dernoncourt and J. Y. Lee},
  journal={2016 IEEE Spoken Language Technology Workshop (SLT)},
  year={2016},
  pages={406-413}
}
Systems based on artificial neural networks (ANNs) have achieved state-of-the-art results in many natural language processing tasks. Although ANNs do not require manually engineered features, ANNs have many hyperparameters to be optimized. The choice of hyperparameters significantly impacts models' performances. However, the ANN hyperparameters are typically chosen by manual, grid, or random search, which either requires expert experiences or is computationally expensive. Recent approaches… Expand
Meta Learning for Hyperparameter Optimization in Dialogue System
Evaluation of the Influences of Hyper-Parameters and L2-Norm Regularization on ANN Model for MNIST Recognition
Bayesian Optimization for Selecting Efficient Machine Learning Models
Sequential short-text classification with neural networks
Hyper-parameter Optimisation by Restrained Stochastic Hill Climbing
Neural Networks for Joint Sentence Classification in Medical Paper Abstracts
Normality Testing for Vectors on Perceptron Layers
Information extraction with neural networks
...
1
2
3
...

References

SHOWING 1-10 OF 37 REFERENCES
Practical Bayesian Optimization of Machine Learning Algorithms
Algorithms for Hyper-Parameter Optimization
A Convolutional Neural Network for Modelling Sentences
Recurrent neural network based language model
Practical Recommendations for Gradient-Based Training of Deep Architectures
  • Yoshua Bengio
  • Computer Science
  • Neural Networks: Tricks of the Trade
  • 2012
Sequential Short-Text Classification with Recurrent and Convolutional Neural Networks
Recurrent Neural Networks for Word Alignment Model
Natural Language Processing (Almost) from Scratch
Convolutional Neural Networks for Sentence Classification
...
1
2
3
4
...