Deep Super Learner: A Deep Ensemble for Classification Problems

@article{Young2018DeepSL,
  title={Deep Super Learner: A Deep Ensemble for Classification Problems},
  author={Steven Young and Tamer Abdou and Ayse Basar Bener},
  journal={ArXiv},
  year={2018},
  volume={abs/1803.02323}
}
Deep learning has become very popular for tasks such as predictive modeling and pattern recognition in handling big data. [...] Key Result Experimental results show that the deep super learner has superior performance compared to the individual base learners, single-layer ensembles, and in some cases deep neural networks. Performance of the deep super learner may further be improved with task-specific tuning.Expand
Snapshot boosting: a fast ensemble framework for deep neural networks
TLDR
The results show that snapshot boosting can get a more balanced trade-off between training expenses and ensemble accuracy than other well-known ensemble methods. Expand
An automated ensemble learning framework using genetic programming for image classification
TLDR
This study is the first work using GP to automatically generate ensembles for image classification using a novel program structure, new function set and a new terminal set developed in EGP. Expand
Evolving Deep Forest with Automatic Feature Extraction for Image Classification Using Genetic Programming
TLDR
This study proposes a genetic programming-based approach to automatically and simultaneously evolving effective structures of deep forest connections and extracting informative features for image classification by defining two types of modules: forest modules and feature extraction modules. Expand
Genetic Programming With a New Representation to Automatically Learn Features and Evolve Ensembles for Image Classification
TLDR
An evolutionary approach based on genetic programming to automatically and simultaneously learn informative features and evolve effective ensembles for image classification is proposed and achieves better classification accuracy on most datasets than the competitive methods. Expand
Learning and Sharing: A Multitask Genetic Programming Approach to Image Feature Learning
TLDR
A new knowledge sharing mechanism based on a new individual representation is developed to allow GP to automatically learn what to share across two tasks and to improve its learning performance. Expand
Learning to Share: A Multitasking Genetic Programming Approach to Image Feature Learning
TLDR
A multitasking GP approach to image feature learning for classification with limited training data that outperforms compared methods in almost all the comparisons and learns simple yet effective common trees with high effectiveness and transferability. Expand
A Divide-and-Conquer Genetic Programming Algorithm with Ensembles for Image Classification
  • Ying Bi, Bing Xue, Mengjie Zhang
  • Computer Science
  • 2021
TLDR
A divide-and-conquer GP algorithm with knowledge transfer and ensembles to achieve fast feature learning in image classification and achieves better classification performance in significantly less computation time than the baseline GP-based algorithm. Expand
Online Feature Selection (OFS) with Accelerated Bat Algorithm (ABA) and Ensemble Incremental Deep Multiple Layer Perceptron (EIDMLP) for big data streams
TLDR
In this research work, MR-OFS-ABA method has shown enhanced performance than the existing feature selection methods namely PSO, APSO and ASAMO (Accelerated Simulated Annealing and Mutation Operator). Expand
Chimera: A Multi-Task Recurrent Convolutional Neural Network for Forest Classification and Structural Estimation
TLDR
A new model is presented, based on a deep learning architecture, that performs both classification and regression concurrently, thereby consolidating what was previously several independent tasks and models into one stream and could provide continuous, annual estimates of forest structure for other forested landscapes at regional or national scales. Expand
Genetic Programming With Image-Related Operators and a Flexible Program Structure for Feature Learning in Image Classification
TLDR
This article proposes a new GP-based approach to automatically learning informative features for different image classification tasks and shows that the new approach achieves better classification performance than most benchmark methods. Expand
...
1
2
3
...

References

SHOWING 1-10 OF 17 REFERENCES
Deep Forest: Towards An Alternative to Deep Neural Networks
In this paper, we propose gcForest, a decision tree ensemble approach with performance highly competitive to deep neural networks in a broad range of tasks. In contrast to deep neural networks whichExpand
Learning Deep Architectures for AI
TLDR
The motivations and principles regarding learning algorithms for deep architectures, in particular those exploiting as building blocks unsupervised learning of single-layer modelssuch as Restricted Boltzmann Machines, used to construct deeper models such as Deep Belief Networks are discussed. Expand
Representation Learning: A Review and New Perspectives
TLDR
Recent work in the area of unsupervised feature learning and deep learning is reviewed, covering advances in probabilistic models, autoencoders, manifold learning, and deep networks. Expand
Ensemble Methods in Data Mining: Improving Accuracy Through Combining Predictions
TLDR
IS reveals classic ensemble methods -- bagging, random forests, and boosting -- to be special cases of a single algorithm, thereby showing how to improve their accuracy and speed, and explains the paradox of how ensembles achieve greater accuracy on new data despite their (apparently much greater) complexity. Expand
Ensemble Methods: Foundations and Algorithms
An up-to-date, self-contained introduction to a state-of-the-art machine learning approach, Ensemble Methods: Foundations and Algorithms shows how these accurate methods are used in real-world tasks.Expand
Multi-column deep neural networks for image classification
TLDR
On the very competitive MNIST handwriting benchmark, this method is the first to achieve near-human performance and improves the state-of-the-art on a plethora of common image classification benchmarks. Expand
Super Learner
TLDR
A fast algorithm for constructing a super learner in prediction which uses V-fold cross-validation to select weights to combine an initial set of candidate learners. Expand
Gradient-based learning applied to document recognition
TLDR
This paper reviews various methods applied to handwritten character recognition and compares them on a standard handwritten digit recognition task, and Convolutional neural networks are shown to outperform all other techniques. Expand
XGBoost: A Scalable Tree Boosting System
TLDR
This paper proposes a novel sparsity-aware algorithm for sparse data and weighted quantile sketch for approximate tree learning and provides insights on cache access patterns, data compression and sharding to build a scalable tree boosting system called XGBoost. Expand
Opening the Black Box: Low-Dimensional Dynamics in High-Dimensional Recurrent Neural Networks
TLDR
The hypothesis that fixed points, both stable and unstable, and the linearized dynamics around them, can reveal crucial aspects of how RNNs implement their computations is explored. Expand
...
1
2
...