Deep Learning
@article{Goodfellow2015DeepL, title={Deep Learning}, author={Ian J. Goodfellow and Yoshua Bengio and Aaron C. Courville}, journal={Nature}, year={2015}, volume={521}, pages={436-444} }
Machine-learning technology powers many aspects of modern society: from web searches to content filtering on social networks to recommendations on e-commerce websites, and it is increasingly present in consumer products such as cameras and smartphones. [] Key Method Representation learning is a set of methods that allows a machine to be fed with raw data and to automatically discover the representations needed for detection or classification.
28,802 Citations
Neural Networks for Survey Researchers
- Computer Science
- 2018
This article describes what neural networks are and how they learn, considers their strengths and weaknesses as a machine learning approach, and illustrates how they perform on a classification task predicting survey response from respondents’ (and nonrespondents’) prior known demographics.
Deep Learning: A Primer for Radiologists.
- Computer ScienceRadiographics : a review publication of the Radiological Society of North America, Inc
- 2017
The key concepts of deep learning for clinical radiologists are reviewed, technical requirements are discussed, emerging applications in clinical radiology are described, and limitations and future directions in this field are outlined.
Deep learning: a branch of machine learning
- Computer ScienceJournal of Physics: Conference Series
- 2019
A broad writing survey is completed and the utilization of deep learning in different fields is reviewed and how and in what real applications deep learning algorithms have been used are shown.
A Review of Deep Learning Algorithms and Their Applications in Healthcare
- Computer ScienceAlgorithms
- 2022
A review and a checkpoint to systemize the popular algorithms of deep learning and to encourage further innovation regarding their applications and to introduce detailed information on how to apply several deep learning algorithms in healthcare, such as in relation to the COVID-19 pandemic.
A Detailed Survey on Deep Learning Techniques for Real-Time Image Classification, Recognition and Analysis
- Computer ScienceExpert Clouds and Applications
- 2021
This paper is going to address deep learning techniques such as single-shot detector (SSD), scale-invariant feature transform (sfit), histogram of oriented gradient (HOG) and many more to detect cybercrimes through the assistance of the above-mentioned techniques.
Tricks from Deep Learning
- Computer ScienceArXiv
- 2016
A way to dramatically reduce the size of the tape when performing reverse-mode AD on a (theoretically) time-reversible process like an ODE integrator; and a new mathematical insight that allows for the implementation of a stochastic Newton's method are discussed.
Convolutional neural network and its pretrained models for image classification and object detection: A survey
- Computer ScienceConcurr. Comput. Pract. Exp.
- 2022
This paper presents detailed and analytical literature starting from the very elementary level to the recent trends of this trending technology while focusing on the most used DL model, that is, convolutional neural network and its pretrained models for image classification and object detection.
Recent advances in deep learning
- Computer ScienceInt. J. Mach. Learn. Cybern.
- 2020
Focusing on recent developments in DL architectures and their applications, the articles in this issue are classified into four categories: (1) deep architectures and conventional neural networks, (2) incremental learning, (3) recurrent neural Networks, and (4) generative models and adversarial examples.
Deep learning in the automotive industry: Applications and tools
- Computer Science2016 IEEE International Conference on Big Data (Big Data)
- 2016
An end-to-end deep learning application utilizing a mobile app for data collection and process support, and an Amazon-based cloud backend for storage and training, and the effectiveness of the trained classifier in a real world setting during manufacturing process is demonstrated.
References
SHOWING 1-10 OF 938 REFERENCES
An Analysis of Single-Layer Networks in Unsupervised Feature Learning
- Computer ScienceAISTATS
- 2011
The results show that large numbers of hidden nodes and dense feature extraction are critical to achieving high performance—so critical, in fact, that when these parameters are pushed to their limits, they achieve state-of-the-art performance on both CIFAR-10 and NORB using only a single layer of features.
Machine learning - a probabilistic perspective
- Computer ScienceAdaptive computation and machine learning series
- 2012
This textbook offers a comprehensive and self-contained introduction to the field of machine learning, based on a unified, probabilistic approach, and is suitable for upper-level undergraduates with an introductory-level college math background and beginning graduate students.
Measuring Invariances in Deep Networks
- Computer ScienceNIPS
- 2009
A number of empirical tests are proposed that directly measure the degree to which these learned features are invariant to different input transformations and find that stacked autoencoders learn modestly increasingly invariant features with depth when trained on natural images and convolutional deep belief networks learn substantially more invariant Features in each layer.
Zero-Shot Learning Through Cross-Modal Transfer
- Computer ScienceNIPS
- 2013
This work introduces a model that can recognize objects in images even if no training data is available for the object class, and uses novelty detection methods to differentiate unseen classes from seen classes.
Beyond simple features: A large-scale feature search approach to unconstrained face recognition
- Computer ScienceFace and Gesture 2011
- 2011
This work demonstrates a large-scale feature search approach to generating new, more powerful feature representations in which a multitude of complex, nonlinear, multilayer neuromorphic feature representations are randomly generated and screened to find those best suited for the task at hand.
Reading Digits in Natural Images with Unsupervised Feature Learning
- Computer Science
- 2011
A new benchmark dataset for research use is introduced containing over 600,000 labeled digits cropped from Street View images, and variants of two recently proposed unsupervised feature learning methods are employed, finding that they are convincingly superior on benchmarks.
Convolutional networks and applications in vision
- Computer ScienceProceedings of 2010 IEEE International Symposium on Circuits and Systems
- 2010
New unsupervised learning algorithms, and new non-linear stages that allow ConvNets to be trained with very few labeled samples are described, including one for visual object recognition and vision navigation for off-road mobile robots.
Project Adam: Building an Efficient and Scalable Deep Learning Training System
- Computer ScienceOSDI
- 2014
The design and implementation of a distributed system called Adam comprised of commodity server machines to train large deep neural network models that exhibits world-class performance, scaling and task accuracy on visual recognition tasks and shows that task accuracy improves with larger models.
Learning and Selecting Features Jointly with Point-wise Gated Boltzmann Machines
- Computer ScienceICML
- 2013
A point-wise gated Boltzmann machine is proposed, a unified generative model that combines feature learning and feature selection that achieves improved performance over state-of-the-art in several visual recognition benchmarks.
Sequence to Sequence Learning with Neural Networks
- Computer ScienceNIPS
- 2014
This paper presents a general end-to-end approach to sequence learning that makes minimal assumptions on the sequence structure, and finds that reversing the order of the words in all source sentences improved the LSTM's performance markedly, because doing so introduced many short term dependencies between the source and the target sentence which made the optimization problem easier.