Deep Residual Learning for Image Recognition

@article{He2016DeepRL,
  title={Deep Residual Learning for Image Recognition},
  author={Kaiming He and X. Zhang and Shaoqing Ren and Jian Sun},
  journal={2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
  year={2016},
  pages={770-778}
}
  • Kaiming He, X. Zhang, +1 author Jian Sun
  • Published 2016
  • Computer Science
  • 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • Deeper neural networks are more difficult to train. We present a residual learning framework to ease the training of networks that are substantially deeper than those used previously. We explicitly reformulate the layers as learning residual functions with reference to the layer inputs, instead of learning unreferenced functions. We provide comprehensive empirical evidence showing that these residual networks are easier to optimize, and can gain accuracy from considerably increased depth. On… CONTINUE READING
    59,902 Citations
    Study of Residual Networks for Image Recognition
    • 15
    • Highly Influenced
    • PDF
    Shallow Learning For Deep Networks
    • 2
    • Highly Influenced
    Hyperparameter Optimization for Deep Residual Learning in Image Classification
    • Abbas Jafar, Myungho Lee
    • Computer Science
    • 2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems Companion (ACSOS-C)
    • 2020
    • Highly Influenced
    On the importance of network architecture in training very deep neural networks
    • 3
    Deep Residual Networks with Exponential Linear Unit
    • 62
    • Highly Influenced
    • PDF
    Convolutional Recurrent Neural Networks for Better Image Understanding
    • A. Vallet, H. Sakamoto
    • Computer Science
    • 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA)
    • 2016
    • 3
    Weighted residuals for very deep networks
    • Falong Shen, Gang Zeng
    • Computer Science
    • 2016 3rd International Conference on Systems and Informatics (ICSAI)
    • 2016
    • 18
    • Highly Influenced
    • PDF
    Improved Residual Networks for Image and Video Recognition
    • 5
    • Highly Influenced
    • PDF
    Greedy Layerwise Learning Can Scale to ImageNet
    • 45
    • Highly Influenced
    • PDF
    Energy-Efficient and Improved Image Recognition with Conditional Deep Learning
    • 13

    References

    SHOWING 1-10 OF 61 REFERENCES
    Very Deep Convolutional Networks for Large-Scale Image Recognition
    • 44,818
    • Highly Influential
    • PDF
    Deeply-Supervised Nets
    • 1,154
    • PDF
    ImageNet classification with deep convolutional neural networks
    • 59,529
    • Highly Influential
    • PDF
    Understanding the difficulty of training deep feedforward neural networks
    • 9,428
    • PDF
    Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
    • 9,071
    • PDF
    Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
    • 21,338
    • Highly Influential
    • PDF
    Network In Network
    • 3,276
    • PDF
    Learning Multiple Layers of Features from Tiny Images
    • 10,450
    • PDF
    Deep Learning Made Easier by Linear Transformations in Perceptrons
    • 163
    • PDF