Corpus ID: 188266673

Recovering the Lowest Layer of Deep Networks with High Threshold Activations

@article{Goel2018RecoveringTL,
  title={Recovering the Lowest Layer of Deep Networks with High Threshold Activations},
  author={Surbhi Goel and Rina Panigrahy},
  journal={arXiv: Learning},
  year={2018}
}
  • Surbhi Goel, Rina Panigrahy
  • Published 2018
  • Mathematics, Computer Science
  • arXiv: Learning
  • Giving provable guarantees for learning neural networks is a core challenge of machine learning theory. Most prior work gives parameter recovery guarantees for one hidden layer networks, however, the networks used in practice have multiple non-linear layers. In this work, we show how we can strengthen such results to deeper networks -- we address the problem of uncovering the lowest layer in a deep neural network under the assumption that the lowest layer uses a high threshold before applying… CONTINUE READING