Corpus ID: 51970765

Fast, Better Training Trick - Random Gradient

@article{Wei2018FastBT,
  title={Fast, Better Training Trick - Random Gradient},
  author={Jiakai Wei},
  journal={ArXiv},
  year={2018},
  volume={abs/1808.04293}
}

Jiakai Wei

Published 2018

Mathematics, Computer Science

ArXiv

In this paper, we will show an unprecedented method to accelerate training and improve performance, which called random gradient (RG). This method can be easier to the training of any model without extra calculation cost, we use Image classification, Semantic segmentation, and GANs to confirm this method can improve speed which is training model in computer vision. The central idea is using the loss multiplied by a random number to random reduce the back-propagation gradient. We can use this… CONTINUE READING

View PDF on arXiv

Save to Library

Create Alert

Cite

Launch Research Feed