Corpus ID: 221113156

Mish: A Self Regularized Non-Monotonic Activation Function

@inproceedings{Misra2020MishAS,
  title={Mish: A Self Regularized Non-Monotonic Activation Function},
  author={Diganta Misra},
  booktitle={BMVC},
  year={2020}
}

Diganta Misra

Published in BMVC 2020

Computer Science, Mathematics

We propose Mish, a novel self-regularized non-monotonic activation function which can be mathematically defined as: f (x) = x tanh(so f t plus(x)). As activation functions play a crucial role in the performance and training dynamics in neural networks, we validated experimentally on several well-known benchmarks against the best combinations of architectures and activation functions. We also observe that data augmentation techniques have a favorable effect on benchmarks like ImageNet-1k and MS… CONTINUE READING

View PDF on arXiv

Save to Library

Create Alert

Cite

Launch Research Feed