Domain Adaptation and Transfer Learning in StochasticNets

Abstract

Transfer learning is a recent field of machine learning research that aims to resolve the challenge of dealing with insufficient training data in the domain of interest. This is a particular issue with traditional deep neural networks where a large amount of training data is needed. Recently, StochasticNets was proposed to take advantage of sparse connectivity in order to decrease the number of parameters that needs to be learned, which in turn may relax training data size requirements. In this paper, we study the efficacy of transfer learning on StochasticNet frameworks. Experimental results show ∼7% improvement on StochasticNet performance when the transfer learning is applied in training step.

DOI: 10.15353/vsnl.v1i1.44

Extracted Key Phrases

1 Figure or Table

Cite this paper

@article{Shafiee2015DomainAA, title={Domain Adaptation and Transfer Learning in StochasticNets}, author={Mohammad Javad Shafiee and Parthipan Siva and Paul W. Fieguth and Alexander Wong}, journal={CoRR}, year={2015}, volume={abs/1512.05844} }