Corpus ID: 227275587

TinyTL: Reduce Memory, Not Parameters for Efficient On-Device Learning

@inproceedings{Cai2020TinyTLRM,
  title={TinyTL: Reduce Memory, Not Parameters for Efficient On-Device Learning},
  author={H. Cai and Chuang Gan and Ligeng Zhu and Song Han},
  booktitle={NeurIPS},
  year={2020}
}

H. Cai, Chuang Gan, +1 author Song Han

Published in NeurIPS 2020

Computer Science

On-device learning enables edge devices to continually adapt the AI models to new data, which requires a small memory footprint to fit the tight memory constraint of edge devices. Existing work solves this problem by reducing the number of trainable parameters. However, this doesn't directly translate to memory saving since the major bottleneck is the activations, not parameters. In this work, we present Tiny-Transfer-Learning (TinyTL) for memory-efficient on-device learning. TinyTL freezes the… CONTINUE READING

View PDF on arXiv

Save to Library

Create Alert

Cite

Launch Research Feed