iTAML: An Incremental Task-Agnostic Meta-learning Approach
@article{Rajasegaran2020iTAMLAI, title={iTAML: An Incremental Task-Agnostic Meta-learning Approach}, author={Jathushan Rajasegaran and Salman Khan and Munawar Hayat and F. Khan and M. Shah}, journal={2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, year={2020}, pages={13585-13594} }
Humans can continuously learn new knowledge as their experience grows. In contrast, previous learning in deep neural networks can quickly fade out when they are trained on a new task. In this paper, we hypothesize this problem can be avoided by learning a set of generalized parameters, that are neither specific to old nor new tasks. In this pursuit, we introduce a novel meta-learning approach that seeks to maintain an equilibrium between all the encountered tasks. This is ensured by a new meta… Expand
Supplemental Code
Github Repo
Via Papers with Code
Official implementation of "iTAML : An Incremental Task-Agnostic Meta-learning Approach". CVPR 2020
Figures, Tables, and Topics from this paper
18 Citations
GDumb: A Simple Approach that Questions Our Progress in Continual Learning
- Computer Science
- ECCV
- 2020
- 23
- PDF
Meta-Learned Attribute Self-Gating for Continual Generalized Zero-Shot Learning
- Computer Science, Mathematics
- ArXiv
- 2021
- 1
- Highly Influenced
- PDF
Efficient Feature Transformations for Discriminative and Generative Continual Learning
- Computer Science
- ArXiv
- 2021
- PDF
Few-Shot Unsupervised Continual Learning through Meta-Examples
- Computer Science, Mathematics
- ArXiv
- 2020
- 2
- PDF
Do Not Forget to Attend to Uncertainty while Mitigating Catastrophic Forgetting
- Computer Science
- ArXiv
- 2021
- PDF
Multilayer Neuromodulated Architectures for Memory-Constrained Online Continual Learning
- Computer Science
- ArXiv
- 2020
- PDF
References
SHOWING 1-10 OF 36 REFERENCES
Task Agnostic Meta-Learning for Few-Shot Learning
- Computer Science, Mathematics
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- 2019
- 84
- PDF
Meta-Learning Representations for Continual Learning
- Computer Science, Mathematics
- NeurIPS
- 2019
- 70
- Highly Influential
- PDF
Class-incremental Learning via Deep Model Consolidation
- Computer Science
- 2020 IEEE Winter Conference on Applications of Computer Vision (WACV)
- 2020
- 52
- PDF
Learning without Forgetting
- Computer Science, Mathematics
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- 2018
- 938
- PDF
Generative replay with feedback connections as a general strategy for continual learning
- Computer Science, Mathematics
- ArXiv
- 2018
- 87
- PDF
Overcoming catastrophic forgetting in neural networks
- Computer Science, Mathematics
- Proceedings of the National Academy of Sciences
- 2017
- 1,597
- Highly Influential
- PDF