• Corpus ID: 246035994

Continual Learning for CTR Prediction: A Hybrid Approach

  title={Continual Learning for CTR Prediction: A Hybrid Approach},
  author={Ke Hu and Yi Qi and Jianqiang Huang and Jia Cheng and Jun Lei},
Click-through rate(CTR) prediction is a core task in cost-perclick(CPC) advertising systems and has been studied extensively by machine learning practitioners. While many existing methods have been successfully deployed in practice, most of them are built upon i.i.d.(independent and identically distributed) assumption, ignoring that the click data used for training and inference is collected through time and is intrinsically non-stationary and drifting. This mismatch will inevitably lead to sub… 
ReLoop: A Self-Correction Continual Learning Loop for Recommender Systems
This paper attempts to build a self-correction learning loop (dubbed ReLoop) for recommender systems that enables a continual self-Correction process in the long run and thus is expected to obtain better performance over existing training strategies.


Ad click prediction: a view from the trenches
The goal of this paper is to highlight the close relationship between theoretical advances and practical engineering in this industrial setting, and to show the depth of challenges that appear when applying traditional machine learning methods in a complex dynamic system.
Online Continual Learning with Maximally Interfered Retrieval
This work considers a controlled sampling of memories for replay, and shows a formulation for this sampling criterion in both the generative replay and the experience replay setting, producing consistent gains in performance and greatly reduced forgetting.
Deep Interest Network for Click-Through Rate Prediction
A novel model: Deep Interest Network (DIN) is proposed which tackles this challenge by designing a local activation unit to adaptively learn the representation of user interests from historical behaviors with respect to a certain ad.
Learning to Learn without Forgetting By Maximizing Transfer and Minimizing Interference
This work proposes a new conceptualization of the continual learning problem in terms of a temporally symmetric trade-off between transfer and interference that can be optimized by enforcing gradient alignment across examples, and introduces a new algorithm, Meta-Experience Replay, that directly exploits this view by combining experience replay with optimization based meta-learning.
ADER: Adaptively Distilled Exemplar Replay Towards Continual Learning for Session-based Recommendation
ADER is a promising solution to mitigate the catastrophic forgetting issue towards building more realistic and scalable session-based recommenders and consistently outperforms other baselines, and it even outperforms the method using all historical data at every update cycle.
Experience Replay for Continual Learning
This work shows that using experience replay buffers for all past events with a mixture of on- and off-policy learning can still learn new tasks quickly yet can substantially reduce catastrophic forgetting in both Atari and DMLab domains, even matching the performance of methods that require task identities.
Deep Session Interest Network for Click-Through Rate Prediction
A novel CTR model named Deep Session Interest Network (DSIN) is proposed that leverages users' multiple historical sessions in their behavior sequences and outperforms other state-of-the-art models on both datasets.
Practical Lessons from Predicting Clicks on Ads at Facebook
This paper introduces a model which combines decision trees with logistic regression, outperforming either of these methods on its own by over 3%, an improvement with significant impact to the overall system performance.
DeepFM: A Factorization-Machine based Neural Network for CTR Prediction
This paper shows that it is possible to derive an end-to-end learning model that emphasizes both low- and high-order feature interactions, and combines the power of factorization machines for recommendation and deep learning for feature learning in a new neural network architecture.
Selective Experience Replay for Lifelong Learning
Overall, the results show that selective experience replay, when suitable selection algorithms are employed, can prevent catastrophic forgetting and is consistently the best approach on all domains tested.