AMEIR: Automatic Behavior Modeling, Interaction Exploration and MLP Investigation in the Recommender System

@inproceedings{Zhao2021AMEIRAB,
  title={AMEIR: Automatic Behavior Modeling, Interaction Exploration and MLP Investigation in the Recommender System},
  author={Pengyu Zhao and Kecheng Xiao and Yuanxing Zhang and Kaigui Bian and Wei Yan},
  booktitle={IJCAI},
  year={2021}
}
Recently, deep learning models have been widely explored in recommender systems. Though having achieved remarkable success, the design of task-aware recommendation models usually requires manual feature engineering and architecture engineering from domain experts. To relieve those efforts, we explore the potential of neural architecture search (NAS) and introduce AMEIR for Automatic behavior Modeling, interaction Exploration and multi-layer perceptron (MLP) Investigation in the Recommender… 

Figures and Tables from this paper

AutoML for Deep Recommender Systems: A Survey
TLDR
A taxonomy as a classification framework containing embedding dimension search, feature interaction search, model design search and other components search is presented, which puts a particular emphasis on the search space and search strategy.
AutoFAS: Automatic Feature and Architecture Selection for Pre-Ranking System
TLDR
A novel framework AutoFAS is proposed which jointly optimizes the efficiency and effectiveness of the pre-ranking model and consistently outperforms the previous state-of-the-art (SOTA) approaches at a lower computing cost.
Click-through rate prediction in online advertising: A literature review
Automated Machine Learning for Deep Recommender Systems: A Survey
TLDR
An overview of AutoML for DRS models and the related techniques is provided, including the state-of-the-art AutoML approaches that automate the feature selection, feature embeddings, feature interactions, and system design in DRS.

References

SHOWING 1-10 OF 35 REFERENCES
Towards Automated Neural Interaction Discovery for Click-Through Rate Prediction
TLDR
This work proposes an automated interaction architecture discovering framework for CTR prediction named AutoCTR, which performs evolutionary architecture exploration with learning-to-rank guidance at the architecture level and achieves acceleration using low-fidelity model.
AutoFIS: Automatic Feature Interaction Selection in Factorization Models for Click-Through Rate Prediction
TLDR
This work proposes a two-stage algorithm called Automatic Feature Interaction Selection (AutoFIS), which can automatically identify important feature interactions for factorization models with computational cost just equivalent to training the target model to convergence.
Deep Session Interest Network for Click-Through Rate Prediction
TLDR
A novel CTR model named Deep Session Interest Network (DSIN) is proposed that leverages users' multiple historical sessions in their behavior sequences and outperforms other state-of-the-art models on both datasets.
DeepFM: A Factorization-Machine based Neural Network for CTR Prediction
TLDR
This paper shows that it is possible to derive an end-to-end learning model that emphasizes both low- and high-order feature interactions, and combines the power of factorization machines for recommendation and deep learning for feature learning in a new neural network architecture.
Neural Attentive Session-based Recommendation
TLDR
A novel neural networks framework, i.e., Neural Attentive Recommendation Machine (NARM), is proposed to tackle session-based recommendation, which outperforms state-of-the-art baselines on both datasets and achieves a significant improvement on long sessions.
xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems
TLDR
A novel Compressed Interaction Network (CIN), which aims to generate feature interactions in an explicit fashion and at the vector-wise level and is named eXtreme Deep Factorization Machine (xDeepFM), which is able to learn certain bounded-degree feature interactions explicitly and can learn arbitrary low- and high-order feature interactions implicitly.
Self-Attentive Sequential Recommendation
TLDR
Extensive empirical studies show that the proposed self-attention based sequential model (SASRec) outperforms various state-of-the-art sequential models (including MC/CNN/RNN-based approaches) on both sparse and dense datasets.
Wide & Deep Learning for Recommender Systems
TLDR
Wide & Deep learning is presented---jointly trained wide linear models and deep neural networks---to combine the benefits of memorization and generalization for recommender systems and is open-sourced in TensorFlow.
BPR: Bayesian Personalized Ranking from Implicit Feedback
TLDR
This paper presents a generic optimization criterion BPR-Opt for personalized ranking that is the maximum posterior estimator derived from a Bayesian analysis of the problem and provides a generic learning algorithm for optimizing models with respect to B PR-Opt.
A Simple Convolutional Generative Network for Next Item Recommendation
TLDR
A simple, but very effective generative model that is capable of learning high-level representation from both short- and long-range item dependencies is introduced that attains state-of-the-art accuracy with less training time in the next item recommendation task.
...
...