Retrieval & Interaction Machine for Tabular Data Prediction

  title={Retrieval \& Interaction Machine for Tabular Data Prediction},
  author={Jiarui Qin and Weinan Zhang and Rong Su and Zhirong Liu and Weiwen Liu and Ruiming Tang and Xiuqiang He and Yong Yu},
  journal={Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery \& Data Mining},
  • Jiarui Qin, Weinan Zhang, +5 authors Yong Yu
  • Published 2021
  • Computer Science
  • Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining
Prediction over tabular data is an essential task in many data science applications such as recommender systems, online advertising, medical treatment, etc. Tabular data is structured into rows and columns, with each row as a data sample and each column as a feature attribute. Both the columns and rows of the tabular data carry useful patterns that could improve the model prediction performance. However, most existing models focus on the cross-column patterns yet overlook the cross-rowpatterns… Expand
Deep Learning for Click-Through Rate Estimation
This survey provides a comprehensive review of deep learning models for CTR estimation tasks and takes a review of the transfer from shallow to deep CTR models and explains why going deep is a necessary trend of development. Expand


Product-Based Neural Networks for User Response Prediction
  • Yanru Qu, Han Cai, +4 authors J. Wang
  • Computer Science, Mathematics
  • 2016 IEEE 16th International Conference on Data Mining (ICDM)
  • 2016
A Product-based Neural Networks (PNN) with an embedding layer to learn a distributed representation of the categorical data, a product layer to capture interactive patterns between interfield categories, and further fully connected layers to explore high-order feature interactions. Expand
Product-Based Neural Networks for User Response Prediction over Multi-Field Categorical Data
This article discusses an insensitive gradient issue in DNN-based models and proposes Product-based Neural Network, which adopts a feature extractor to explore feature interactions and Generalizing the kernel product to a net-in-net architecture, which can generalize previous models. Expand
Deep Learning over Multi-field Categorical Data - - A Case Study on User Response Prediction
This paper proposes two novel models using deep neural networks (DNNs) to automatically learn effective patterns from categorical feature interactions and make predictions of users' ad clicks and demonstrates that their methods work better than major state-of-the-art models. Expand
Neural Factorization Machines for Sparse Predictive Analytics
NFM seamlessly combines the linearity of FM in modelling second- order feature interactions and the non-linearity of neural network in modelling higher-order feature interactions, and is more expressive than FM since FM can be seen as a special case of NFM without hidden layers. Expand
xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems
A novel Compressed Interaction Network (CIN), which aims to generate feature interactions in an explicit fashion and at the vector-wise level and is named eXtreme Deep Factorization Machine (xDeepFM), which is able to learn certain bounded-degree feature interactions explicitly and can learn arbitrary low- and high-order feature interactions implicitly. Expand
DeepFM: A Factorization-Machine based Neural Network for CTR Prediction
This paper shows that it is possible to derive an end-to-end learning model that emphasizes both low- and high-order feature interactions, and combines the power of factorization machines for recommendation and deep learning for feature learning in a new neural network architecture. Expand
Field-aware Factorization Machines for CTR Prediction
This paper establishes FFMs as an effective method for classifying large sparse data including those from CTR prediction, and proposes efficient implementations for training FFMs and comprehensively analyze FFMs. Expand
Wide & Deep Learning for Recommender Systems
Wide & Deep learning is presented---jointly trained wide linear models and deep neural networks---to combine the benefits of memorization and generalization for recommender systems and is open-sourced in TensorFlow. Expand
Latent Cross: Making Use of Context in Recurrent Recommender Systems
This paper offers "Latent Cross," an easy-to-use technique to incorporate contextual data in the RNN by embedding the context feature first and then performing an element-wise product of the context embedding with model's hidden states. Expand
User Behavior Retrieval for Click-Through Rate Prediction
In UBR4CTR, the most relevant and appropriate user behaviors will be firstly retrieved from the entire user history sequence using a learnable search method and fed into a deep model to make the final prediction instead of simply using the most recent ones. Expand