Recommendation as a Communication Game: Self-Supervised Bot-Play for Goal-oriented Dialogue

@inproceedings{Kang2019RecommendationAA,
  title={Recommendation as a Communication Game: Self-Supervised Bot-Play for Goal-oriented Dialogue},
  author={Dongyeop Kang and Anusha Balakrishnan and Pararth Shah and Paul A. Crook and Y-Lan Boureau and J. Weston},
  booktitle={EMNLP/IJCNLP},
  year={2019}
}
Traditional recommendation systems produce static rather than interactive recommendations invariant to a user’s specific requests, clarifications, or current mood, and can suffer from the cold-start problem if their tastes are unknown. These issues can be alleviated by treating recommendation as an interactive dialogue task instead, where an expert recommender can sequentially ask about someone’s preferences, react to their requests, and recommend more appropriate items. In this work, we… Expand
Towards Conversational Recommendation over Multi-Type Dialogs
TLDR
This work creates a human-to-human Chinese dialog dataset DuRecDial, where there are multiple sequential dialogs for a pair of a recommendation seeker and a recommender, where the recommender proactively leads a multi-type dialog to approach recommendation targets and then makes multiple recommendations with rich interaction behavior. Expand
Bridging the Gap between Conversational Reasoning and Interactive Recommendation
TLDR
A novel recommender dialog model that walks on a large-scale knowledge graph to form a reasoning tree at each turn, then mapped to dialog acts to guide response generation and maximizes the mutual benefit between two systems. Expand
INSPIRED: Toward Sociable Recommendation Dialog Systems
TLDR
This work designs an annotation scheme related to recommendation strategies based on social science theories and annotate these dialogs, and shows that sociable recommendation strategies, such as sharing personal opinions or communicating with encouragement, more frequently lead to successful recommendations. Expand
GoChat: Goal-oriented Chatbots with Hierarchical Reinforcement Learning
TLDR
GoChat proposes Goal-oriented Chatbots (GoChat), a framework for end-to-end training the chatbot to maximize the long-term return from offline multi-turn dialogue datasets, which outperforms previous methods on both the quality of response generation as well as the success rate of accomplishing the goal. Expand
A Survey on Conversational Recommender Systems
TLDR
A detailed survey of existing approaches to conversational recommendation is provided, categorizing these approaches in various dimensions, e.g., in terms of the supported user intents or the knowledge they use in the background. Expand
RevCore: Review-Augmented Conversational Recommendation
  • Yu Lu, Junwei Bao, +4 authors Xiaodong He
  • Computer Science
  • FINDINGS
  • 2021
TLDR
This paper designs a novel end-to-end framework, namely, Review-augmented Conversational Recommender (RevCore), where reviews are seamlessly incorporated to enrich item information and assist in generating both coherent and informative responses. Expand
End-to-End Learning for Conversational Recommendation: A Long Way to Go?
TLDR
Analysis of utterances generated by two recent end-to-end learning approaches for Conversational Recommender Systems shows that current approaches that are published at high-quality research outlets may have severe limitations regarding their usability in practice and academic evaluation approaches for CRS should be reconsidered. Expand
User Memory Reasoning for Conversational Recommendation
TLDR
A simple yet expandable formulation for constructing and updating the Memory Graph, and an end-to-end graph-based reasoning model that updates MG from unstructured utterances and predicts optimal dialog policies (eg recommendation) based on updated MG are proposed. Expand
CR-Walker: Tree-Structured Graph Reasoning and Dialog Acts for Conversational Recommendation
Growing interests have been attracted in Conversational Recommender Systems (CRS), which explore user preference through conversational interactions in order to make appropriate recommendation.Expand
Towards Retrieval-based Conversational Recommendation
Conversational recommender systems have attracted immense attention recently. The most recent approaches rely on neural models trained on recorded dialogs between humans, implementing an end-to-endExpand
...
1
2
3
...

References

SHOWING 1-10 OF 31 REFERENCES
Towards Deep Conversational Recommendations
TLDR
This paper collects ReDial, a data set consisting of over 10,000 conversations centered around the theme of providing movie recommendations and uses this dataset to explore new neural architectures, mechanisms and methods suitable for composing conversational recommendation systems. Expand
Deal or No Deal? End-to-End Learning of Negotiation Dialogues
TLDR
For the first time, it is shown it is possible to train end-to-end models for negotiation, which must learn both linguistic and reasoning skills with no annotated dialogue states, and this technique dramatically improves performance. Expand
Learning End-to-End Goal-Oriented Dialog
TLDR
It is shown that an end-to-end dialog system based on Memory Networks can reach promising, yet imperfect, performance and learn to perform non-trivial operations and be compared to a hand-crafted slot-filling baseline on data from the second Dialog State Tracking Challenge. Expand
Decoupling Strategy and Generation in Negotiation Dialogues
TLDR
A modular approach based on coarse dialogue acts (e.g., propose(price=50)) that decouples strategy and generation that can flexibly set the strategy using supervised learning, reinforcement learning, or domain-specific knowledge without degeneracy is proposed. Expand
Modeling a Dialogue Strategy for Personalized Movie Recommendations
This paper addresses conversational interaction in user-adaptive recommender systems. By collecting and analyzing a movie recommendation dialogue corpus, two initiative types that need to beExpand
Learning Symmetric Collaborative Dialogue Agents with Dynamic Knowledge Graph Embeddings
TLDR
A neural model with dynamic knowledge graph embeddings that evolve as the dialogue progresses is proposed, which is both more effective at achieving the goal and more human-like than baseline neural and rule-based models. Expand
Personalizing Dialogue Agents: I have a dog, do you have pets too?
TLDR
This work collects data and train models tocondition on their given profile information; and information about the person they are talking to, resulting in improved dialogues, as measured by next utterance prediction. Expand
Hierarchical Text Generation and Planning for Strategic Dialogue
TLDR
An approach to learning representations of messages in dialogues by maximizing the likelihood of subsequent sentences and actions, which decouples the semantics of the dialogue utterance from its linguistic realization, which outperforms previous work both linguistically and strategically. Expand
Recommender systems with social regularization
TLDR
This paper proposes a matrix factorization framework with social regularization, which can be easily extended to incorporate other contextual information, like social tags, etc, and demonstrates that the approaches outperform other state-of-the-art methods. Expand
Mastering the game of Go without human knowledge
TLDR
An algorithm based solely on reinforcement learning is introduced, without human data, guidance or domain knowledge beyond game rules, that achieves superhuman performance, winning 100–0 against the previously published, champion-defeating AlphaGo. Expand
...
1
2
3
4
...