Learning to Automate Follow-up Question Generation using Process Knowledge for Depression Triage on Reddit Posts

  title={Learning to Automate Follow-up Question Generation using Process Knowledge for Depression Triage on Reddit Posts},
  author={Shrey Gupta and Anmol Agarwal and Manas Gaur and Kaushik Roy and Vignesh Narayanan and Ponnurangam Kumaraguru and Amit P. Sheth},
Conversational Agents (CAs) powered with deep language models (DLMs) have shown tremendous promise in the domain of mental health. Prominently, the CAs have been used to provide informational or therapeutic services (e.g., cognitive behavioral therapy) to patients. However, the utility of CAs to assist in mental health triaging has not been explored in the existing work as it requires a controlled generation of follow-up questions (FQs), which are often initiated and guided by the mental health… 

Figures and Tables from this paper

Process Knowledge-Infused AI: Towards User-level Explainability, Interpretability, and Safety
This article will use two demanding applications – mental health triaging and cooking recipes for diabetes to show what process knowledge they need and how process knowledge can be modeled and then infused into AI algorithms to achieve the outlined features.


Knowledge-Infused Abstractive Summarization of Clinical Diagnostic Interviews: Framework Development Study
This study proposes an unsupervised, knowledge-infused abstractive summarization (KiAS) approach that generates summaries to enable MHPs to perform a well-informed follow-up with patients to improve the existing summarization methods built on frequency heuristics by creating more informative summaries.
Semi-Supervised Approach to Monitoring Clinical Depressive Symptoms in Social Media
Based on the analysis of tweets crawled from users with self-reported depressive symptoms in their Twitter profiles, the potential for detecting clinical depression symptoms which emulate the PHQ-9 questionnaire clinicians use today is demonstrated.
Detection of Mental Health from Reddit via Deep Contextualized Representations
A large scale dataset of Reddit posts from users with eight disorders and a control user group is built and strong classification models based on deep contextualized word representations are built that outperform previously applied statistical models with simple linguistic features by large margins.
A Test Collection for Research on Depression and Language Use
A novel early detection task is proposed and a novel effectiveness measure is defined to systematically compare early detection algorithms that takes into account both the accuracy of the decisions taken by the algorithm and the delay in detecting positive cases.
Anticipating Safety Issues in E2E Conversational AI: Framework and Tooling
This paper surveys the problem landscape for safety for end-to-end conversational AI, highlights tensions between values, potential positive impact and potential harms, and provides a framework for making decisions about whether and how to release these models, following the tenets of value-sensitive design.
Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
It is shown that for domains with abundant unlabeled text, such as biomedicine, pretraining language models from scratch results in substantial gains over continual pretraining of general-domain language models.
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
A general-purpose fine-tuning recipe for retrieval-augmented generation (RAG) -- models which combine pre-trained parametric and non-parametric memory for language generation, and finds that RAG models generate more specific, diverse and factual language than a state-of-the-art parametric-only seq2seq baseline.
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
This systematic study compares pre-training objectives, architectures, unlabeled datasets, transfer approaches, and other factors on dozens of language understanding tasks and achieves state-of-the-art results on many benchmarks covering summarization, question answering, text classification, and more.
ISEEQ: Information Seeking Question Generation using Dynamic Meta-Information Retrieval and Knowledge Graphs
It is argued that ISEEQ is transferable across domains for generating ISQs, as it shows the acceptable performance when trained and tested on different pairs of domains, and it outperformed the best comparable baseline on five ISQ evaluation metrics.
Towards augmenting crisis counselor training by improving message retrieval
This work proposes simulating an individual in crisis so that human counselors in training can practice crisis counseling in a low-risk environment and shows that embeddings can considerably improve retrieval approaches to make them competitive with generative models.