Ask to Learn: A Study on Curiosity-driven Question Generation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing work on Question Generation focuses on generating relevant questions given text with an answer . human ability to ask questions goes beyond evaluation of reading comprehension . |
| Approach: | They propose a novel text generation task based on a conversational question-asking dataset . they investigate automated metrics to measure different properties of Curious Questions . |
| Outcome: | The proposed task is based on a conversational Question Answering dataset . the results show that humans tend to ask questions with the goal of obtaining new information . |
Similar Papers
Inquisitive Question Generation for High Level Text Comprehension (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing data-driven questions generate questions that fill gaps in knowledge . a dataset of 19K questions is used to generate meaningful questions . |
| Approach: | They propose a dataset of 19K questions that are elicited while a person is reading a document. |
| Outcome: | The proposed model generates reasonable questions, but the task is challenging. |
Exploring Question-Specific Rewards for Generating Deep Questions (2020.coling-main)
Copied to clipboard
| Challenge: | Recent question generation approaches use the sequence-to-sequence framework to optimize the log likelihood of ground-truth questions using teacher forcing. |
| Approach: | They propose to optimize for QG-specific objectives via reinforcement learning to improve question quality. |
| Outcome: | The proposed model improves the fluency, relevance, and answerability of generated questions. |
Reinforced Multi-task Approach for Multi-hop Question Generation (2020.coling-main)
Copied to clipboard
| Challenge: | Empirical evaluation shows our model to outperform the single-hop question generation models on both automatic evaluation metrics such as BLEU, METEOR, and ROUGE and human evaluation metrics for quality and coverage of the generated questions. |
| Approach: | They propose a question-aware reward function to maximize the utilization of supporting facts in the context. |
| Outcome: | The proposed model outperforms single-hop neural question generation models on automatic evaluation metrics and human evaluation metrics for quality and coverage of the generated questions. |
Learning to Generate Question by Asking Question: A Primal-Dual Approach with Uncommon Word Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing automatic question generation methods focus on encoding passage and answer to generate question. |
| Approach: | They propose an automatic question generation approach which integrates question generation with its dual problem, question answering, into a unified primal-dual framework. |
| Outcome: | The proposed approach outperforms existing methods on SQuAD and HotpotQA benchmarks. |
Question-type Driven Question Generation (D19-1)
Copied to clipboard
| Challenge: | Existing work suffers from mismatching between question type and answer . existing work fails to generate questions with type how while answer is personal name . |
| Approach: | They propose to automatically predict the question type based on the input answer and context. |
| Outcome: | The proposed model improves on both SQuAD and MARCO datasets and improves accuracy on the input answer and context. |
Answer-driven Deep Question Generation based on Reinforcement Learning (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for deep question generation focus on enhancing document representations, but little attention is paid to the answer information. |
| Approach: | They propose a deep question generation model that makes better use of the target answer as a guidance to facilitate question generation. |
| Outcome: | The proposed model outperforms state-of-the-art models in automatic and human evaluations on the hotpotQA dataset. |
q2d: Turning Questions into Dialogs to Teach Models How to Search (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent dialog generation models use external search APIs to generate grounded responses. |
| Approach: | They propose an automatic data generation pipeline that generates dialogs from questions . they use a large language model to create conversational versions of question answering datasets . |
| Outcome: | The proposed method improves query generation models on a QReCC dataset. |
Addressing Semantic Drift in Question Generation for Semi-Supervised Question Answering (D19-1)
Copied to clipboard
| Challenge: | Existing QG models suffer from a “semantic drift” problem, i.e., the semantics of the model-generated question drifts away from the given context and answer. |
| Approach: | They propose two semantics-enhanced rewards obtained from downstream question paraphrasing and question answering tasks to regularize the QG model to generate semantically valid questions. |
| Outcome: | The proposed method achieves state-of-the-art performance w.r.t. traditional evaluation metrics and performs best on QA-based evaluation metrics. |
Stay Hungry, Stay Focused: Generating Informative and Specific Questions in Information-Seeking Conversations (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on question generation assumes knowledge of what the answer might be . instead, questioner must reason pragmatically about how to acquire new information . |
| Approach: | They propose a question generation system that generates pragmatically relevant questions in information-asymmetric conversations. |
| Outcome: | The proposed questioner significantly improves the informativeness and specificity of questions generated over a baseline model as evaluated by metrics as well as humans. |
Multi-Task Learning with Language Modeling for Question Generation (D19-1)
Copied to clipboard
| Challenge: | Existing work on answer-aware questions generates a sentence and answer span as input . previous work on QG was mainly tackled by rule-based approach and neural-based one . |
| Approach: | They propose to incorporate an auxiliary task of language modeling to help question generation in a hierarchical multi-task learning structure. |
| Outcome: | The proposed model improves on SQuAD and MARCO datasets and human evaluation proves it. |