It is AI’s Turn to Ask Humans a Question: Question-Answer Pair Generation for Children’s Story Books (2022.acl-long)
Copied to clipboard
| Challenge: | Existing question answering (QA) techniques are created mainly to answer questions asked by humans, but in educational applications, teachers often need to decide what questions to ask . |
| Approach: | They propose to use a fairytale-themed storybook as input to generate QA pairs that can test a student's comprehension skills. |
| Outcome: | The proposed system outperforms state-of-the-art QAG baseline systems and builds an interactive story-telling application for the future real-world deployment. |
Similar Papers
Fantastic Questions and Where to Find Them: FairytaleQA – An Authentic Dataset for Narrative Comprehension (2022.acl-long)
Copied to clipboard
Ying Xu, Dakuo Wang, Mo Yu, Daniel Ritchie, Bingsheng Yao, Tongshuang Wu, Zheng Zhang, Toby Li, Nora Bradford, Branda Sun, Tran Hoang, Yisi Sang, Yufang Hou, Xiaojuan Ma, Diyi Yang, Nanyun Peng, Zhou Yu, Mark Warschauer
| Challenge: | Existing QA datasets rarely distinguish fine-grained reading skills, such as the understanding of varying narrative elements. |
| Approach: | They propose to use FairytaleQA to generate 10,580 questions based on 278 children-friendly stories to assess model's fine-grained learning skills. |
| Outcome: | The proposed dataset consists of 10,580 questions derived from 278 children-friendly stories, covering seven types of narrative elements or relations. |
Towards Diverse and Effective Question-Answer Pair Generation from Children Storybooks (2023.findings-acl)
Copied to clipboard
Sugyeong Eo, Hyeonseok Moon, Jinsung Kim, Yuna Hur, Jeongwook Kim, SongEun Lee, Changwoo Chun, Sungsoo Park, Heuiseok Lim
| Challenge: | Recent advances in QA pair generation (QAG) have raised interest in applying this technique to the educational field. |
| Approach: | They propose a QAG framework that enhances QA type diversity by producing different interrogative sentences and implicit/explicit answers. |
| Outcome: | The proposed framework outperforms state-of-the-art methods by significant margins, achieving improved diversity and quality. |
Educational Question Generation of Children Storybooks via Question Type Distribution Learning and Event-centric Summarization (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods to generate educational questions of fairytales or storybooks are difficult to implement due to adults lacking the skills or time to integrate such interactive opportunities. |
| Approach: | They propose a question generation method that first learns the question type distribution of an input story paragraph, and then summarizes salient events which can be used to generate high-cognitive-demand questions. |
| Outcome: | The proposed method performs well on automatic and human evaluation metrics on a newly proposed educational question-answering dataset FairytaleQA. |
Evaluation of Question Answer Generation for Portuguese: Insights and Datasets (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Automatic question generation is an increasingly important task that can be applied in educational settings, data augmentation for question-answering (QA), and conversational systems. |
| Approach: | They adapt and apply QAG approaches to generate question-answer pairs given context and look into strategies for error filtering and their effects. |
| Outcome: | The proposed methods can generate question-answer pairs in Portuguese, a widely spoken language that is underrepresented in natural language processing research. |
Asking Questions Like Educational Experts: Automatically Generating Question-Answer Pairs on Real-World Examination Data (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to generate high quality question-answer pairs are limited . a new framework is proposed for the question-answer generation task on real-world examination data. |
| Approach: | They propose a multi-agent communication model to generate and optimize the question and keyphrases iteratively and then apply the generated question and keys to guide the generation of answers. |
| Outcome: | The proposed framework makes great breakthroughs in the question-answer pair generation task. |
Improving the Robustness of QA Models to Challenge Sets with Variational Question-Answer Pair Generation (2021.acl-srw)
Copied to clipboard
| Challenge: | Existing data augmentation methods for reading comprehension lack robustness to challenge sets whose distribution is different from that of training sets. |
| Approach: | They propose a question-answer pair generation method that generates multiple diverse QA pairs from a paragraph to mitigate this problem. |
| Outcome: | The proposed model improves the accuracy of 12 challenge sets and the in-distribution accuracy. |
Generative Interpretation: Toward Human-Like Evaluation for Educational Question-Answer Pair Generation (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing evaluation methods often fail to produce objective results and favor high similarity to the ground-truth question-answer pairs. |
| Approach: | They propose an alternative approach to evaluate question-answer generation using Generative Interpretation (GI) GI outperforms existing evaluation methods in terms of human alignment . |
| Outcome: | The proposed approach outperforms existing evaluation methods in human alignment and shows comparable performance with GPT3.5, only with BART-large. |
A Practical Toolkit for Multilingual Question and Answer Generation (2023.acl-demo)
Copied to clipboard
| Challenge: | Generating questions and answers from text is a challenging task due to the expected structured output. |
| Approach: | They propose an online service for multilingual QAG along with a python package for model fine-tuning, generation, and evaluation. |
| Outcome: | The proposed model is available in eight languages and can be used online or locally via lmqg. |
Diversity Enhanced Narrative Question Generation for Storybooks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Question generation (QG) from a given context can enhance comprehension, engagement, assessment, and overall efficacy in learning or conversational environments. |
| Approach: | They propose a multi-question generation model which generates multiple, diverse questions by focusing on context and questions. |
| Outcome: | The proposed model shows promising results across evaluation metrics, among strong baselines. |
StorySparkQA: Expert-Annotated QA Pairs with Real-World Knowledge for Children’s Story-Based Learning (2024.emnlp-main)
Copied to clipboard
Jiaju Chen, Yuxuan Lu, Shao Zhang, Bingsheng Yao, Yuanzhe Dong, Ying Xu, Yunyao Li, Qianwen Wang, Dakuo Wang, Yuling Sun
| Challenge: | Existing story reading systems fail to capture the nuances of how education experts think when conducting interactive story reading activities. |
| Approach: | They propose to use existing question-answering (QA) datasets to capture experts' annotations and thinking process to construct a story-based annotation framework. |
| Outcome: | The proposed framework captures experts’ annotations and thinking process and can be used to generate 5, 868 expert-annotated QA pairs with real-world knowledge. |