A Feasibility Study of Answer-Agnostic Question Generation for Education (2022.findings-acl)
Copied to clipboard
Liam Dugan, Eleni Miltsakaki, Shriyash Upadhyay, Etan Ginsberg, Hannah Gonzalez, DaHyeon Choi, Chuning Yuan, Chris Callison-Burch
| Challenge: | a feasibility study into the applicability of answer-agnostic question generation models to textbook passages is conducted . a significant portion of errors arise from asking irrelevant or un-interpretable questions, a study finds . |
| Approach: | They conduct a feasibility study into the applicability of answer-agnostic question generation models to textbook passages. |
| Outcome: | The proposed model reduces the time it takes to write questions that target salient concepts . the proposed model would help professors write quizzes faster and help students stay engaged . |
Similar Papers
Concise Answers to Complex Questions: Summarization of Long-form Answers (2023.acl-long)
Copied to clipboard
| Challenge: | Long-form question answering systems provide rich information by presenting paragraph-level answers, but not all information is required to answer the question. |
| Approach: | They propose an extract-and-decontextualize approach to summarize long-form answers using state-of-the-art models. |
| Outcome: | The proposed extract-and-decontextualize approach improves the quality of the extractive summary, exemplifying its potential in the summarization task. |
Generative Interpretation: Toward Human-Like Evaluation for Educational Question-Answer Pair Generation (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing evaluation methods often fail to produce objective results and favor high similarity to the ground-truth question-answer pairs. |
| Approach: | They propose an alternative approach to evaluate question-answer generation using Generative Interpretation (GI) GI outperforms existing evaluation methods in terms of human alignment . |
| Outcome: | The proposed approach outperforms existing evaluation methods in human alignment and shows comparable performance with GPT3.5, only with BART-large. |
Elaboration-Generating Commonsense Question Answering at Scale (2023.acl-long)
Copied to clipboard
| Challenge: | elaborations are generated using language models that generate background knowledge that helps improve performance . human evaluations show that the quality of the generated ellaborations is high . |
| Approach: | They propose to finetune smaller language models to generate useful intermediate context . they compare a language model with an answer predictor and generate elaborations . human evaluations show that the quality of the generated ellaborations is high . |
| Outcome: | The proposed framework outperforms other models on commonsense questions on four commons sense benchmarks. |
Covering Uncommon Ground: Gap-Focused Question Generation for Answer Assessment (2023.acl-short)
Copied to clipboard
Roni Rabin, Alexandre Djerbetian, Roee Engelberg, Lidan Hackmon, Gal Elidan, Reut Tsarfaty, Amir Globerson
| Challenge: | Human communication often involves information gaps between the interlocutors. |
| Approach: | They propose a model that generates such gap-focused questions automatically . they propose an evaluation by human annotators of the generated questions . |
| Outcome: | The proposed model outperforms human generated questions in a competitive environment. |
Leveraging Context Information for Natural Question Generation (N18-2)
Copied to clipboard
| Challenge: | Existing work for natural question generation ignores the input passage or hard-codes answer positions. |
| Approach: | They propose a model that matches the answer with the passage before generating a question. |
| Outcome: | The proposed model outperforms the state-of-the-art model using rich features. |
Improving Factual Consistency of Abstractive Summarization via Question Answering (2021.acl-long)
Copied to clipboard
Feng Nan, Cicero Nogueira dos Santos, Henghui Zhu, Patrick Ng, Kathleen McKeown, Ramesh Nallapati, Dejiao Zhang, Zhiguo Wang, Andrew O. Arnold, Bing Xiang
| Challenge: | Recent studies show that about 30% of summaries generated by neural text summarization suffer from fact fabrication. |
| Approach: | They propose an automatic evaluation metric to measure factual consistency and a learning algorithm that maximizes the metric during model training. |
| Outcome: | The proposed method improves factual consistency and overall quality of summarization models. |
CONSISTENT: Open-Ended Question Generation From News Articles (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work on question generation has largely focused on factoid questions such as who, what, where, when about basic facts. |
| Approach: | They propose an end-to-end system for generating openended questions that are answerable from and faithful to the input text. |
| Outcome: | The proposed model outperforms existing models and can be used in news media organizations. |
Improving Unsupervised Question Answering via Summarization-Informed Question Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Question Generation (QG) is the production of meaningful questions given a set of input passages and corresponding answers. |
| Approach: | They propose a method which uses questions generated heuristically from news summaries as a source of training data for a QG system. |
| Outcome: | The proposed method outperforms previous unsupervised models on three in-domain datasets and three out-of-domain ones. |
KHANQ: A Dataset for Generating Deep Questions in Education (2022.coling-1)
Copied to clipboard
| Challenge: | Existing QG datasets are not suitable for educational question generation because the questions are not real questions asked by humans during learning. |
| Approach: | They propose a dataset for question generation that contains 1,034 high-quality learner-generated questions seeking an in-depth understanding of the taught online courses in Khan Academy. |
| Outcome: | The proposed dataset contains 1,034 high-quality learner-generated questions seeking an in-depth understanding of the taught online courses in Khan Academy. |
I Could’ve Asked That: Reformulating Unanswerable Questions (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing large language models do not assist users in reformulating unanswerable questions . a recent study found that the models failed to reformulate questions based on assumptions that conflict with or cannot be verified with the information available in documents. |
| Approach: | They evaluate open-source and proprietary LLMs on couldAsk to evaluate their performance . they found that GPT-4 and Llama2-7B successfully reformulate questions only 26% and 12% of the time . |
| Outcome: | The proposed model successfully reformulates questions only 26% and 12% of the time . the proposed model is not able to reformulate questions, but it can be improved . |