Which questions should I answer? Salience Prediction of Inquisitive Questions (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent work in NLP has taken advantage of question generation capabilities of LLMs to enhance a wide range of applications. |
| Approach: | They propose a salience predictor for inquisitive questions that is instruction-tuned . they show that highly salient questions are empirically more likely to be answered in the same article . |
| Outcome: | The proposed model is based on linguist-annotated salience scores of 1,766 questions . it shows that answering salient questions improves comprehension of the text . |
Similar Papers
Inquisitive Question Generation for High Level Text Comprehension (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing data-driven questions generate questions that fill gaps in knowledge . a dataset of 19K questions is used to generate meaningful questions . |
| Approach: | They propose a dataset of 19K questions that are elicited while a person is reading a document. |
| Outcome: | The proposed model generates reasonable questions, but the task is challenging. |
SGCM: Salience-Guided Context Modeling for Question Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Identifying relevant sentences to answers is crucial for reasoning the possible questions before generation. |
| Approach: | They propose a salience-guided approach to enhance Paragraph-level Question Generation by identifying salient sentences that manifest relevance. |
| Outcome: | The proposed approach achieves Rouge-L, BLEU4, BERTScore, Q-BLUE-3 and F1-scores compared to baseline on FairytaleQA. |
Question Difficulty Estimation for Large Language Models via Answer Plausibility Scoring (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to estimate question difficulty rely on readability formulas, retrieval-based signals, or popularity statistics. |
| Approach: | They propose a method that estimates question difficulty by computing the entropy of plausibility scores over candidate answers. |
| Outcome: | The proposed method outperforms baselines across four QA datasets and shows strong robustness across hyperparameter variations and question types. |
Knowing More About Questions Can Help: Improving Calibration in Question Answering (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing work on calibration focuses on model confidence, such as the max probability of the predicted class. |
| Approach: | They propose a calibration method which estimates whether model correctly predicts answer for each question. |
| Outcome: | The proposed calibration method achieves 5-10% gains on reading comprehension benchmarks. |
Incorporating Question Answering-Based Signals into Abstractive Summarization via Salient Span Selection (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for generating summarizations using QA-based supervision produce higher quality summaries than baseline methods. |
| Approach: | They propose a method for incorporating question-answering signals into a summarization model by automatically marking document NPs as salient based on whether they are answered in the gold summaries. |
| Outcome: | The proposed method generates higher-quality summaries than baseline methods on benchmark summarization datasets. |
Question Answering as Programming for Solving Time-Sensitive Questions (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies show that Large Language Models (LLMs) have shown remarkable intelligence in question answering. |
| Approach: | They propose to reframe the Question Answering task as Programming to overcome this limitation by leveraging LLMs' superior ability in understanding both natural language and programming language. |
| Outcome: | The proposed approach improves on time-sensitive question answering datasets by 14.5% over baselines. |
DebateQA: Evaluating Question Answering on Debatable Knowledge (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing QA benchmarks that provide fixed answers to debatable questions are inadequate for evaluating their performance. |
| Approach: | They propose to use a dataset of 2,941 debatable questions to assess their ability to provide comprehensive answers to inherently debatably asked questions. |
| Outcome: | The proposed model performs well on 2,941 debatable questions accompanied by human-annotated partial answers that capture a variety of perspectives. |
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing metrics for assessing question generation fail to take into account the input context of generation. |
| Approach: | They propose a context-aware Relevance evaluation metric for Question Generation that takes into account the context of question generation into account. |
| Outcome: | The proposed metric achieves higher correlation with human judgments while being much more robust to adversarial samples. |
Can NLI Models Verify QA Systems’ Predictions? (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Recent question answering systems perform well on benchmark datasets, but are not always well-calibrated to spot spurious answers under distribution shifts. |
| Approach: | They propose to use natural language inference to verify whether answers are correct . they leverage large pre-trained models and recent prior datasets to construct powerful question conversion and decontextualization modules. |
| Outcome: | The proposed approach improves the confidence estimation of a QA model across different domains, evaluated in a selective QA setting. |
Integrating Question Classification and Deep Learning for improved Answer Selection (C18-1)
Copied to clipboard
| Challenge: | Question Answering (QA) is the task of automatically generating answers to questions posed in natural language. |
| Approach: | They propose a system for Answer Selection that integrates fine-grained Question Classification with a Deep Learning model designed for Answer selection. |
| Outcome: | The proposed system outperforms the current state of the art in all variations except one . the proposed system improves QA by reducing the search space of potential answers . |