| Challenge: | Existing question answering datasets provide extractive or short answers, but less attention has been paid to open-ended questions that require explanations. |
| Approach: | They present a large-scale corpus for long form question answering . they use a Reddit forum to provide elaborate answers to open-ended questions . |
| Outcome: | The proposed model outperforms Seq2Seq, language modeling, and other models in human evaluations. |
Similar Papers
How Do We Answer Complex Questions: Discourse Structure of Long-form Answers (2022.acl-long)
Copied to clipboard
| Challenge: | Recent work explored long-form answers, where answers are free-form texts consisting of multiple sentences. |
| Approach: | They develop an ontology of six sentence-level functional roles for long-form answers . they annotate 3.9k sentences in 640 answer paragraphs and train a strong classifier . |
| Outcome: | The proposed model-generated answers agree less with model-driven answers than human-written answers. |
Concise Answers to Complex Questions: Summarization of Long-form Answers (2023.acl-long)
Copied to clipboard
| Challenge: | Long-form question answering systems provide rich information by presenting paragraph-level answers, but not all information is required to answer the question. |
| Approach: | They propose an extract-and-decontextualize approach to summarize long-form answers using state-of-the-art models. |
| Outcome: | The proposed extract-and-decontextualize approach improves the quality of the extractive summary, exemplifying its potential in the summarization task. |
Hurdles to Progress in Long-form Question Answering (2021.naacl-main)
Copied to clipboard
| Challenge: | Long-form question answering (LFQA) involves retrieving documents relevant to a given question and using them to generate a paragraph-length answer. |
| Approach: | They propose a long-form question answering system that relies on sparse attention and contrastive retriever learning to achieve state-of-the-art performance on the ELI5 LFQA dataset. |
| Outcome: | The proposed system tops the public leaderboard on the ELI5 LFQA dataset, but it has several troubling issues. |
A Critical Evaluation of Evaluations for Long-form Question Answering (2023.acl-long)
Copied to clipboard
| Challenge: | Long-form question answering (LFQA) is an emerging research area within QA . however, its flexibility poses enormous challenges for evaluation . |
| Approach: | They conduct the first targeted study of the evaluation of long-form answers, covering both human and automatic evaluation practices. |
| Outcome: | The proposed evaluations cover human and automatic evaluations. |
QuALITY: Question Answering with Long Input Texts, Yes! (2022.naacl-main)
Copied to clipboard
Richard Yuanzhe Pang, Alicia Parrish, Nitish Joshi, Nikita Nangia, Jason Phang, Angelica Chen, Vishakh Padmakumar, Johnny Ma, Jana Thompson, He He, Samuel Bowman
| Challenge: | Existing models for natural language understanding are limited to processing only a few hundred words at a time. |
| Approach: | They propose a dataset with context passages in English that have an average length of 5,000 tokens. |
| Outcome: | a new dataset with long-text comprehension questions is used to test models on long-document comprehension . the questions are validated by contributors who have read the entire passage, not just excerpts . only half of the questions can be answered by annotators working under tight time constraints . |
Open-Domain Question Answering (2020.acl-tutorials)
Copied to clipboard
| Challenge: | tutorial provides a comprehensive overview of cutting-edge research in open-domain question answering (QA) |
| Approach: | tutorial provides a comprehensive overview of cutting-edge research in open-domain question answering . focus will shift to cutting- edge models proposed for open- domain QA . |
| Outcome: | The tutorial will cover cutting-edge research in open-domain question answering (QA) it will cover two-stage retriever-reader approaches, dense retriever and end-to-end training, and retriever free methods . |
Revisiting Automated Evaluation for Long-form Table Question Answering (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing automated metrics for long-form table question answering (LFTQA) are poorly correlated with human judgments and fail to distinguish between factually accurate responses and those that are factual incorrect. |
| Approach: | They propose to use a meta-evaluation dataset to assess the effectiveness of LLM-based LFTQA systems. |
| Outcome: | The proposed meta-evaluation dataset includes 2,988 human-annotated examples. |
emrQA: A Large Corpus for Question Answering on Electronic Medical Records (D18-1)
Copied to clipboard
| Challenge: | Existing annotations for other NLP tasks are used to generate domain-specific large-scale question answering (QA) datasets. |
| Approach: | They propose to re-purpose existing annotations for other NLP tasks by generating a large-scale question answering corpus using 1 million questions-logical form and 400,000+ question-answer evidence pairs. |
| Outcome: | The proposed model can be trained to learn domain-specific large-scale question answering (QA) datasets. |
Long-Context Long-Form Question Answering for Legal Domain (2026.eacl-industry)
Copied to clipboard
| Challenge: | Legal documents have complex document layouts involving multiple nested sections and lengthy footnotes that make question answering challenging. |
| Approach: | They propose a question answering system that parses document layouts while isolating sections and footnotes and linking them appropriately. |
| Outcome: | The proposed system can parse complex document layouts while isolating sections and footnotes and linking them appropriately. |
Table Question Answering in the Era of Large Language Models: A Comprehensive Survey of Tasks, Methods, and Evaluation (2026.acl-long)
Copied to clipboard
| Challenge: | Table Question Answering (TQA) aims to answer natural language questions using tabular data. |
| Approach: | They propose a systematic overview of TQA research using large language models and summarize available benchmarks based on task features. |
| Outcome: | The proposed framework provides a comprehensive overview of the current state of the art in the field of Table Question Answering. |