Exploiting WordNet Synset and Hypernym Representations for Answer Selection (2020.aacl-main)
Copied to clipboard
| Challenge: | Answer selection (AS) is a challenging subtask of document-based question answering (DQA). |
| Approach: | They propose to use WordNet to enrich the word representation and sentence encoding to incorporate similarity scores of two concepts that share synset or hypernym relations into the attention mechanism. |
| Outcome: | The proposed model outperforms existing state-of-the-art models on the public WikiQA and SelQA datasets and significantly improves the baseline system. |
Similar Papers
A Study on Efficiency, Accuracy and Document Structure for Answer Sentence Selection (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to QA re-rank sentences use huge neural models or complex attentive architectures. |
| Approach: | They propose to exploit the intrinsic structure of the original rank with an effective word-relatedness encoder to achieve the highest accuracy among the cost-efficient models. |
| Outcome: | The proposed model takes 9.5 seconds to train on the WikiQA dataset, compared with 18 minutes required by a standard BERT-base fine-tuning. |
Contextualized Word Representations for Reading Comprehension (N18-2)
Copied to clipboard
| Challenge: | Reading comprehension (RC) is a high-level task in natural language understanding that requires reading a document and answering questions about its content. |
| Approach: | They propose to provide a standard neural network for reading a document and answering a question about its content. |
| Outcome: | The proposed model improves on the competitive SQuAD dataset by providing rich contextualized word representations and allowing it to choose between context-dependent and context-independent representations. |
Integrating Question Classification and Deep Learning for improved Answer Selection (C18-1)
Copied to clipboard
| Challenge: | Question Answering (QA) is the task of automatically generating answers to questions posed in natural language. |
| Approach: | They propose a system for Answer Selection that integrates fine-grained Question Classification with a Deep Learning model designed for Answer selection. |
| Outcome: | The proposed system outperforms the current state of the art in all variations except one . the proposed system improves QA by reducing the search space of potential answers . |
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for answer sentence selection (AS2) are not yet available for AS2 . |
| Approach: | They propose to incorporate paragraph-level semantics within and across documents to improve transformers for AS2 . they propose to use a dataset to predict whether two sentences are extracted from the same paragraph . |
| Outcome: | The proposed model outperforms baseline models on public and industrial datasets on three public and one industrial dataset. |
Cross-sentence Pre-trained Model for Interactive QA matching (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for semantic matching do not examine each sentence individually, but consider syntactic context inside a sentence. |
| Approach: | They propose a semantic matching model that takes a cross-sentence context-aware architecture and incorporates a quantity of context information jump to facilitate attention weight formulation. |
| Outcome: | The proposed model outperforms state-of-the-art models on the Yahoo! community question dataset and the TREC library. |
EEE-QA: Exploring Effective and Efficient Question-Answer Representations (2024.lrec-main)
Copied to clipboard
| Challenge: | Current approaches to question answering rely on pre-trained language models like RoBERTa. |
| Approach: | They propose a pooling approach that embeds all answer candidates with the question . they also propose enabling cross-reference between answer choices . |
| Outcome: | The proposed methods improve throughput and memory efficiency with little sacrifice in performance. |
Joint Models for Answer Verification in Question Answering Systems (2021.acl-long)
Copied to clipboard
| Challenge: | Using a joint approach, we found that the model is more efficient than those developed in machine reading (MR) work. |
| Approach: | They propose a joint model for selecting correct answer sentences among the top k provided by answer sentence selection modules. |
| Outcome: | The proposed model improves on WikiQA, TREC-QA, and a real-world dataset. |
Semantic Linking in Convolutional Neural Networks for Answer Sentence Selection (D18-1)
Copied to clipboard
| Challenge: | Recent NLP approaches that model relations between text use complex architectures and attention. |
| Approach: | They propose to use labelled data to model semantic relations between two pieces of text . they use word representations to encode matching features directly in the word representation . |
| Outcome: | The proposed approach beats tree kernel models and neural models with similar input encodings while keeping the model simple and fast to train. |
Question-Answer Sentence Graph for Joint Modeling Answer Selection (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing approaches to automate Question Answering (QA) are graph-based and can target large text databases. |
| Approach: | They propose graph-based approaches for Answer Sentence Selection (AS2) . they train and integrate state-of-the-art (SOTA) models for computing scores . |
| Outcome: | The proposed approach outperforms baseline models on academic benchmarks and a real-world dataset on unseen queries. |
Answer Generation for Retrieval-based Question Answering Systems (2021.findings-acl)
Copied to clipboard
| Challenge: | Question Answering systems are a core component of many commercial applications . answer sentence selection (AS2) models are trained to select the best answer sentence . |
| Approach: | They propose to train a sequence to sequence transformer model to generate an answer from a set of candidates. |
| Outcome: | The proposed model improves accuracy by 32 points over the state-of-the-art model on English AS2 datasets. |