Learning to Rank Question-Answer Pairs Using Hierarchical Recurrent Encoder with Latent Topic Clustering (N18-1)
Copied to clipboard
| Challenge: | Existing models for sentence pair ranking are based on hierarchical recurrent neural network and latent topic clustering module. |
| Approach: | They propose a hierarchical recurrent neural network and latent topic clustering module to adapt a recursive hierarchic neural network to rank candidate answers. |
| Outcome: | The proposed model shows small performance degradations in longer text comprehension compared to current models which suffer from it. |
Similar Papers
Supervised Neural Clustering via Latent Structured Output Learning: Application to Question Intents (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent work on structured prediction has produced very effective supervised clustering algorithms using linear classifiers. |
| Approach: | They propose to use latent structured prediction loss and Transformer models to approach supervised clustering. |
| Outcome: | The proposed approach outperforms the state-of-the-art in recreating intents from public question corpora. |
Double Retrieval and Ranking for Accurate Question Answering (2023.findings-eacl)
Copied to clipboard
| Challenge: | Recent work shows that answer verification models can improve the state of the art in Question Answering . despite the fact that the supporting candidates are ranked only according to the relevancy with the question, the model still lacks the support needed for other answer candidates. |
| Approach: | They propose a double reranking model that selects the best support for each target answer . they propose 'second neural retrieval stage' to encode question and answer pair as query . |
| Outcome: | The proposed approach improves the state of the art in Question Answering . the proposed model ranked candidates according to relevancy and not the answer . but the proposed approach fails to provide the best support . |
Recurrent Neural Networks with Mixed Hierarchical Structures and EM Algorithm for Natural Language Processing (2022.lrec-1)
Copied to clipboard
| Challenge: | A variety of hierarchical RNN models have been proposed to incorporate hierarchically-based hierarchic information in modeling languages in the literature. |
| Approach: | They propose a latent indicator layer approach to identify and learn hierarchical information and develop an EM algorithm to handle the latent indicators layer in training. |
| Outcome: | The proposed approach outperforms other RNN-based models in document classification tasks. |
RankQA: Neural Question Answering with Answer Re-Ranking (P19-1)
Copied to clipboard
| Challenge: | RankQA extends the conventional two-stage process in neural question answering . RankQ achieves state-of-the-art performance on 3 out of 4 benchmark datasets . |
| Approach: | They propose to extend the conventional two-stage process in neural QA with a third stage that performs an additional answer re-ranking. |
| Outcome: | RankQA outperforms more complex question answering systems by a significant margin on 3 out of 4 benchmark datasets. |
Retrieving Support to Rank Answers in Open-Domain Question Answering (2025.emnlp-main)
Copied to clipboard
| Challenge: | a novel question answering architecture retrieves content relevant to the combined pair . previous work on automatic claim verification has shown hallucinations . |
| Approach: | They propose a question-answer architecture that prioritizes supporting evidence . it retrieves paragraphs that directly substantiate the correctness of a with respect to q . |
| Outcome: | The proposed approach can be used by large language models to retrieve explanatory paragraphs that ground their reasoning. |
Answering questions by learning to rank - Learning to rank by answering questions (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to answer multiple-choice questions with no supporting documents are poor performance. |
| Approach: | They propose a method which can be used to semantically rank documents extracted from Wikipedia . they propose 'semantic ranking' method that latently learns to rank documents by their importance . |
| Outcome: | The proposed model achieves state-of-the-art accuracy on two datasets: ARC Easy and Challenge. |
Neural Attention-Aware Hierarchical Topic Model (2021.emnlp-main)
Copied to clipboard
| Challenge: | Neural topic models (NTMs) use deep neural networks to learn topic information. |
| Approach: | They propose a variational autoencoder model that reconstructs sentence and document word counts using bag-of-words embeddings and pre-trained semantic embedders. |
| Outcome: | The proposed model lowers reconstruction errors at sentence and document levels and finds more coherent topics from real-world datasets. |
Hierarchical Transformers for Multi-Document Summarization (P19-1)
Copied to clipboard
| Challenge: | Existing models for multidocument summarization have been developed that can process multiple documents in a hierarchical manner. |
| Approach: | They propose a neural summarization model which can process multiple input documents and distill Transformer architecture with the ability to encode documents in a hierarchical manner. |
| Outcome: | The proposed model improves on the WikiSum dataset and can process multiple documents in a hierarchical manner. |
Harvesting Paragraph-level Question-Answer Pairs from Wikipedia (P18-1)
Copied to clipboard
| Challenge: | Existing models that only take into account sentence-level information do not generate question-answer pairs. |
| Approach: | They propose a neural network approach that incorporates coreference knowledge via a novel gating mechanism for paragraphlevel question generation. |
| Outcome: | The proposed model outperforms existing models on a Wikipedia article question-answer generation task. |
A Hierarchical Neural Attention-based Text Classifier (D18-1)
Copied to clipboard
| Challenge: | Existing hierarchical classification models are unable to handle large corpora and the number of categories increases with increasing corpus. |
| Approach: | They propose to use external knowledge to introduce a hierarchical neural attention-based classifier to help with the classification of documents. |
| Outcome: | The proposed model performs better than or comparable to state-of-the-art hierarchical models at significantly lower computational cost while maintaining high interpretability. |