Simple Attention-Based Representation Learning for Ranking Short Social Media Posts (N19-1)
Copied to clipboard
| Challenge: | Existing approaches to ranking short social media posts are complex and require different components to capture a multitude of relevance signals. |
| Approach: | They propose a word-level Siamese architecture with attention-based mechanisms for capturing semantic "soft" matches between query and post tokens. |
| Outcome: | The proposed model is faster and simpler than existing models and more efficient than existing approaches. |
Similar Papers
Topic Memory Networks for Short Text Classification (D18-1)
Copied to clipboard
| Challenge: | Existing classification models for short texts are weak due to data sparsity . |
| Approach: | They propose topic memory networks for short text classification with a novel topic memory mechanism to encode latent topic representations indicative of class labels. |
| Outcome: | The proposed model outperforms state-of-the-art models on short text classification, while generating coherent topics. |
Fine-Grained Emotion Detection in Health-Related Online Posts (D18-1)
Copied to clipboard
| Challenge: | Emotion detection from health-related posts is based on a health-specific vocabulary that people use in OHCs. |
| Approach: | They propose to use deep neural networks and lexicon-based features to detect emotions in health-related posts. |
| Outcome: | The proposed method uses high-level and abstract features derived from deep neural networks combined with lexicon-based features to detect emotions. |
A Novel Perspective to Look At Attention: Bi-level Attention-based Explainable Topic Modeling for News Classification (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing deep learning models have the attention mechanism to improve performance, but the inherent characteristics of deep learning model complexity and the flexibility of the attention structure make them difficult to explain. |
| Approach: | They propose a two-tier attention architecture to decouple the complexity of explanation and the decision-making process by using large-scale news corpora. |
| Outcome: | The proposed model can achieve competitive performance with state-of-the-art models and illustrates its appropriateness from an explainability perspective. |
ReAttn: Improving Attention-based Re-ranking via Attention Re-weighting (2026.findings-eacl)
Copied to clipboard
| Challenge: | Attention-based re-ranking methods are highly concentrated a small subset of tokens within a few documents, making others indistinguishable. |
| Approach: | They propose a post-hoc re-weighting strategy that uses attention weights to reduce lexical bias and emphasize distinctive terms. |
| Outcome: | The proposed method reduces lexical bias and emphasizes distinctive terms across documents, while maintaining a balanced distribution across informative tokens. |
Answering questions by learning to rank - Learning to rank by answering questions (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to answer multiple-choice questions with no supporting documents are poor performance. |
| Approach: | They propose a method which can be used to semantically rank documents extracted from Wikipedia . they propose 'semantic ranking' method that latently learns to rank documents by their importance . |
| Outcome: | The proposed model achieves state-of-the-art accuracy on two datasets: ARC Easy and Challenge. |
TAN-NTM: Topic Attention Networks for Neural Topic Modeling (2021.acl-long)
Copied to clipboard
| Challenge: | Topic models have been widely used to learn text representations and gain insight into document corpora. |
| Approach: | They propose a framework which processes document as a sequence of tokens through a LSTM whose contextual outputs are attended in a topic-aware manner. |
| Outcome: | The proposed model improves on two downstream tasks: document classification and topic guided keyphrase generation. |
Tiny-NewsRec: Effective and Efficient PLM-based News Recommendation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work fine tunes the PLM with the news recommendation task, which can cause a domain shift problem. |
| Approach: | They propose a self-supervised method to adapt general PLM to news domain with a contrastive matching task between news titles and news bodies. |
| Outcome: | The proposed method can improve both the effectiveness and efficiency of the large PLM-based news recommendation model while maintaining its performance. |
A Hierarchical Neural Attention-based Text Classifier (D18-1)
Copied to clipboard
| Challenge: | Existing hierarchical classification models are unable to handle large corpora and the number of categories increases with increasing corpus. |
| Approach: | They propose to use external knowledge to introduce a hierarchical neural attention-based classifier to help with the classification of documents. |
| Outcome: | The proposed model performs better than or comparable to state-of-the-art hierarchical models at significantly lower computational cost while maintaining high interpretability. |
Self-Supervised Document Similarity Ranking via Contextualized Language Models and Hierarchical Inference (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to document-to-document similarity ranking are limited to relatively short documents or lack similarity labels. |
| Approach: | They propose a self-supervised method for document similarity ranking that can be applied to documents of arbitrary length. |
| Outcome: | The proposed model outperforms existing methods on large documents datasets. |
Effective Attention Modeling for Aspect-Level Sentiment Classification (C18-1)
Copied to clipboard
| Challenge: | Aspect-level sentiment classification aims to determine sentiment polarity of review sentence towards opinion target . main challenge is to separate different opinion contexts for different targets . |
| Approach: | They propose a method that captures the semantic meaning of the opinion target and a model that incorporates syntactic information into the attention mechanism. |
| Outcome: | The proposed method captures the semantic meaning of the opinion target and incorporates syntactic information into the attention mechanism. |