| Challenge: | Existing tools for exploratory search can be useful for document writers but they are not always effective for identifying topics for further research. |
| Approach: | They propose a supervised learning problem for recommending topics to a writer . they propose entropy loss function modification to improve the results . |
| Outcome: | The proposed model improves on a large dataset and can be used to identify topics for further research. |
Similar Papers
DOCENT: Learning Self-Supervised Entity Representations from Large Document Collections (2021.eacl-main)
Copied to clipboard
Yury Zemlyanskiy, Sudeep Gandhe, Ruining He, Bhargav Kanagal, Anirudh Ravula, Juraj Gottweis, Fei Sha, Ilya Eckstein
| Challenge: | Using pre-trained models, we learn to jointly predict words and entities from multiple text sources without any human supervision. |
| Approach: | They propose to learn rich self-supervised entity representations from large amounts of associated text. |
| Outcome: | The proposed models outperform baseline models on downstream tasks in the TV-Movies domain, and scale to very large corpora. |
Improving Fine-grained Entity Typing with Entity Linking (D19-1)
Copied to clipboard
| Challenge: | Existing methods for fine-grained entity typing require a large tag set and knowledge of the context. |
| Approach: | They propose a deep neural model that uses context and information from entity linking to improve fine-grained entity typing. |
| Outcome: | The proposed model achieves 5% absolute strict accuracy improvement over the state of the art on two datasets. |
Boosting Entity Linking Performance by Leveraging Unlabeled Documents (P19-1)
Copied to clipboard
| Challenge: | a new approach to entity linking relies on unlabeled documents and Wikipedia . a supervised approach uses only natural information, such as unlabed documents . |
| Approach: | They propose a method which exploits only naturally occurring information . they construct a high recall list of candidate entities for each mention in an unlabeled document . |
| Outcome: | The proposed model outperforms fully-supervised state-of-the-art systems on standard test sets. |
Is Neural Topic Modelling Better than Clustering? An Empirical Study on Clustering with Contextual Embeddings for Topics (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent work incorporates pre-trained word embeddings into Neural Topic Models (NTMs), generating highly coherent topics. |
| Approach: | They conduct thorough experiments to investigate whether embeddings directly with an appropriate word selection method can generate more coherent and diverse topics than NTMs. |
| Outcome: | The proposed model generates more coherent and diverse topics than traditional NTMs, achieving higher efficiency and simplicity. |
Improving the TENOR of Labeling: Re-evaluating Topic Models for Content Analysis (2024.eacl-long)
Copied to clipboard
Zongxia Li, Andrew Mao, Daniel Stephens, Pranav Goel, Emily Walpole, Alden Dima, Juan Fung, Jordan Boyd-Graber
| Challenge: | Existing evaluation metrics such as coherence and coherency are inadequate for neural topic models. |
| Approach: | They conduct the first evaluation of neural, supervised and classical topic models in an interactive task-based setting. |
| Outcome: | The proposed model performs better on cluster evaluation metrics and human evaluations than classical models on real-world tasks. |
Ranking-Constrained Learning with Rationales for Text Classification (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to text classification use labels and rationales as ranking constraints. |
| Approach: | They propose a ranking-constrained loss function that combines cross-entropy loss with ranking losses as rationale constraints to speed up deep learning models with limited training data. |
| Outcome: | The proposed approach outperforms baselines on three human-annotated datasets and shows that it is more efficient than existing approaches. |
Deep Relevance Ranking Using Enhanced Document-Query Interactions (D18-1)
Copied to clipboard
| Challenge: | Document relevance ranking is the task of ranking documents from a large collection using the query and the text of each document only. |
| Approach: | They propose to use convolutional n-gram matching to inject rich context-sensitive encodings into their models, inspired by PACRR's convolution-based ngram matching features. |
| Outcome: | The proposed models outperform baselines, DRMM, and PACRR on the BIOASQ and TREC ROBUST questions and document inputs. |
Combining Deep Learning and Topic Modeling for Review Understanding in Context-Aware Recommendation (N18-1)
Copied to clipboard
| Challenge: | Existing models for user reviews are limited by data sparsity and lack of data. |
| Approach: | They propose to integrate LSTM and Topic Modeling to extract review information for recommender systems by utilizing user reviews. |
| Outcome: | The proposed model outperforms existing models on Amazon review dataset and shows better ability on making topic clustering than traditional topic model based method. |
Automatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to few-shot text classification require domain expertise and an understanding of the language model's abilities to define the mapping between words and labels. |
| Approach: | They propose a method that converts textual inputs to cloze questions that contain some form of task description and processes them with a pretrained language model to map the predicted words to labels. |
| Outcome: | The proposed approach performs almost as well as hand-crafted label-to-word mappings for a number of tasks with small amounts of training data. |
Topic Modeling: Contextual Token Embeddings Are All You Need (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Current neural approaches to topic modeling have not been able to solve all of the problems. |
| Approach: | They propose a topic modeling approach that uses document contextual token embeddings to find topics and find topic spans within documents. |
| Outcome: | The proposed model outperforms the current state-of-the-art models on a comprehensive set of topic model evaluation metrics. |