From Documents to Segments: A Contextual Reformulation for Topic Assignment (2026.findings-acl)
Copied to clipboard
| Challenge: | Traditional topic modeling treats each document as a single, coherent unit of topic. |
| Approach: | They propose a paradigm that redefines topic assignment at the level of segments . they propose 'segment intrusion task' to extend word intrusion to the span level . |
| Outcome: | The proposed paradigm improves topic purity, interpretability and applicability to multi-theme corpora. |
Similar Papers
Advancing Topic Segmentation and Outline Generation in Chinese Texts: The Paragraph-level Topic Representation, Corpus, and Benchmark (2024.lrec-main)
Copied to clipboard
| Challenge: | Compared with sentence-level topic structure, paragraph-level topics can grasp and understand the context of a document from a higher level. |
| Approach: | They propose a hierarchical paragraph-level topic structure representation with three layers to guide corpus construction. |
| Outcome: | The proposed method achieves the largest Chinese paragraph-level topic structure corpus, achieving high quality. |
Topic Modeling: Contextual Token Embeddings Are All You Need (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Current neural approaches to topic modeling have not been able to solve all of the problems. |
| Approach: | They propose a topic modeling approach that uses document contextual token embeddings to find topics and find topic spans within documents. |
| Outcome: | The proposed model outperforms the current state-of-the-art models on a comprehensive set of topic model evaluation metrics. |
Towards Modern Topic Models: A Survey of Taxonomies and Paradigm Shifts from Algorithm-Centric to LLM-Centered Topic Analysis (2026.findings-acl)
Copied to clipboard
| Challenge: | Topic modeling (TM) is a classic unsupervised learning task in the field of natural language processing. |
| Approach: | They propose a new taxonomy that emphasizes the role of LLMs and the design of end-to-end workflows. |
| Outcome: | The proposed taxonomy emphasizes the role of LLMs and the design of end-to-end workflows. |
LLM-Guided Semantic-Aware Clustering for Topic Modeling (2025.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that topic modeling is competitive compared to closed-source methods. |
| Approach: | They propose a semi-supervised topic modeling method that combines LLMs with clustering to improve topic generation and distribution. |
| Outcome: | The proposed method outperforms state-of-the-art methods that utilize GPT-4 on topic alignment and exhibits competitive performance compared to Neural Topic Models on topic quality. |
Improving Long Document Topic Segmentation Models With Enhanced Coherence Modeling (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent supervised neural models have greatly promoted the development of topic segmentation, but the deeper relationship between coherence and topic segmenting is underexplored. |
| Approach: | They propose to use topic-aware Sentence Structure Prediction and Contrastive Semantic Similarity Learning to capture coherence from logical structure and semantic similarity perspectives to further improve topic segmentation performance. |
| Outcome: | The proposed approach outperforms state-of-the-art methods on WIKI-727K and achieves an average relative reduction of 4.3% on Pk on WikiSection. |
Exploiting Discourse-Level Segmentation for Extractive Summarization (D19-54)
Copied to clipboard
| Challenge: | Existing approaches to extract summarize text are based on sentences as the elementary unit, but semantic segments containing supplementary information or descriptive details are often nonessential in the generated summaries. |
| Approach: | They propose to exploit discourse-level segmentation as a finer-grained means to more precisely pinpoint the core content in a document. |
| Outcome: | The proposed method improves extractive summarization performance on CNN/Daily Mail dataset. |
Inducing Document Structure for Aspect-based Summarization (P19-1)
Copied to clipboard
| Challenge: | Abstractive summarization systems treat documents as unstructured and generate a single generic summary per document. |
| Approach: | They propose to incorporate document structure into automatic summarization systems . they induce latent document structure and abstractive summarizing objective . |
| Outcome: | The proposed model improves on topic-agnostic baselines and can produce abstractive and extractive aspect-based summaries. |
Joint Dialogue Topic Segmentation and Categorization: A Case Study on Clinical Spoken Conversations (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Utilizing natural language processing in clinical conversations is effective to improve the efficiency of workflows for medical staff and patients. |
| Approach: | They propose a model for dialogue segmentation and topic categorization that integrates natural language processing techniques into a joint model. |
| Outcome: | The proposed model improves on follow-up calls for diabetes management and reduces computational complexity and cost. |
Text Segmentation by Cross Segment Attention (2020.emnlp-main)
Copied to clipboard
| Challenge: | Document and discourse segmentation are two fundamental NLP tasks pertaining to breaking up text into constituents. |
| Approach: | They propose three transformer-based NLP models that break up text into constituents and compare them to previous approaches. |
| Outcome: | The proposed architectures reduce errors by a large margin on three datasets and improve performance on real-world datasets. |
Context-Aware Hierarchical Taxonomy Generation for Scientific Papers via LLM-Guided Multi-Aspect Clustering (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing taxonomy construction methods lack coherence and granularity . Existing approaches rely on manual or narrowly defined schemes . |
| Approach: | They propose a context-aware hierarchical taxonomy generation framework that integrates LLMs with dynamic clustering. |
| Outcome: | The proposed method outperforms existing methods in taxonomy coherence, granularity, and interpretability. |