Challenge: Sentence segmentation is a linguistic task used as a pre-processing step in many NLP applications.
Approach: They propose a sequence labeling classifier that predicts sentence spans using a dynamic sliding window based on the prediction of each input sequence.
Outcome: The proposed method outperforms state-of-the-art systems on clinical notes and on five other datasets to assess its generalizability and performance.

Similar Papers

One-Dimensional Object Detection for Streaming Text Segmentation of Meeting Dialogue (2025.findings-acl)

Copied to clipboard

Challenge: Current text segmentation models exhibit numerous limitations, such as imbalances in labels that affect the stability of model training and discrepancies between the model’s training tasks (sentence classification) and the actual text segmenting.
Approach: They implement a sliding window-based segmentation method and employ two different levels of sliding window based balanced label strategies to stabilize the training process of the streaming segmentation model.
Outcome: The proposed method is robust, controllable, and achieves state-of-the-art performance.
Sequential Span Classification with Neural Semi-Markov CRFs for Biomedical Abstracts (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for dividing biomedical abstracts into rhetorical segments assign a rhetorical label to each sentence while considering context in the abstract.
Approach: They propose to use Neural Semi-Markov Conditional Random Fields to assign a rhetorical label to a span that consists of continuous sentences.
Outcome: The proposed method achieved the best micro sentence-F1 score and the best macro span-F1.
Segmenting Natural Language Sentences via Lexical Unit Analysis (2021.findings-emnlp)

Copied to clipboard

Challenge: Recent work on sequence segmentation models suffer from invalid predictions and a lack of consistency.
Approach: They propose a unified span-based model that embeds every span and computes a score for each segmentation candidate.
Outcome: The proposed model achieves state-of-the-art on 6 of the 3 tasks tested.
Neural Document Segmentation Using Weighted Sliding Windows with Transformer Encoders (2025.coling-industry)

Copied to clipboard

Challenge: Using overlapping text sequences and position-aware weighting, we achieve up to a 10% increase in segmentation F1 score compared to existing methods.
Approach: They propose a Transformer-based method for document segmentation that utilizes overlapping text sequences with a unique position-aware weighting mechanism to enhance segmentation accuracy.
Outcome: The proposed method achieves up to 10% increase in segmentation F1 score compared to existing methods and improves quality of generated responses by 5% while achieving four times greater efficiency.
Neural Sequence Segmentation as Determining the Leftmost Segments (2021.naacl-main)

Copied to clipboard

Challenge: Existing methods to segment sentences are mostly at token level, limiting their full potential to capture long-term dependencies.
Approach: They propose a framework that incrementally segments natural language sentences at segment level.
Outcome: The proposed framework outperforms baseline methods on syntactic chunking and Chinese part-of-speech tagging datasets.
Chapter Captor: Text Segmentation in Novels (2020.emnlp-main)

Copied to clipboard

Challenge: Using a hybrid approach, we identify chapter boundaries in novels . chapter boundaries are typically denoted by formatting conventions such as page breaks, white-space, chapter numbers, and titles.
Approach: They build a project Gutenberg data set of 9,126 English novels to analyze chapter boundaries . they use neural inference and rule matching to recognize chapter title headers .
Outcome: The proposed method achieves an F1 score of 0.77 on the segmentation task . the annotated data reveal interesting historical trends in the chapter structure of novels .
End-to-End Segmentation-based News Summarization (2022.findings-acl)

Copied to clipboard

Challenge: Existing summarization systems only provide one genetic summary of the whole article, making it difficult for users to navigate the reading.
Approach: They propose a task of segmenting a news article into multiple sections and generating the corresponding summary to each section.
Outcome: The proposed model outperforms state-of-the-art models on a 27k news article dataset . it can jointly segment a document and produce the summary for each section .
CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge Notes (2021.acl-long)

Copied to clipboard

Challenge: Continuity of care is crucial to ensuring positive health outcomes for patients discharged from an inpatient hospital setting.
Approach: They propose to annotate clinical action items from a dataset of medical notes annotated by physicians and extract them as multi-aspect extractive summarization.
Outcome: The proposed dataset is annotated by physicians and covers 718 documents representing 100K sentences.
Evaluating Sentence Segmentation in Different Datasets of Neuropsychological Language Tests in Brazilian Portuguese (2020.lrec-1)

Copied to clipboard

Challenge: Using automated analysis of connected speech is a promising direction for diagnosing cognitive impairments.
Approach: They propose to use a novel model to segment impaired speech transcriptions . they propose to include a Linear Chain CRF and a self-attention mechanism .
Outcome: The proposed system performs better than the existing model with three new datasets used to diagnose cognitive impairments.
Toward Unifying Text Segmentation and Long Document Summarization (2022.emnlp-main)

Copied to clipboard

Challenge: Abstractive strategies produce more condensed summaries, but they suffer from hallucinations and factual errors, which pose a more difficult generation challenge.
Approach: They propose a method that learns robust sentence representations by performing summarization and segmentation simultaneously, which is further enhanced by an optimization-based regularizer to promote selection of diverse summary sentences.
Outcome: The proposed model achieves state-of-the-art performance on publicly available benchmarks and better cross-genre transferability when equipped with text segmentation.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations