A unified approach to sentence segmentation of punctuated text in many languages (2021.acl-long)
Copied to clipboard
| Challenge: | Existing tools for segmenting punctuated text in many languages are limited in their language coverage and evaluation is ad hoc. |
| Approach: | They propose a new context-based modeling approach that can be trained on noisily-annotated data. |
| Outcome: | The proposed model exceeds baselines set by existing methods on English corpora and performs well on average on new multilingual evaluation set. |
Similar Papers
Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Sentence segmentation is a key task in many NLP systems, but no prior method has achieved all of the features needed to segment a text into sentences. |
| Approach: | They propose a new model that uses punctuation to enhance robustness and adaptability. |
| Outcome: | The proposed model outperforms baselines across 8 corpora across diverse domains and languages and is available under the MIT license. |
Where’s the Point? Self-Supervised Multilingual Punctuation-Agnostic Sentence Segmentation (2023.acl-long)
Copied to clipboard
| Challenge: | Prior sentence segmentation tools rely on punctuation or require a large amount of training data . a new method for multilingual sentence segmenting is proposed to replace the best prior tools by using only sentence-segmented examples. |
| Approach: | They propose a punctuation-agnostic sentence segmentation method that uses newline characters which implicitly perform segmentation into paragraphs. |
| Outcome: | The proposed method outperforms all prior best sentence segmentation tools by 6.1% F1 points. |
Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges (2025.acl-long)
Copied to clipboard
Bolei Ma, Yuting Li, Wei Zhou, Ziwei Gong, Yang Janet Liu, Katja Jasinskaja, Annemarie Friedrich, Julia Hirschberg, Frauke Kreuter, Barbara Plank
| Challenge: | linguistics studies how context influences meaning of language and how people use it to convey implied meanings, emotions, and intentions. |
| Approach: | They analyze task designs, data collection methods, evaluation approaches and their relevance to real-world applications. |
| Outcome: | The findings highlight emerging trends, challenges, and gaps in existing benchmarks . the findings will contribute to more nuanced and context-aware NLP models . |
Sentence Compression for Arbitrary Languages via Multilingual Pivoting (D18-1)
Copied to clipboard
| Challenge: | a new study advocates the use of bilingual corpora for sentence compression models . previous work focused on word deletion, while others view sentence compression as a general text rewriting problem. |
| Approach: | They propose to use bilingual corpora for training sentence compression models. |
| Outcome: | The proposed model can be trained for any language as long as a bilingual corpus is available . it performs arbitrary rewrites without access to compression specific data . |
Recent Trends in Linear Text Segmentation: A Survey (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Linear text segmentation is the task of automatically tagging text documents with topic shifts . the task is based on coherence modeling and/or local cues to identify topic boundaries . |
| Approach: | They provide an overview of current advances in linear text segmentation . they highlight limitations of available resources and of the task itself . |
| Outcome: | The proposed task is based on the most recent literature and under-explored research directions. |
Unsupervised Subtitle Segmentation with Masked Language Models (2023.acl-short)
Copied to clipboard
| Challenge: | Existing methods to improve subtitle segmentation are based on character counting and linguistically correct segmentation. |
| Approach: | They propose a method where subtitle breaks are predicted according to likelihood of punctuation . their approach is highly portable across languages and domains . |
| Outcome: | The proposed method obtained competitive results in terms of segmentation accuracy across metrics while also fully preserving the original text and complying with length constraints. |
Towards Universal Segmentations: UniSegments 1.0 (2022.lrec-1)
Copied to clipboard
Zdeněk Žabokrtský, Niyati Bafna, Jan Bodnár, Lukáš Kyjánek, Emil Svoboda, Magda Ševčíková, Jonáš Vidra
| Challenge: | Existing data resources for morphological segmentation are limited to 32 languages . a large number of word forms exist, with some sub-parts being "recycled" many times . |
| Approach: | They propose a multilingual data resource for morphological segmentation in 32 languages . they analyze diversity of how individual linguistic phenomena are captured across them . |
| Outcome: | The proposed scheme is based on 17 existing data resources relevant for segmentation in 32 languages. |
The DReaM Corpus: A Multilingual Annotated Corpus of Grammars for the World’s Languages (2020.lrec-1)
Copied to clipboard
| Challenge: | Until recently, language descriptions were available in paper form only, with indexes as the only search aid. |
| Approach: | They propose to digitize a multilingual corpus of language descriptions and annotate it with various meta, word, and text attributes to make searching and analysis easier and more useful. |
| Outcome: | The proposed corpus is searchable through a couple of well-established corpus infrastructures. |
A Survey on Cross-Lingual Summarization (2022.tacl-1)
Copied to clipboard
| Challenge: | Cross-lingual summarization is a task of generating a summary in one language for a given document in a different language. |
| Approach: | They present a systematic review of the literature on cross-lingual summarization . they summarize previous efforts and compare them with each other . |
| Outcome: | The proposed approach is compared with previous approaches and summarizes them to provide a deeper analysis. |
Evaluating Historical Text Normalization Systems: How Well Do They Generalize? (N18-2)
Copied to clipboard
| Challenge: | Historical text normalization systems aim to convert historical wordforms to their modern equivalents . many of these systems have been developed and tested on a single language . |
| Approach: | They propose to use a nave baseline system to evaluate historical text normalization systems . they show that the models generalize well to unseen words in tests on five languages . |
| Outcome: | The proposed models generalize well to unseen words on five languages, but provide no clear benefit over the nave baseline. |