Papers with LLACA
Segment First or Comprehend First? Explore the Limit of Unsupervised Word Segmentation with Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to measure word segmentation only assess the language model's understanding of the overall meaning of sentences, lacking an evaluation of the language models' understanding capabilities at a fine-grained level. |
| Approach: | They propose a framework to explore the limit of unsupervised word segmentation with Large Language Models (LLMs) they employ current mainstream LLMs to perform word segmentations across multiple languages . |
| Outcome: | The proposed method improves on existing methods and combines the advanced pattern recognition capabilities of Aho-Corasick automata with the deep insights of well-pretrained LLMs. |