Papers by Marion Marco
Subword Segmentation in LLMs: Looking at Inflection and Consistency (2024.emnlp-main)
Copied to clipboard
| Challenge: | Subword segmentation is not linguistically guided and is not currently well understood in LLMs. |
| Approach: | They group words according to their segmentation properties and compare how well a model can solve a linguistic task for these groups using two criteria: adherence to morpheme boundaries and segmentation consistency of inflected forms of a lemma. |
| Outcome: | The results show that the criterion of segmentation consistency can predict the model’s ability to recognize and generate the lemma from an inflected form, providing evidence that subword segmentation is relevant. |