Papers by Gal Astrach
Probing Subphonemes in Morphology Models (2025.findings-acl)
Copied to clipboard
| Challenge: | morphological inflection models have achieved state-of-the-art performance, yet their ability to generalize across languages and morphology rules remains limited. |
| Approach: | They propose a language-agnostic probing method to investigate phonological feature encoding in transformers trained directly on phonemes and perform it across seven morphologically diverse languages. |
| Outcome: | The proposed method shows that phonological features which are local are captured well in phoneme embeddings, whereas long-distance dependencies like vowel harmony are better represented in the transformer’s encoder. |