| Challenge: | morphological analyzers are used to analyze word forms at word level. |
| Approach: | They propose to create an annotated morphological dataset for the Gujarati language that contains 16,527 unique inflected words along with their morphology and grammatical feature tagging information. |
| Outcome: | The proposed dataset contains 16,527 unique inflected words along with their morphological segmentation and grammatical feature tagging information. |
Similar Papers
MorphAGram, Evaluation and Framework for Unsupervised Morphological Segmentation (2020.lrec-1)
Copied to clipboard
| Challenge: | Unsupervised morphological segmentation is beneficial for many natural language processing tasks. |
| Approach: | They propose a framework for unsupervised morphological segmentation that uses Adaptor Grammars. |
| Outcome: | The proposed framework achieves state-of-the-art results across languages of different typologies, from fusional to polysynthetic and from high-resource to low-resourced. |
K-UniMorph: Korean Universal Morphology and its Feature Schema (2023.findings-acl)
Copied to clipboard
| Challenge: | Previously, the Korean language has been underrepresented in the field of morphological paradigms amongst hundreds of diverse world languages. |
| Approach: | They propose a new Universal Morphology dataset for Korean that preserves its distinct characteristics. |
| Outcome: | The proposed dataset extracts inflected Korean verb forms from the largest annotated corpus for Korean. |
Juman++: A Morphological Analysis Toolkit for Scriptio Continua (D18-2)
Copied to clipboard
| Challenge: | a morphological analyzer is useful for languages without natural word boundaries, but it is difficult to improve it without creating costly annotations. |
| Approach: | They propose a toolkit for developing morphological analyzers for languages without natural word boundaries using lattices and neural nets. |
| Outcome: | The proposed morphological analyzer of Japanese achieves new SOTA on Jumandic-based corpora while being 250 times faster than the previous one. |
UniMorph 3.0: Universal Morphology (2020.lrec-1)
Copied to clipboard
Arya D. McCarthy, Christo Kirov, Matteo Grella, Amrit Nidhi, Patrick Xia, Kyle Gorman, Ekaterina Vylomova, Sabrina J. Mielke, Garrett Nicolai, Miikka Silfverberg, Timofey Arkhangelskiy, Nataly Krizhanovsky, Andrew Krizhanovsky, Elena Klyachko, Alexey Sorokin, John Mansfield, Valts Ernštreits, Yuval Pinter, Cassandra L. Jacobs, Ryan Cotterell, Mans Hulden, David Yarowsky
| Challenge: | Explicit modeling of morphology has demonstrable benefits for language modeling, speech recognition, word embedding and keyword search. |
| Approach: | They propose a language-independent feature schema for rich morphological annotation and a type-level resource for annotated data in diverse languages. |
| Outcome: | The proposed schema has been improved to make it more complete and correct, and adds 66 new languages and parts of speech for 12 languages. |
Morphological Segmentation for Low Resource Languages (2020.lrec-1)
Copied to clipboard
Justin Mott, Ann Bies, Stephanie Strassel, Jordan Kodner, Caitlin Richter, Hongzhi Xu, Mitchell Marcus
| Challenge: | a new corpus of annotated morphological data is described for the DARPA LORELEI Program . the data is annotating 9 low resource languages and root information for 7 of the languages . |
| Approach: | This paper describes a new morphology resource created by Linguistic Data Consortium and the University of Pennsylvania for the DARPA LORELEI Program. |
| Outcome: | The annotated corpus provides a gold standard for unsupervised morphological segmenters and analyzers . the language-specific annotation guidelines were language-independent, but included morphology paradigms and other specifications. |
Morphology Without Borders: Clause-Level Morphology (2022.tacl-1)
Copied to clipboard
| Challenge: | Morphological tasks use large multi-lingual datasets that organize words into inflection tables . lack of a clear linguistic and operational definition of what is a word impairs universality of tasks . |
| Approach: | They propose to view morphology as a clause-level phenomenon, rather than word-level . they propose to use a dataset for clause- level morphological tasks in 4 different languages . |
| Outcome: | The proposed dataset for clause-level morphology covers 4 typologically different languages: English, German, Turkish, and Hebrew. |
Wiktionary Normalization of Translations and Morphological Information (2020.coling-main)
Copied to clipboard
| Challenge: | We extend the Yawipa Wiktionary Parser to extract and normalize translations from etymology glosses and morphological form-of relations. |
| Approach: | They extend Yawipa to extract and normalize translations from etymology glosses . they propose a method to identify typos in translation annotations based on extracted morphological data . |
| Outcome: | The proposed method improves on a standard attention baseline by using copy attention. |
UniMorph 4.0: Universal Morphology (2022.lrec-1)
Copied to clipboard
Khuyagbaatar Batsuren, Omer Goldman, Salam Khalifa, Nizar Habash, Witold Kieraś, Gábor Bella, Brian Leonard, Garrett Nicolai, Kyle Gorman, Yustinus Ghanggo Ate, Maria Ryskina, Sabrina Mielke, Elena Budianskaya, Charbel El-Khaissi, Tiago Pimentel, Michael Gasser, William Abbott Lane, Mohit Raj, Matt Coler, Jaime Rafael Montoya Samame, Delio Siticonatzi Camaiteri, Esaú Zumaeta Rojas, Didier López Francis, Arturo Oncevay, Juan López Bautista, Gema Celeste Silva Villegas, Lucas Torroba Hennigen, Adam Ek, David Guriel, Peter Dirix, Jean-Philippe Bernardy, Andrey Scherbakov, Aziyana Bayyr-ool, Antonios Anastasopoulos, Roberto Zariquiey, Karina Sheifer, Sofya Ganieva, Hilaria Cruz, Ritván Karahóǧa, Stella Markantonatou, George Pavlidis, Matvey Plugaryov, Elena Klyachko, Ali Salehi, Candy Angulo, Jatayu Baxi, Andrew Krizhanovsky, Natalia Krizhanovskaya, Elizabeth Salesky, Clara Vania, Sardana Ivanova, Jennifer White, Rowan Hall Maudslay, Josef Valvoda, Ran Zmigrod, Paula Czarnowska, Irene Nikkarinen, Aelita Salchak, Brijesh Bhatt, Christopher Straughn, Zoey Liu, Jonathan North Washington, Yuval Pinter, Duygu Ataman, Marcin Wolinski, Totok Suhardijanto, Anna Yablonskaya, Niklas Stoehr, Hossep Dolatian, Zahroh Nuriah, Shyam Ratan, Francis M. Tyers, Edoardo M. Ponti, Grant Aiton, Aryaman Arora, Richard J. Hatcher, Ritesh Kumar, Jeremiah Young, Daria Rodionova, Anastasia Yemelina, Taras Andrushko, Igor Marchenko, Polina Mashkovtseva, Alexandra Serova, Emily Prud’hommeaux, Maria Nepomniashchaya, Fausto Giunchiglia, Eleanor Chodroff, Mans Hulden, Miikka Silfverberg, Arya D. McCarthy, David Yarowsky, Ryan Cotterell, Reut Tsarfaty, Ekaterina Vylomova
| Challenge: | The Universal Morphology project provides broad-coverage instantiated morphological inflection tables for hundreds of diverse languages. |
| Approach: | They propose a language-independent feature schema for rich morphological annotation and a type-level resource of annotated data in diverse languages realizing that schema. |
| Outcome: | The proposed schema has added 66 new languages, including 24 endangered languages. |
UniMorph 2.0: Universal Morphology (L18-1)
Copied to clipboard
Christo Kirov, Ryan Cotterell, John Sylak-Glassman, Géraldine Walther, Ekaterina Vylomova, Patrick Xia, Manaal Faruqui, Sabrina J. Mielke, Arya McCarthy, Sandra Kübler, David Yarowsky, Jason Eisner, Mans Hulden
| Challenge: | The Universal Morphology project is a collaborative effort to improve how NLP handles complex morphology across the world's languages. |
| Approach: | They propose to use a universal tagset to annotate morphological data using a schema that includes a lemma and a bundle of morphology features. |
| Outcome: | The project releases annotated morphological data using a universal tagset, the UniMorph schema. |
Morphology Matters: A Multilingual Language Modeling Analysis (2021.tacl-1)
Copied to clipboard
| Challenge: | Existing studies on inflectional morphology disagree on whether or not it makes languages harder to model. |
| Approach: | They propose to use a corpus of 145 Bible translations in 92 languages to investigate whether inflectional morphology makes languages harder to model. |
| Outcome: | The proposed model trains with linguistically motivated subword segmentation strategies and reduces the impact of morphology on language modeling. |