Back to Patterns: Efficient Japanese Morphological Analysis with Feature-Sequence Trie (2023.acl-short)
Copied to clipboard
| Challenge: | Accurate neural models are less efficient than non-neural models and are useless for processing billions of social media posts and handling user queries. |
| Approach: | They propose to make fast pattern-based NLP methods as accurate as possible . they propose a morphological analyzer for Japanese that induces reliable patterns . |
| Outcome: | The proposed method induces reliable patterns from a morphological dictionary and annotated data in Japanese. |
Similar Papers
Shrinking Japanese Morphological Analyzers With Neural Networks and Semi-supervised Learning (N19-1)
Copied to clipboard
| Challenge: | Modern neural morphological analyzers consume gigabytes of memory. |
| Approach: | They propose a method which uses unigram character embeddings to train a model on labels produced by a state-of-the-art analyzer. |
| Outcome: | The proposed model outperforms dictionary-based methods in Japanese and Chinese . it uses less than 15 megabytes of space and is much smaller than the dictionary- based one . |
Juman++: A Morphological Analysis Toolkit for Scriptio Continua (D18-2)
Copied to clipboard
| Challenge: | a morphological analyzer is useful for languages without natural word boundaries, but it is difficult to improve it without creating costly annotations. |
| Approach: | They propose a toolkit for developing morphological analyzers for languages without natural word boundaries using lattices and neural nets. |
| Outcome: | The proposed morphological analyzer of Japanese achieves new SOTA on Jumandic-based corpora while being 250 times faster than the previous one. |
User-Generated Text Corpus for Evaluating Japanese Morphological Analysis and Lexical Normalization (2021.naacl-main)
Copied to clipboard
| Challenge: | Morphological analysis (MA) and lexical normalization (LN) are important tasks for Japanese user-generated text. |
| Approach: | They construct a publicly available Japanese UGT corpus annotated with morphological and normalization information. |
| Outcome: | The proposed corpus shows low performance for non-general words and non-standard forms . morphological analysis is an important task in Japanese user-generated text . |
A Japanese Word Segmentation Proposal (P19-2)
Copied to clipboard
| Challenge: | Current word segmentation methods may produce different segmentations for the same strings . this occurs when strings appear in different sentences . |
| Approach: | They propose to use Japanese word segmentation methods that use a morpheme-based approach to produce different segmentations for the same strings. |
| Outcome: | The proposed method produces much more consistent segmentation than the current morpheme-based one. |
Unsupervised Morphology Learning with Statistical Paradigms (C18-1)
Copied to clipboard
| Challenge: | Existing models treat words as concatenation of morphemes, but some use transformations like rewrite rules to recognize dependencies between morphs. |
| Approach: | They propose an unsupervised model that exploits the notion of paradigms for morphological segmentation that can be applied to a homogeneous set of words. |
| Outcome: | The proposed model significantly improves on the Morpho-Challenge dataset in English, Turkish, and Finnish. |
Minimally-Supervised Morphological Segmentation using Adaptor Grammars with Linguistic Priors (2021.findings-acl)
Copied to clipboard
Ramy Eskander, Cass Lowry, Sujay Khandagale, Francesca Callejas, Judith Klavans, Maria Polinsky, Smaranda Muresan
| Challenge: | Unsupervised morphological segmentation is an essential subtask in many natural language processing applications. |
| Approach: | They introduce two types of priors: grammar definition and linguist-provided affixes . they show that priors boost morphological segmentation performance in a minimally-supervised manner . |
| Outcome: | The proposed priors achieve 8.9% and 34.2% error reductions over the state-of-the-art unsupervised system. |
Wiktionary Normalization of Translations and Morphological Information (2020.coling-main)
Copied to clipboard
| Challenge: | We extend the Yawipa Wiktionary Parser to extract and normalize translations from etymology glosses and morphological form-of relations. |
| Approach: | They extend Yawipa to extract and normalize translations from etymology glosses . they propose a method to identify typos in translation annotations based on extracted morphological data . |
| Outcome: | The proposed method improves on a standard attention baseline by using copy attention. |
Using Morphological Knowledge in Open-Vocabulary Neural Language Models (N18-1)
Copied to clipboard
| Challenge: | Existing models that generate words from a fixed vocabulary are linguistically nave . authors present an open-vocabulary language model that incorporates morphological knowledge into a neural framework . |
| Approach: | They propose a model that incorporates morphological knowledge into a neural model by generating words as a sequence of characters, generating full word forms and combining them with a hand-written morphology analyzer. |
| Outcome: | The proposed model outperforms character-based models on Finnish, Turkish, and Russian on three languages. |
Korean Morphological Analysis with Tied Sequence-to-Sequence Multi-Task Model (D19-1)
Copied to clipboard
| Challenge: | Korean morphological analysis is a sequence of morpheme processing and POS tagging. |
| Approach: | They propose a tied sequence-to-sequence multi-task model for training the two tasks simultaneously without any explicit regularization. |
| Outcome: | The proposed model achieves state-of-the-art performance without any explicit regularization. |
Rich Character-Level Information for Korean Morphological Analysis and Part-of-Speech Tagging (C18-1)
Copied to clipboard
| Challenge: | Korean is a highly agglutinative, character-rich language, requiring dictionary-less morphological analysis . a novel model can perform morphology and part-of-speech tagging without prior knowledge . |
| Approach: | They propose a multi-stage action-based model that performs morphological transformation and part-of-speech tagging using arbitrary units of input. |
| Outcome: | The proposed model achieves state-of-the-art word and sentence-level tagging accuracy with Korean corpus. |