Beyond Distribution: Investigating Language Models’ Understanding of Sino-Korean Morphemes (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Transformer-based language models can learn compositional morphology of SK morphemes . morphological models trained on Hangul text can learn SK, but performance is based on frequency of words . |
| Approach: | They investigate whether Transformer-based language models can learn compositional morphology of Sino-Korean morphemes. |
| Outcome: | The proposed models learn the compositional morphology of SK morphemes from real and fake pairs. |
Similar Papers
Diversifying language models for lesser-studied languages and language-usage contexts: A case of second language Korean (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing morpheme parsers/taggers do not work reliably and optimally for L2 data. |
| Approach: | They train a neural network model on varying L2 datasets and measure its morpheme parsing/POS tagging performance on L2 test sets. |
| Outcome: | The proposed model excels in domain-specific tokenization and POS tagging compared to the baseline model. |
Korean Language Modeling via Syntactic Guide (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing research on pre-trained language models focuses on widely-used languages . however, not every language can benefit from such models due to computational resources . |
| Approach: | They propose to build a pre-trained language model that understands the linguistic phenomena in the target language with low resources. |
| Outcome: | The proposed model improves the performance of Korean language understanding tasks. |
Morpheme Matters: Morpheme-Based Subword Tokenization for Korean Language Models (2026.eacl-short)
Copied to clipboard
| Challenge: | Existing tokenizers rely on frequency-based segmentation to represent words . this often leads to inefficient token representations and oversegmentation . |
| Approach: | They propose a tokenization method that emphasizes the importance of Korean morphological structures in eojeol. |
| Outcome: | The proposed method outperforms existing tokenizers on Korean benchmark tasks and produces significantly fewer tokens per input sequence. |
Yet Another Format of Universal Dependencies for Korean (2022.coling-1)
Copied to clipboard
Yige Chen, Eunkyul Leah Jo, Yundong Yao, KyungTae Lim, Miikka Silfverberg, Francis M. Tyers, Jungyeul Park
| Challenge: | Existing dependency parsers for Korean do not perform as well as their English counterparts due to the complexity of Korean's linguistic features. |
| Approach: | They propose a morpheme-based Korean dependency parsing format and propose to adopt it to Universal Dependencies. |
| Outcome: | The proposed format outperforms parsing results for Korean UD treebanks and detailed error analysis. |
BERT-like Models for Slavic Morpheme Segmentation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing morpheme segmentation algorithms for Slavic languages have been improved but performance is still low for words with roots not present in training data. |
| Approach: | They propose to fine-tune BERT-like models for morpheme segmentation using data from Belarusian, Czech, and Russian to account for word semantics. |
| Outcome: | The proposed models outperform all previous approaches in Czech and Russian, with word-level accuracy of 92.5-95.1%. |
A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation (2022.findings-naacl)
Copied to clipboard
Jaehyung Seo, Seounghoon Lee, Chanjun Park, Yoonna Jang, Hyeonseok Moon, Sugyeong Eo, Seonmin Koo, Heuiseok Lim
| Challenge: | Korean pretrained language models struggle to generate short sentences with a given condition based on compositionality and commonsense reasoning. |
| Approach: | They propose a Korean text-generation dataset for Korean generative commonsense reasoning and language model evaluation using a semi-automatic dataset construction approach. |
| Outcome: | The proposed dataset is available at http://aihub.or.kr/opendata/korea-university. |
Getting The Most Out of Your Training Data: Exploring Unsupervised Tasks for Morphological Inflection (2024.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained transformers have been shown to be effective in many natural language tasks, but are under-explored for character-level sequence to sequence tasks. |
| Approach: | They propose to use pre-trained transformers for character-level morphological inflection in several languages to train models for unsupervised tasks. |
| Outcome: | The proposed model outperforms the best two shared tasks on morphological inflection and graphemeto-phoneme conversion benchmarks. |
Don’t Just Scratch the Surface: Enhancing Word Representations for Korean with Hanja (D19-1)
Copied to clipboard
| Challenge: | Existing knowledge of Korean and Chinese is based on cultural and historical reasons. |
| Approach: | They propose a method for improving Korean word representations using additional linguistic annotation by leveraging the fact that Hanja is closely related to Chinese. |
| Outcome: | The proposed approach improves representations on a novel Korean news headline generation task. |
A Primer in BERTology: What We Know About How BERT Works (2020.tacl-1)
Copied to clipboard
| Challenge: | a new study examines the current state of knowledge about the BERT model . the model is a stack of transformer encoder layers that are based on multiple self-attention ''heads'' |
| Approach: | They present a survey of over 150 studies of the popular Transformer-based model BERT . they discuss the current state of knowledge about how BERT works and how it is represented . |
| Outcome: | The proposed model is based on the Transformer-based model with state-of-the-art results . the proposed model has little cognitive motivation and is too small to perform ablation studies . |
Subword-level Word Vector Representations for Korean (P18-1)
Copied to clipboard
| Challenge: | Existing research on word vectors for English focuses on decomposing words into subword units and using subwords to improve performance. |
| Approach: | They propose to decompose Korean words into the jamo-level, beyond the character-level . they develop Korean test sets for word similarity and analogy and make them publicly available . |
| Outcome: | The proposed method outperforms word2vec and character-level skip-grams on similarity and analogy tasks and contributes positively toward downstream NLP tasks such as sentiment analysis. |