| Challenge: | evaluating distributed word representations in languages that do not have such resources is difficult . et al., 2015: distributed word represent a sparse vector indicating the word itself or the context of the word. |
| Approach: | They constructed a Japanese word similarity dataset to evaluate distributed representations in Japanese. |
| Outcome: | a Japanese word similarity dataset is the first resource that can be used to evaluate distributed representations in Japanese . the dataset contains various parts of speech and includes rare words in addition to common words . |
Similar Papers
Learning Word Vectors for 157 Languages (L18-1)
Copied to clipboard
| Challenge: | Distributed word representations, or word vectors, have been used in natural language processing for many tasks. |
| Approach: | They propose to use the encyclopedia Wikipedia and the common crawl corpus to train distributed word representations on large corpora and use them in downstream tasks. |
| Outcome: | The proposed model performs very well on 10 languages for which evaluation dataset exists. |
Word Complexity Estimation for Japanese Lexical Simplification (2020.lrec-1)
Copied to clipboard
| Challenge: | Experimental results show that the proposed method achieves the highest performance of Japanese lexical simplification. |
| Approach: | They propose a large-scale word complexity lexicon, a synonym lexicone and a toolkit for developing and benchmarking Japanese lexical simplification systems. |
| Outcome: | The proposed method achieves the highest performance of Japanese lexical simplification. |
A Document-Level Text Simplification Dataset for Japanese (2024.lrec-main)
Copied to clipboard
| Challenge: | Document-level text simplification tasks combine summarization and intra-sentence simplification. |
| Approach: | They devised a Japanese document-level text simplification dataset based on newspaper articles and Wikipedia. |
| Outcome: | The proposed dataset compared Japanese document-level text simplification models with English models and newspaper articles. |
Advances in Pre-Training Distributed Word Representations (L18-1)
Copied to clipboard
| Challenge: | Pre-trained word representations are a building block of many Natural Language Processing and Machine Learning applications. |
| Approach: | They propose to combine known tricks and a set of publicly available pre-trained word vector representations to train high-quality representations. |
| Outcome: | The proposed models outperform the current state of the art on a number of tasks while maintaining a high training speed to scale to massive amount of data. |
Cross-lingual Transfer Learning for Japanese Named Entity Recognition (N19-2)
Copied to clipboard
| Challenge: | a recent study focuses on bootstrapping named entity models from English to Japanese . TL is a technique that overcomes linguistic differences between the target and source languages . |
| Approach: | They propose to use a deep neural network model to transfer weights between languages . they also propose a novel approach that romanizes a portion of the Japanese input . |
| Outcome: | The proposed approach overcomes linguistic differences by romanizing a portion of the Japanese input. |
On the Correlation of Word Embedding Evaluation Metrics (2020.lrec-1)
Copied to clipboard
| Challenge: | Word embeddings are geometrical representations of word paradigmatics and syntagmatics. |
| Approach: | They propose to investigate evaluation metrics on various datasets to find correlations . they propose a fast solution to select the best word embeddings among many others . |
| Outcome: | The proposed method could be used to select the best word embeddings among many others. |
Analyzing the Surprising Variability in Word Embedding Stability Across Languages (2021.emnlp-main)
Copied to clipboard
| Challenge: | Word embeddings are powerful representations that form the foundation of many natural language processing architectures. |
| Approach: | They explore word embedding stability in a wide range of languages to gain insight into their stability. |
| Outcome: | The proposed results provide insights into word embedding stability in English and other languages. |
Subword-level Word Vector Representations for Korean (P18-1)
Copied to clipboard
| Challenge: | Existing research on word vectors for English focuses on decomposing words into subword units and using subwords to improve performance. |
| Approach: | They propose to decompose Korean words into the jamo-level, beyond the character-level . they develop Korean test sets for word similarity and analogy and make them publicly available . |
| Outcome: | The proposed method outperforms word2vec and character-level skip-grams on similarity and analogy tasks and contributes positively toward downstream NLP tasks such as sentiment analysis. |
JGLUE: Japanese General Language Understanding Evaluation (2022.lrec-1)
Copied to clipboard
| Challenge: | There is no benchmark for Japanese to evaluate and analyze NLU ability from different perspectives. |
| Approach: | They build a Japanese NLU benchmark from scratch without translation to measure general NLU ability in Japanese. |
| Outcome: | a Japanese NLU benchmark is built from scratch without translation to measure general NLU ability in Japanese. |
Building a List of Synonymous Words and Phrases of Japanese Compound Verbs (L18-1)
Copied to clipboard
| Challenge: | Japanese is rich in compound verbs consisting of two verbs joined together. |
| Approach: | They built a database of Japanese "Verb + Verb" compounds semi-automatically . they extracted Japanese compound verbs from corpus and found suitable clusters . |
| Outcome: | The proposed database extracts synonymous expressions of Japanese compound verbs from corpus . it then links the results to the "Compound Verb Lexicon" |