An Unsupervised Framework for Adaptive Context-aware Simplified-Traditional Chinese Character Conversion (2024.lrec-main)
Copied to clipboard
| Challenge: | Traditional Chinese characters are still widely used in many areas of China . traditional methods to convert between simplified characters are ineffective . |
| Approach: | They propose an unsupervised adaptive context-aware conversion model that learns to convert between simplified and traditional Chinese characters under a denoising auto-encoder framework. |
| Outcome: | The proposed model outperforms strong unsupervised baselines and yields better conversion result for one-to-many cases. |
Similar Papers
An Alignment-Agnostic Model for Chinese Text Error Correction (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for Chinese text error correction can correct mistaken, missing and redundant characters, but they cannot handle missing or redundant characters. |
| Approach: | They propose an alignment-agnostic framework to correct Chinese text errors . framework detects missing and redundant characters and can be used as a cold start model . |
| Outcome: | The proposed framework can handle both text aligned and non-aligned situations and can serve as a cold start model when no annotation data are provided. |
Improving Chinese Story Generation via Awareness of Syntactic Dependencies and Semantics (2022.aacl-short)
Copied to clipboard
| Challenge: | Current neural models for Chinese story generation struggle to generate high-quality long text narratives due to ambiguity in syntactically parsing the Chinese language. |
| Approach: | They propose a framework that enhances the feature capturing mechanism by informing the generation model of dependencies between words and additionally augmenting the semantic representation learning through synonym denoising training. |
| Outcome: | The proposed framework outperforms the state-of-the-art Chinese generation models on all evaluation metrics, showing that it enhances dependency and semantic representation learning. |
VarMAE: Pre-training of Variational Masked Autoencoder for Domain-adaptive Language Understanding (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models have been widely applied to standard benchmarks due to the limited resources available in a domain. |
| Approach: | They propose a Transformer-based language model called VarMAE for domain-adaptive language understanding that encodes the context of a token into a smooth latent distribution. |
| Outcome: | Experiments on science- and finance-domain NLU tasks show that the proposed model can be efficiently adapted to new domains with limited resources. |
Enhancing Pre-trained Chinese Character Representation with Word-aligned Attention (2020.acl-main)
Copied to clipboard
| Challenge: | Pre-trained Chinese language models take character as the basic unit and learn representation according to character’s external contexts, ignoring the semantics expressed in the word, which is the smallest meaningful utterance in Chinese. |
| Approach: | They propose to pool character-level attention to the word level and propose to alleviate the potential issue of segmentation error propagation by multi-source information fusion. |
| Outcome: | The proposed approach improves on five Chinese NLP benchmark tasks against BERT, ERNIE and BERT-wwm. |
Unsupervised Cross-Lingual Adaptation of Dependency Parsers Using CRF Autoencoders (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work on cross-lingual adaptation of dependency parsers without annotated target corpora focuses on discriminative source parser ignoring unannotated corporata . |
| Approach: | They propose to use unsupervised discriminative parsers to adapt dependency parser to unannotated target corpora without a supervised generative parsing method. |
| Outcome: | The proposed method significantly outperforms previous methods. |
Chinese Grammatical Correction Using BERT-based Pre-trained Model (2020.aacl-main)
Copied to clipboard
| Challenge: | Recent studies have shown that pre-trained models improve performance on downstream tasks. |
| Approach: | They propose to incorporate a pre-trained model into an encoder-decoder model to improve the performance of Chinese grammatical error correction tasks. |
| Outcome: | The proposed method improves the performance of Chinese grammatical error correction tasks. |
HL-EncDec: A Hybrid-Level Encoder-Decoder for Neural Response Generation (C18-1)
Copied to clipboard
| Challenge: | Existing models for conversation systems operate sentences at word-level . word-based models suffer from Unknown Words Issue and Preference Issue . |
| Approach: | They propose a hybrid-level Encoder-Decoder model which utilizes word-level features and character-level ones. |
| Outcome: | The proposed model outperforms non-word-level models in automatic metrics and human annotations on a Chinese corpus. |
Sub-Character Tokenization for Chinese Pretrained Language Models (2023.tacl-1)
Copied to clipboard
Chenglei Si, Zhengyan Zhang, Yingfa Chen, Fanchao Qi, Xiaozhi Wang, Zhiyuan Liu, Yasheng Wang, Qun Liu, Maosong Sun
| Challenge: | Existing tokenization methods for Chinese PLMs treat each character as an indivisible token, but ignore the unique feature of the writing system where additional linguistic information exists below the character level. |
| Approach: | They propose to encode Chinese characters into short sequences and construct Chinese vocabulary based on the encoded text. |
| Outcome: | The proposed tokenizers can tokenize inputs into much shorter sequences, improving computational efficiency. |
Unsupervised Neural Text Simplification (P19-1)
Copied to clipboard
| Challenge: | Existing unsupervised methods for text simplification are limited to unlabeled text . paper aims to improve the performance of unsupervised systems by incorporating labeled pairs . |
| Approach: | They propose to use unlabeled text to train a neural text simplification framework . they propose to add a pair of attentional-decoders to the framework to improve performance . |
| Outcome: | The proposed model outperforms existing supervised methods on public test data. |
CUE Vectors: Modular Training of Language Models Conditioned on Diverse Contextual Signals (2022.findings-acl)
Copied to clipboard
| Challenge: | Using contextual universal embeddings, we train neural language models on one type of contextual data and adapts to novel context types. |
| Approach: | They propose a framework to modularize the training of neural language models that use diverse forms of context by eliminating the need to jointly train context and within-sentence encoders. |
| Outcome: | The proposed framework trains LMs on one type of contextual data and adapts to novel context types. |