Papers by Zhi-Hong Deng
Prefix-Tuning Based Unsupervised Text Style Transfer (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Unsupervised text style transfer is an important task in computer vision and natural language processing. |
| Approach: | They propose a method that uses pre-trained large language models to train a generative model that can alter the style of the input sentence without using any parallel data. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on well-known datasets. |
Dual-Alignment Pre-training for Cross-lingual Sentence Embedding (2023.acl-long)
Copied to clipboard
Ziheng Li, Shaohan Huang, Zihan Zhang, Zhi-Hong Deng, Qiang Lou, Haizhen Huang, Jian Jiao, Furu Wei, Weiwei Deng, Qi Zhang
| Challenge: | Recent studies have shown that dual encoder models trained with the sentence-level translation ranking task are effective methods for cross-lingual sentence embedding. |
| Approach: | They propose a dual-alignment pre-training framework that incorporates both sentence-level and token-level alignment. |
| Outcome: | The proposed framework improves cross-lingual sentence embedding on three cross-linguistic benchmarks. |
Unsupervised Neural Word Segmentation for Chinese via Segmental Language Modeling (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to unsupervised Chinese word segmentation (CWS) are discriminative and generative, but they are non-trivial. |
| Approach: | They propose a neural generative model for fully unsupervised Chinese word segmentation (CWS) their approach explicitly focuses on the segmental nature of Chinese, and preserves several properties of language models. |
| Outcome: | The proposed model achieves competitive performance to the state-of-the-art models on four datasets from SIGHAN 2005 bakeoff. |