Papers by Zhongli Li
Harvesting and Refining Question-Answer Pairs for Unsupervised QA (2020.acl-main)
Copied to clipboard
| Challenge: | Recent research attempts to extend unsupervised question answering to settings with few or no labeled data available. |
| Approach: | They propose two approaches to improve unsupervised question answering . first, they harvest lexically and syntactically divergent Wikipedia questions to automatically construct a corpus of question-answer pairs . second, they take advantage of the QA model to extract more appropriate answers . |
| Outcome: | The proposed approach outperforms previous unsupervised approaches by a large margin and is competitive with early supervised models. |
Towards Real-World Writing Assistance: A Chinese Character Checking Benchmark with Faked and Misspelled Characters (2024.acl-long)
Copied to clipboard
Yinghui Li, Zishan Xu, Shaoshen Chen, Haojing Huang, Yangning Li, Shirong Ma, Yong Jiang, Zhongli Li, Qingyu Zhou, Hai-Tao Zheng, Ying Shen
| Challenge: | Existing studies focus on misspelled characters, ignoring faked characters which are more common and difficult to correct. |
| Approach: | They propose to use Chinese character checking to identify and correct wrong characters in texts by human annotation. |
| Outcome: | The proposed dataset is the first real-world visual and the largest human-crafted dataset for the Chinese character checking scenario. |
Type-Driven Multi-Turn Corrections for Grammatical Error Correction (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on data augmentation to combat exposure bias . but data augmented models lack the ability to recognize the procedure of gradual corrections . |
| Approach: | They propose a type-driven multi-turn corrections approach that uses multiple training instances to train dominant models. |
| Outcome: | The proposed model achieves state-of-the-art single-model performance on English GEC benchmarks. |
Seeking Patterns, Not just Memorizing Procedures: Contrastive Learning for Solving Math Word Problems (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing models memorize procedures from context and rely on shallow heuristics to solve MWPs. |
| Approach: | They propose a contrastive learning approach where the neural network perceives the divergence of patterns. |
| Outcome: | The proposed method greatly improves performance in monolingual and multilingual settings. |
Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell Checking (2021.findings-acl)
Copied to clipboard
| Challenge: | Chinese Spell Checking (CSC) aims to detect and correct erroneous characters for usergenerated text in Chinese. |
| Approach: | They propose a Chinese spell checker that leverages multimodal Chinese characters' information to predict the correct output. |
| Outcome: | The proposed model outperforms strong baselines on the SIGHAN benchmarks by a large margin. |
AiM: Taking Answers in Mind to Correct Chinese Cloze Tests in Educational Applications (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to correct handwritten assignments are to use OCR to recognize characters and compare them to answers. |
| Approach: | They propose a multimodal approach to correct handwritten Chinese characters by combining the visual information of students' handwriting with the encoded representations of answers. |
| Outcome: | The proposed model outperforms OCR-based methods by a large margin. |
Linguistic Rules-Based Corpus Generation for Native Chinese Grammatical Error Correction (2022.findings-emnlp)
Copied to clipboard
Shirong Ma, Yinghui Li, Rongyi Sun, Qingyu Zhou, Shulin Huang, Ding Zhang, Li Yangning, Ruiyang Liu, Zhongli Li, Yunbo Cao, Haitao Zheng, Ying Shen
| Challenge: | Chinese Grammatical Error Correction (CGEC) is a challenging NLP task and a common application in human daily life. |
| Approach: | They propose a linguistic rules-based approach to construct large-scale CGEC training corpora with automatically generated grammatical errors. |
| Outcome: | The proposed method improves performance of existing CGEC models and the benchmark is excellent resource for further development. |
Learning from the Dictionary: Heterogeneous Knowledge Guided Fine-tuning for Chinese Spell Checking (2022.findings-emnlp)
Copied to clipboard
Yinghui Li, Shirong Ma, Qingyu Zhou, Zhongli Li, Li Yangning, Shulin Huang, Ruiyang Liu, Chao Li, Yunbo Cao, Haitao Zheng
| Challenge: | Chinese Spell Checking (CSC) aims to detect and correct Chinese spelling errors. |
| Approach: | They propose a framework which renders Chinese Spell Checking model to learn heterogeneous knowledge from the dictionary in terms of phonetics, vision, and meaning. |
| Outcome: | The proposed framework renders the CSC model to learn heterogeneous knowledge from the dictionary in terms of phonetics, vision, and meaning. |
Improving BERT with Syntax-aware Local Attention (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that attention-based models benefit from more focused attention over local regions. |
| Approach: | They propose a syntax-aware local attention which restrains attention over syntactically relevant words. |
| Outcome: | The proposed model performs better on all benchmark datasets, including sentence classification and sequence labeling tasks. |
The Past Mistake is the Future Wisdom: Error-driven Contrastive Probability Optimization for Chinese Spell Checking (2022.findings-acl)
Copied to clipboard
Yinghui Li, Qingyu Zhou, Yangning Li, Zhongli Li, Ruiyang Liu, Rongyi Sun, Zizhen Wang, Chao Li, Yunbo Cao, Hai-Tao Zheng
| Challenge: | Chinese Spell Checking (CSC) aims to detect and correct spelling errors, which are caused by the phonological or visual similarity. |
| Approach: | They propose an Error-driven COntrastive Probability Optimization framework to refine the knowledge representations of pre-trained language models to avoid predicting common characters. |
| Outcome: | Extensive experiments and detailed analyses on SIGHAN datasets demonstrate that ECOPO is simple yet effective. |