Papers by Yanzhu Guo
The Curious Decline of Linguistic Diversity: Training Language Models on Synthetic Text (2024.findings-naacl)
Copied to clipboard
| Challenge: | a new study examines the effects of training language models on synthetic data generated by their predecessors. |
| Approach: | They propose to use recursive finetuning techniques to assess linguistic diversity of models. |
| Outcome: | The proposed metrics show a decrease in diversity of model outputs through successive iterations, especially for tasks demanding high levels of creativity. |
Do Large Language Models have an English Accent? Evaluating and Improving the Naturalness of Multilingual LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Current Large Language Models (LLMs) are predominantly designed with English as the primary language, but many are still English-dominated. |
| Approach: | They propose to use automatic corpus-level metrics to assess lexical and syntactic naturalness of LLMs in a multilingual context. |
| Outcome: | The proposed method improves naturalness of LLMs in target languages without compromising performance on general-purpose benchmarks. |
Questioning the Validity of Summarization Datasets and Improving Their Factual Consistency (2022.emnlp-main)
Copied to clipboard
| Challenge: | Abstractive summarization systems have a lack of a defined definition for the task . factual consistency is a key factor in summarizing, but there are still deficiencies . a new study shows that summarized summarisation models achieve improved performance . |
| Approach: | They propose a filtered summarization dataset with improved factual consistency to address this problem . they argue that the dataset should become a valid benchmark for developing and evaluating summarizing systems . |
| Outcome: | The proposed model improves on a popular summarization dataset with improved factual consistency. |
Automatic Analysis of Substantiation in Scientific Peer Reviews (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing systems to analyze peer reviews' quality are inadequate due to the increasing workload of reviewers and the lack of domain experts . |
| Approach: | They propose to use a claim-evidence pair extraction problem to analyze substantiation in peer reviews and train an argument mining system to do the same. |
| Outcome: | The proposed system could be used by conference managers and reviewers to analyze the quality of peer reviews. |