Papers by Xinwei Guo
The Elephant in the Room: Exploring the Role of Neutral Words in Language Model Group-Agnostic Debiasing (2025.findings-acl)
Copied to clipboard
Xinwei Guo, Jiashi Gao, Junlei Zhou, Jiaxin Zhang, Guanhua Chen, Xiangyu Zhao, Quanying Liu, Haiyan Wu, Xin Yao, Xuetao Wei
| Challenge: | Large Language Models (LLMs) are increasingly integrated into our daily lives, raising ethical concerns, especially about perpetuating stereotypes. |
| Approach: | They propose a method that incorporates a neutral word semantics-based loss function to alleviate the deterioration of the LMS during debiasing. |
| Outcome: | The proposed method alleviates the deterioration of the Language Modeling Score (LMS) by incorporating a neutral word semantics-based loss function. |
Exploring Multilingual Concepts of Human Values in Large Language Models: Is Value Alignment Consistent, Transferable and Controllable across Languages? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Prior research has revealed that certain abstract concepts are linearly represented as directions in the representation space of LLMs, predominantly centered around English. |
| Approach: | They extend previous research that shows certain abstract concepts are linearly represented as directions in LLMs, predominantly centered around English. |
| Outcome: | The proposed model can be used to align LLMs with human values, and it can generate toxic, untruthful, biased, and even illegal content. |
LLMs Trust Humans More, That’s a Problem! Unveiling and Mitigating the Authority Bias in Retrieval-Augmented Generation (2025.acl-long)
Copied to clipboard
Yuxuan Li, Xinwei Guo, Jiashi Gao, Guanhua Chen, Xiangyu Zhao, Jiaxin Zhang, Quanying Liu, Haiyan Wu, Xin Yao, Xuetao Wei
| Challenge: | Large language models (LLMs) generate outputs that stray from user input or contravene established knowledge. |
| Approach: | They propose a new phenomenon, Authority Bias, where LLMs favor one knowledge source over the other . they propose atomic information that generates conflicts and a Conflict Detection Enhanced Query framework . |
| Outcome: | The proposed framework reduces Authority bias in large language models . it detects conflicts, performs credibility assessment on conflicting paragraphs, and detects perturbed text . |
Can LLMs Hear the Dogwhistle? (2026.findings-acl)
Copied to clipboard
Yifan Liu, Yi Lin, Xinwei Guo, Ziwei Wang, Jiaxin Zhang, Guanhua Chen, Haiyan Wu, Xiangyu Zhao, Xin Yao, Xuetao Wei
| Challenge: | Existing safety benchmarks focus on explicitly harmful content, but ignore context-dependent expressions such as dogwhistles. |
| Approach: | They propose a benchmark for evaluating LLM safety under dogwhistle-driven prompts . their findings expose a blind spot in current safety evaluation practices . |
| Outcome: | The proposed benchmark compared safety performance with toxic terms using dogwhistle-driven prompts. |
CANDY: Benchmarking LLMs’ Limitations and Assistive Potential in Chinese Misinformation Fact-Checking (2025.findings-emnlp)
Copied to clipboard
| Challenge: | CANDY is a benchmark to evaluate the capabilities and limitations of large language models (LLMs) for fact-checking misinformation. |
| Approach: | a team of researchers develop a benchmark to evaluate the capabilities and limitations of large language models in fact-checking misinformation in Chinese. |
| Outcome: | CANDY is a benchmark to evaluate the capabilities and limitations of large language models in fact-checking misinformation in China. |
Semantic-Eval : A Semantic Comprehension Evaluation Framework for Large Language Models Generation without Training (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have emerged as key drivers of progress in the field of natural language processing. |
| Approach: | They propose a framework that assesses LLM-generated text based on semantic understanding. |
| Outcome: | The proposed framework surpasses traditional evaluation metrics and lags behind GPT-4. |