Papers by Jiahuan Cao
Formality is Favored: Unraveling the Learning Preferences of Large Language Models on Data with Conflicting Knowledge (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models have shown excellent performance on knowledge-intensive tasks, but pretraining data tends to contain misleading and conflicting information. |
| Approach: | They systematically analyze LLMs’ learning preferences for data with conflicting knowledge. |
| Outcome: | The proposed model outperforms human-level models on knowledge-intensive tasks by analyzing pretraining data. |
TongGu: Mastering Classical Chinese Understanding with Knowledge-Grounded Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capability in Natural Language Processing (NLP), but struggle with Classical Chinese Understanding (CCU) Existing models, including general-purpose and preliminary LLMs, lack the ability to address CCU in data-demanding and knowledge-intensive tasks. |
| Approach: | They propose to use a classical Chinese corpora-based instruction-tuning dataset to unlock the full CCU potential of LLMs. |
| Outcome: | The proposed model unlocks the full CCU potential of LLMs by preserving its foundational knowledge while maintaining redundancy-aware tuning (RAT) and CCU-RAG. |
HisDoc-OCR: Restoring Visual Grounding in MLLMs for Chinese Historical Document OCR (2026.findings-acl)
Copied to clipboard
| Challenge: | Despite multimodal large language models' strong performance on modern document OCR, their application to historical Chinese texts suffers from severe hallucinations, character fabrication, uncontrolled repetition, and semantic drift. |
| Approach: | They propose a multimodal large language model which restores visual grounding through three synergistic strategies: Layout Injection, First-Occurrence Boost, Self-Distilled Attention Focusing and HisDoc-OCR. |
| Outcome: | The proposed model outperforms general-purpose and OCR-specific models on Chinese historical documents. |
Large-Scale Corpus Construction and Retrieval-Augmented Generation for Ancient Chinese Poetry: New Method and Data Insights (2025.findings-naacl)
Copied to clipboard
| Challenge: | Ancient Chinese poetry presents unique challenges for Large Language Models due to data scarcity and limited ability of general LLMs when dealing with ACP. |
| Approach: | They propose a specialized Retrieval-Augmented Generation framework to improve LLMs' performance . they use 1.1 million ancient poems and 990K related texts to address hallucination issues . |
| Outcome: | The proposed framework improves performance of LLMs in ancient Chinese poetry domain from 49.2% to 89.0%. |
MCS-Bench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in Chinese Classical Studies (2025.acl-long)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) have advanced visual and language understanding, but their potential in Chinese Classical Studies (CCS) remains underexplored due to the lack of specialized benchmarks. |
| Approach: | They propose to develop a multimodal benchmark specifically designed for Chinese Classical Studies across multiple subdomains to bridge this gap. |
| Outcome: | The proposed benchmark spans seven core subdomains with a total of 45 meticulously designed tasks. |