Papers by Yiran Cheng
Continual Pretraining on Encrypted Synthetic Data for Privacy-Preserving LLMs (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods to protect PII from training on small corpora are difficult to implement in real-world applications. |
| Approach: | They propose an entity-based framework that synthesizes encrypted training data to protect PII. |
| Outcome: | The proposed framework outperforms base models and ensures PII security on limited-scale datasets while exhibiting a modest performance gap compared to models trained on unencrypted synthetic data. |
Reasoning Robustness of LLMs to Adversarial Typographical Errors (2024.emnlp-main)
Copied to clipboard
Esther Gan, Yiran Zhao, Liying Cheng, Mao Yancan, Anirudh Goyal, Kenji Kawaguchi, Min-Yen Kan, Michael Shieh
| Challenge: | Large Language Models (LLMs) have demonstrated impressive capabilities in reasoning using Chain-of-Thought (CoT) prompting. |
| Approach: | They develop an algorithm that iteratively samples typos for words that are important to the query and selects the edit that is most likely to succeed in attacking. |
| Outcome: | The proposed algorithm detects typographical errors in large and closed-source LLMs and shows that they are robust to them. |