Papers by Yujia Tang
Mechanistic Interpretability Should Prioritize Feature Consistency in Sparse Autoencoders (2026.acl-long)
Copied to clipboard
Xiangchen Song, Aashiq Muhamed, Yujia Zheng, Lingjing Kong, Zeyu Tang, Mona T. Diab, Virginia Smith, Kun Zhang
| Challenge: | Sparse Autoencoders (SAEs) are a tool in mechanistic interpretability (MI) but the aspiration to identify a canonical set of features is challenged by the observed inconsistency of learned SAE features across different training runs. |
| Approach: | They propose to use the Pairwise Dictionary Mean Correlation Coefficient to quantify SAE feature consistency as an evaluation axis alongside reconstruction and sparsity. |
| Outcome: | The proposed measure is based on the pairwise dictionary mean correlation coefficient (PW-MCC) on LLM activations. |
Augmenting Multi-Agent Communication with State Delta Trajectory (2025.emnlp-main)
Copied to clipboard
| Challenge: | Multi-agent systems based on large language models (LLMs) have shown to be effective in downstream tasks. |
| Approach: | They propose a protocol that transfers both natural language tokens and token-wise state transition trajectory from one agent to another. |
| Outcome: | The proposed protocol can transfer both natural language tokens and token-wise state transition trajectory from one agent to another. |
FaithBench: A Diverse Hallucination Benchmark for Summarization by Modern LLMs (2025.naacl-short)
Copied to clipboard
Forrest Sheng Bao, Miaoran Li, Renyi Qu, Ge Luo, Erana Wan, Yujia Tang, Weisi Fan, Manveer Singh Tamber, Suleman Kazi, Vivek Sourabh, Mike Qi, Ruixuan Tu, Chenyu Xu, Matthew Gonzales, Ofer Mendelevitch, Amin Ahmad
| Challenge: | Existing evaluations of hallucinations in large language models suffer from a lack of diversity and recency in the LLM and LLM families considered. |
| Approach: | They propose a summarization hallucination benchmark that challenges models to disagree on hallucines . they use models to generate answers or summaries from textual input . |
| Outcome: | The proposed model combines the best of 10 modern LLMs with ground truth annotations. |