Papers by Ling Shi
UniVocal: Unified Speech-Singing Code-Switching Synthesis (2026.acl-long)
Copied to clipboard
| Challenge: | Existing systems cannot automatically determine when to switch between modes based on text content. |
| Approach: | They propose a unified framework that implicitly infers vocal modes from text context to pioneer SCS Synthesis. |
| Outcome: | The proposed framework infers vocal modes solely from text context to pioneer SCS Synthesis. |
FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data (2024.emnlp-industry)
Copied to clipboard
Haoran Sun, Renren Jin, Shaoyang Xu, Leiyu Pan, null Supryadi, Menglong Cui, Jiangcun Du, Yikun Lei, Lei Yang, Ling Shi, Juesi Xiao, Shaolin Zhu, Deyi Xiong
| Challenge: | Large language models exhibit significant performance discrepancies between high- and low-resource languages. |
| Approach: | They present an open-source multilingual LLM with 8 billion parameters and a multilingual instruction dataset. |
| Outcome: | The proposed model achieves consistent multilingual representations across languages. |
ActPlan-1K: Benchmarking the Procedural Planning Ability of Visual Language Models in Household Activities (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been adopted to process textual task description and accomplish procedural planning in embodied AI tasks because of their powerful reasoning ability. |
| Approach: | They propose to evaluate the planning ability of large language models and multi-modal counterfactual vision language models (VLMs) using a multi-factual household activity simulator and a chatGPT task description to evaluate their reasoning ability. |
| Outcome: | The proposed benchmark evaluates the planning ability of multi-modal and counterfactual vision language models on a household activity simulator and a chatGPT task description. |
From Insight to Action: A Novel Framework for Interpretability-Guided Data Selection in Large Language Models (2026.acl-long)
Copied to clipboard
Ling Shi, Xinwei Wu, Xiaohu Zhao, Hao Wang, Heng Liu, Yangyang Liu, Linlong Xu, Longyue Wang, Deyi Xiong, Weihua Luo
| Challenge: | Recent research in mechanistic interpretability has revealed that Large Language models contain disentangled, human-understandable components. |
| Approach: | They propose a framework that first identifies causal task features through frequency recall and interventional filtering, then selects “Feature-Resonant Data” that maximally activates task features for fine-tuning. |
| Outcome: | The proposed framework outperforms existing models on mathematical reasoning, summarization, and translation tasks while using only 50% of the data. |
Spiral of Silence in Large Language Model Agents (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing theories of Spiral of Silence do not apply to large language models . |
| Approach: | They propose an evaluation framework for examining SoS in large language models . they consider four controlled conditions that vary the availability of "History" and "Persona" signals . |
| Outcome: | The proposed framework examines the SoS-like dynamics in large language models . it shows that history and persona together produce strong majority dominance . |
OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety (2024.acl-demos)
Copied to clipboard
Chuang Liu, Linhao Yu, Jiaxuan Li, Renren Jin, Yufei Huang, Ling Shi, Junhui Zhang, Xinmeng Ji, Tingting Cui, Liutao Liutao, Jinwang Song, Hongying Zan, Sun Li, Deyi Xiong
| Challenge: | a rapid development of Chinese large language models poses big challenges for efficient LLM evaluation. |
| Approach: | They propose an evaluation testbed that benchmarks Chinese LLMs across capability, alignment and safety. |
| Outcome: | The evaluation platform OpenEval benchmarks Chinese LLMs across capability, alignment and safety. |
CHBias: Bias Evaluation and Mitigation of Chinese Conversational Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Existing studies on social biases in language models have focused on only English. |
| Approach: | They propose to use a Chinese dataset for bias evaluation and mitigation of Chinese conversational language models. |
| Outcome: | The proposed dataset includes under-explored bias categories, such as ageism and appearance biases, which received less attention in previous studies. |
R2IF: Aligning Reasoning with Decisions via Composite Rewards for Interpretable LLM Function Calling (2026.acl-long)
Copied to clipboard
| Challenge: | Existing RL-based approaches to function calling are misaligned between reasoning processes and tool-call decisions. |
| Approach: | They propose a reasoning-aware RL framework for interpretable function calling . they integrate a composite reward integrating format/correctness constraints, CER, and SMV . |
| Outcome: | Experiments on BFCL/ACEBench show R2IF outperforms baselines by 34.62% with positive Average CoT Effectiveness. |
CT-FineBench: A Diagnostic Fidelity Benchmark for Fine-Grained Evaluation of CT Report Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation metrics for radiology report generation focus on lexical overlap and entity matching. |
| Approach: | They propose a benchmark to evaluate the fine-grained factual consistency of CT reports . they use a question-answering process to query a machine-generated report . |
| Outcome: | The proposed benchmark evaluates the fine-grained factual consistency of CT reports . it correlates better with expert clinical assessment and is more sensitive to errors . |
PresentAgent: Multimodal Agent for Presentation Video Generation (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Existing methods for generating static slides or text summaries are limited to producing narrated presentations. |
| Approach: | They propose a multimodal agent that transforms long-form documents into narrated presentations. |
| Outcome: | The present agent produces fully synchronized visual and spoken content that closely mimics human-style presentations. |
Think-Search-Patch: A Retrieval-Augmented Reasoning Framework for Repository-Level Code Repair (2025.emnlp-industry)
Copied to clipboard
Bojian Xiong, Yikun Lei, Xikai Liu, Shaowei Zhang, Pengyun Zhu, Yan Liu, Yongqi Leng, Ling Shi, Meizhi Zhong, Yurong Zhang, Yan Gao, null Yiwu, Yao Hu, Deyi Xiong
| Challenge: | Large language models suffer from multiple-file coding scenarios with strong inter-file dependencies . experimental results show that large language models exhibit inadequate performance in multi-file scenarios . |
| Approach: | They propose a retrieval-augmented reasoning framework for repository-level code repair . they use a dataset to generate standardized patches based on the key snippets . |
| Outcome: | The proposed framework improves retrieval accuracy and repair success on SWE-bench Lite . it surpasses models with larger size in managing extensive code contexts and fixing bugs spanning across multiple files. |
Praetor: A Fine-Grained Generative LLM Evaluator with Instance-Level Customizable Evaluation Criteria (2025.acl-long)
Copied to clipboard
Yongqi Leng, Renren Jin, Yue Chen, Zhuowen Han, Ling Shi, Jianxiang Peng, Lei Yang, Juesi Xiao, Deyi Xiong
| Challenge: | Existing evaluation methods are inadequate to evaluate large language models (LLMs). |
| Approach: | They propose a fine-grained generative LLM evaluator with instance-level customazable evaluation criteria that can be used to evaluate large language models. |
| Outcome: | The proposed model outperforms existing LLM evaluators and instruction-tuned LLMs on multiple benchmarks and sets new SOTA results. |
Lost in Pronunciation: Detecting Chinese Offensive Language Disguised by Phonetic Cloaking Replacement (2025.emnlp-industry)
Copied to clipboard
Haotan Guo, Jianfei He, Jiayuan Ma, Hongbin Na, Zimu Wang, Haiyang Zhang, Qi Chen, Wei Wang, Zijing Shi, Tao Shen, Ling Chen
| Challenge: | Phonetic Cloaking Replacement (PCR) is a problem in content moderation in China. |
| Approach: | They organize PCR into a four-way surface-form taxonomy and compile PCR-ToxiCN, a dataset of 500 phonetically cloaked offensive posts gathered from the RedNote platform. |
| Outcome: | The proposed model achieves only an F1-score and zero-shot chain-of-thought prompting pushes performance even lower. |
From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan (2026.acl-long)
Copied to clipboard
Lei Yang, Leiyu Pan, Bojian Xiong, Renren Jin, Shaowei Zhang, Yue Chen, Ling Shi, Jiang Zhou, Junru Wu, Zhen Wang, Jianxiang Peng, Juesi Xiao, Tianyu Dong, Zhuowen Han, Zhuo Chen, Yuqi Ren, Deyi Xiong
| Challenge: | Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages. |
| Approach: | They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English. |
| Outcome: | The proposed model outperforms open-source and Tibetan-focused models on diverse tasks. |
Identifying the Achilles’ Heel: An Iterative Method for Uncovering Factual Errors in Large Language Models (2026.findings-acl)
Copied to clipboard
Wenxuan Wang, Yuk-Kit Chan, Zixuan Ling, Shi Juluan, Youliang Yuan, Jen-tse Huang, Yifei Zhang, Wenxiang Jiao, Zhaopeng Tu, Michael R. Lyu
| Challenge: | Current methods for evaluating LLMs’ veracity are limited by the need for extensive human labor, test data contamination, or limited scope, hindering efficient and effective exposure of errors. |
| Approach: | They propose a framework that extracts fact triplets to generate diverse question types using rule-based natural language processing techniques. |
| Outcome: | The proposed framework can trigger factual errors in up to 55% of questions in large LLMs while maintaining coverage of questions. |
Learning to Ask: When LLM Agents Meet Unclear Instruction (2025.emnlp-main)
Copied to clipboard
Wenxuan Wang, Shi Juluan, Zixuan Ling, Yuk-Kit Chan, Chaozheng Wang, Cheryl Lee, Youliang Yuan, Jen-tse Huang, Wenxiang Jiao, Michael R. Lyu
| Challenge: | Despite their impressive capabilities, LLMs struggle with complex computations and delivering accurate, timely information. |
| Approach: | They propose a framework that prompts LLM agents to ask questions when they encounter obstacles due to unclear instructions and an automated evaluation tool called ToolEvaluator. |
| Outcome: | The proposed framework outperforms existing frameworks for tool learning in the Noisy ToolBench. |
DiplomacyAgent: Do LLMs Balance Interests and Ethical Principles in International Events? (2025.emnlp-main)
Copied to clipboard
| Challenge: | a new study examines the safety implications of large language models in diplomatic positions . it identifies potential risks and ideological biases that could arise from LLMs . |
| Approach: | They propose an LLM-based multi-agent system for diplomatic position analysis . they propose ethical constraint measures to enhance the safety of LLMs . |
| Outcome: | The proposed system assesses the safety implications of large language models in diplomacy . it reveals that LLMs could exhibit a strong bias towards interests, leading to unsafe decisions . |
Benchmarking Web Agent Safety under E-commerce Deceptive Interfaces (2026.acl-long)
Copied to clipboard
| Challenge: | Existing web agents are highly susceptible to multiple classes of deceptive interfaces, but they are not designed to mitigate these failures. |
| Approach: | They propose a lightweight plugin framework that allows controlled injection of deceptive interface patterns into existing web environments. |
| Outcome: | The proposed framework enables controlled injection of deceptive interface patterns into web environments. |
Hazards in Daily Life? Enabling Robots to Proactively Detect and Resolve Anomalies (2025.naacl-long)
Copied to clipboard
Zirui Song, Guangxian Ouyang, Meng Fang, Hongbin Na, Zijing Shi, Zhenhao Chen, Fu Yujie, Zeyu Zhang, Shiyu Jiang, Miao Fang, Ling Chen, Xiuying Chen
| Challenge: | Existing household robots are inability to recognize potential problems or dangers in home environments. |
| Approach: | They propose a task of creating anomaly scenarios using generative models instead of manually labeled data to build simulated environments. |
| Outcome: | The proposed framework outperforms existing models in terms of task description and scene diversity. |
CRiskEval: A Chinese Multi-Level Risk Evaluation Benchmark Dataset for Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models exhibit a risk propensity of more than 40%, and are prone to self-sustainability, power seeking and other dangerous goals as the size of models increases. |
| Approach: | They propose a Chinese dataset to gauge the risk proclivities inherent in large language models such as resource acquisition and malicious coordination. |
| Outcome: | The proposed dataset consists of 14,888 questions that simulate scenarios related to predefined 7 types of frontier risks. |
Self-imitation Learning for Action Generation in Text-based Games (2023.eacl-main)
Copied to clipboard
| Challenge: | Text-based games are situated systems where the game agents observe textual descriptions, and generate textual commands to interact with the environment. |
| Approach: | They propose a confidence-based self-imitation model to generate action candidates for the RL agent by exploiting past valuable trajectories to adapt a pre-trained language model towards a target game. |
| Outcome: | The proposed model performs well in multiple challenging games. |
More than Minorities and Majorities: Understanding Multilateral Bias in Language Generation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on bias dataset construction and mitigation focus on one demographic group . in real-world applications, there are more than two demographic groups at risk of the same bias. |
| Approach: | They propose to analyze and reduce biases across multiple demographic groups using a multi-demographic bias dataset. |
| Outcome: | The proposed method can mitigate biases among multiple demographic groups effectively, the authors show . |