Papers by Jiao Yuan
MAGIC: Deep Geometric Evolution with Structural Consensus for Temporal Knowledge Graph Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing multi-geometry approaches face two key bottlenecks: Riemannian depth barrier and gate collapse. |
| Approach: | They propose a framework for Temporal Knowledge Graph reasoning that integrates a Tangent-Residual Engine into multi-geometric spaces to regulate gradient flow and prevent collapse. |
| Outcome: | The proposed framework improves state-of-the-art in TKG reasoning by up to 2.9 points. |
TableVista: Benchmarking Multimodal Table Reasoning under Visual and Structural Complexity (2026.findings-acl)
Copied to clipboard
Zheyuan Yang, Liqiang Shang, Junjie Chen, Xun Yang, Chenglong Xu, Bo Yuan, Chenyuan Jiao, Yaoru Sun, Yilun Zhao
| Challenge: | TableVista evaluates multimodal table reasoning under visual and structural complexity . current models struggle to maintain reasoning consistency when structural complexity combined with visually integrated presentations. |
| Approach: | They propose a benchmark for evaluating multimodal table reasoning under visual and structural complexity. |
| Outcome: | The proposed model performs poorly on visual and structural complexity. |
Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Training (2025.acl-long)
Copied to clipboard
Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, Jen-tse Huang, Jiahao Xu, Tian Liang, Pinjia He, Zhaopeng Tu
| Challenge: | Large Language Models exhibit a level of intelligence that is both impressive and everevolving, but their ability to refuse generating unsafe content is a double-edged sword. |
| Approach: | They propose a method to tackle a refusal position bias within safety tuning data that compromises the models’ ability to appropriately refuse generating unsafe content. |
| Outcome: | The proposed method significantly improves model safety without compromising performance and surpasses baseline methods in defending against attacks. |
Chain-of-Jailbreak Attack for Image Generation Models via Step by Step Editing (2025.findings-acl)
Copied to clipboard
Wenxuan Wang, Kuiyi Gao, Youliang Yuan, Jen-tse Huang, Qiuzhi Liu, Shuai Wang, Wenxiang Jiao, Zhaopeng Tu
| Challenge: | Text-based image generation models, such as Stable Diffusion and DALL-E 3, hold significant potential in content creation and publishing workflows . however, considerable efforts are being made to prevent the generation of harmful content, such abusive, violent, or pornographic material. |
| Approach: | They propose a chain-of-jailbreak method which decomposes malicious queries into multiple sub-queries and iteratively edits images based on these sub-questions. |
| Outcome: | The proposed method can bypass safeguards of image generation models for over 60% cases, significantly outperforms other jailbreaking methods (14%) |
Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge (2025.emnlp-main)
Copied to clipboard
Tianhao Wu, Weizhe Yuan, Olga Golovneva, Jing Xu, Yuandong Tian, Jiantao Jiao, Jason E Weston, Sainbayar Sukhbaatar
| Challenge: | Existing methods for improving large language models have focused on improving model responses rather than judgment capabilities, resulting in rapid saturation during iterative training. |
| Approach: | They propose an iterative Meta-Rewarding step where the model judges its own judgements and uses that feedback to refine its judgment skills. |
| Outcome: | The proposed model improves Llama-3-8B-Instruct from 22.9% to 39.4% on AlpacaEval 2 and 20.6% to 29.1% on Arena-Hard. |
LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models (2024.emnlp-main)
Copied to clipboard
Yuxuan Wan, Wenxuan Wang, Yiliu Yang, Youliang Yuan, Jen-tse Huang, Pinjia He, Wenxiang Jiao, Michael Lyu
| Challenge: | LogicAsker examines and improves the reasoning abilities of large language models such as ChatGPT and GPT-4. |
| Approach: | They propose a set of atomic reasoning skills grounded in propositional and predicate logic to examine and improve the reasoning abilities of large language models such as ChatGPT and GPT-4. |
| Outcome: | The proposed approach improves reasoning abilities in large language models such as ChatGPT and GPT-4 by up to 5%. |
RBPtool: A Deep Language Model Framework for Multi-Resolution RBP-RNA Binding Prediction and RNA Molecule Design (2025.emnlp-main)
Copied to clipboard
Jiyue Jiang, Yitao Xu, Zikang Wang, Yihan Ye, Yanruisheng Shao, Yuheng Shan, Jiuming Wang, Xiaodan Fan, Jiao Yuan, Yu Li
| Challenge: | RNA-binding proteins play key roles in post-transcriptional gene regulation . existing methods focus on shallow sequence features or coarse structural representations . large language models allow for precise modeling and biologically informed de novo RNA design . |
| Approach: | They extend RPI15223 into a multi-resolution, structure-level RBP-RNA dataset and introduce RBPtool, a framework that fuses sequence and structural information. |
| Outcome: | The proposed framework achieves state-of-the-art performance on public benchmarks and the RPI15223 dataset while supporting fine-grained level predictions. |
Identifying the Achilles’ Heel: An Iterative Method for Uncovering Factual Errors in Large Language Models (2026.findings-acl)
Copied to clipboard
Wenxuan Wang, Yuk-Kit Chan, Zixuan Ling, Shi Juluan, Youliang Yuan, Jen-tse Huang, Yifei Zhang, Wenxiang Jiao, Zhaopeng Tu, Michael R. Lyu
| Challenge: | Current methods for evaluating LLMs’ veracity are limited by the need for extensive human labor, test data contamination, or limited scope, hindering efficient and effective exposure of errors. |
| Approach: | They propose a framework that extracts fact triplets to generate diverse question types using rule-based natural language processing techniques. |
| Outcome: | The proposed framework can trigger factual errors in up to 55% of questions in large LLMs while maintaining coverage of questions. |
Learning to Ask: When LLM Agents Meet Unclear Instruction (2025.emnlp-main)
Copied to clipboard
Wenxuan Wang, Shi Juluan, Zixuan Ling, Yuk-Kit Chan, Chaozheng Wang, Cheryl Lee, Youliang Yuan, Jen-tse Huang, Wenxiang Jiao, Michael R. Lyu
| Challenge: | Despite their impressive capabilities, LLMs struggle with complex computations and delivering accurate, timely information. |
| Approach: | They propose a framework that prompts LLM agents to ask questions when they encounter obstacles due to unclear instructions and an automated evaluation tool called ToolEvaluator. |
| Outcome: | The proposed framework outperforms existing frameworks for tool learning in the Noisy ToolBench. |
Curing Miracle Steps in LLM Mathematical Reasoning with Rubric Rewards (2026.acl-long)
Copied to clipboard
Youliang Yuan, Qiuyang Mang, Jingbang Chen, Hong Wan, Xiaoyuan Liu, Junjielong Xu, Jen-tse Huang, Wenxuan Wang, Wenxiang Jiao, Pinjia He
| Challenge: | Existing models are susceptible to reward hacking, leading to a substantial overestimation of a model's reasoning ability. |
| Approach: | They propose a Rubric Reward Model that rewards the entire reasoning trajectory against problem-specific rubrics. |
| Outcome: | The proposed model outperforms outcome-only supervision on four math benchmarks and boosts Verified Pass@1024 from 26.7% to 62.6% and reduces the incidence of Miracle Steps by 71%. |
LLM Safety From Within: Detecting Harmful Content with Internal Representations (2026.acl-long)
Copied to clipboard
| Challenge: | State-of-the-art guard models rely on terminal-layer representations and overlook safety-relevant features encoded across internal layers. |
| Approach: | They propose a lightweight guard model that harnesses safety neurons from LLM internals without modifying the underlying model. |
| Outcome: | The proposed model outperforms open-source guard models across multiple benchmarks while using 250 fewer trainable parameters. |
Ro-SLM: Onboard Small Language Models for Robot Task Planning and Operation Code Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) provide robots with contextual reasoning abilities to comprehend human instructions. |
| Approach: | They propose a framework that enables reliable SLM-driven robot operation by distilling LLMs’ knowledge and reasoning. |
| Outcome: | The proposed framework enables reliable SLM-driven robot operation by distilling LLMs’ knowledge and reasoning. |
All Languages Matter: On the Multilingual Safety of LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing safety benchmarks only concern the safety in one language, e.g. the majority language in the pretraining data such as English. |
| Approach: | They propose a prompting method to improve multilingual safety of ChatGPT by enhancing cross-lingual generalization of safety alignment. |
| Outcome: | The proposed method can significantly reduce the ratio of unsafe responses by 42% for non-English queries. |
LoopTool: Closing the Data–Training Loop for Robust LLM Tool Calls (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are powerful tools for multi-step tasks, but static data pipelines hinder tool learning and cause noisy labels to persist. |
| Approach: | They propose a fully automated, model-aware data evolution framework that tightly integrates data synthesis and model training. |
| Outcome: | Experiments show that LoopTool-8B significantly surpasses its 32B data generator and achieves new state-of-the-art results on the BFCL-v3 and ACEBench benchmarks for its scale. |