Papers by Kun Wang
HSDreport: Heart Sound Diagnosis with Echocardiography Reports (2024.findings-emnlp)
Copied to clipboard
Zihan Zhao, Pingjie Wang, Liudan Zhao, Yuchen Yang, Ya Zhang, Kun Sun, Xin Sun, Xin Zhou, Yu Wang, Yanfeng Wang
| Challenge: | Existing methods for heart sound diagnosis are limited to a few fixed categories and do not utilize echocardiography reports, the gold standard in the diagnosis of related diseases. |
| Approach: | They propose a benchmark that mandates the direct utilization of heart sounds obtained from auscultation to predict echocardiography reports. |
| Outcome: | The proposed method outperforms existing methods and existing multimodal LLMs in detecting key abnormalities in heart sounds. |
Backdoor Collapse: Eliminating Unknown Threats Via Known Backdoor Aggregation In Language Models (2026.acl-long)
Copied to clipboard
Liang Lin, Miao Yu, Moayad Aloqaily, Zhenhong Zhou, Kun Wang, Linsey Pang, Prakhar Mehrotra, Qingsong Wen
| Challenge: | Existing defenses rely on impractical assumptions about trigger settings to mitigate backdoor attacks . a recent study found that small amounts of training data can systematically induce harmful behaviors in large language models. |
| Approach: | They propose a backdoor defense framework that requires no prior knowledge of trigger settings . they use a two-stage process to aggregate backdoor representations and fine-tune recovery . |
| Outcome: | The proposed defense reduces the average Attack Success Rate to 4.41% across multiple benchmarks . the proposed framework generalizes across different types of backdoors, confirming its robustness in practical deployment scenarios. |
ReFSQL: A Retrieval-Augmentation Framework for Text-to-SQL Generation (2023.findings-emnlp)
Copied to clipboard
Kun Zhang, Xiexiong Lin, Yuanzhuo Wang, Xin Zhang, Fei Sun, Cen Jianhe, Hexiang Tan, Xuhui Jiang, Huawei Shen
| Challenge: | Existing methods that align natural language with SQL Language underestimate inherent structural characteristics of SQL and lead to structure errors. |
| Approach: | They propose a retrieval-argument framework that aligns natural language with SQL Language and trains one encoder-decoder-based model to fit all questions. |
| Outcome: | The proposed framework improves accuracy and robustness of text-to-SQL generation on five datasets. |
ARise: Towards Knowledge-Augmented Reasoning via Risk-Adaptive Search (2025.acl-long)
Copied to clipboard
Yize Zhang, Tianshu Wang, Sirui Chen, Kun Wang, Xingyu Zeng, Hongyu Lin, Xianpei Han, Le Sun, Chaochao Lu
| Challenge: | Large language models (LLMs) have impressive capabilities but their application in open-ended, knowledge-intensive, complex reasoning scenarios is limited. |
| Approach: | They propose a framework that integrates risk assessment of intermediate reasoning states with dynamic retrieval-augmented generation within a Monte Carlo tree search paradigm. |
| Outcome: | The proposed framework outperforms the state-of-the-art KAR methods by up to 23.10% and the latest RAG-equipped large reasoning models by upto 25.37%. |
Pierce the Mists, Greet the Sky: Decipher Knowledge Overshadowing via Knowledge Circuit Analysis (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are hampered by hallucinations, a particularly challenging variant, knowledge overshadowing, which can lead to erroneous outputs even with high-quality training data. |
| Approach: | They propose a framework to analyze and detect knowledge overshadowing by using knowledge circuit analysis to dissect the function of key components in the circuit and how attention pattern dynamics contribute to the phenomenon. |
| Outcome: | Extensive experiments show that the framework can detect and analyze knowledge overshadowing and improves on existing models. |
HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference (2025.findings-acl)
Copied to clipboard
Ping Gong, Jiawei Yi, Shengnan Wang, Juncheng Zhang, Zewen Jin, Ouxiang Zhou, Ruibo Liu, Guanbin Xu, Youhui Bai, Bowen Ye, Kun Yuan, Tong Yang, Gong Zhang, Renhai Chen, Feng Wu, Cheng Li
| Challenge: | Existing top-k attention methods struggle to strike a balance between efficiency and accuracy. |
| Approach: | They propose a top-k attention approach that integrates low-overhead techniques into the Top-k Attention process to achieve 7.2 speedup compared to vanilla full attention. |
| Outcome: | The proposed approach achieves 7.2 speedup compared to current top-k attention methods while maintaining model accuracy. |
Text Embedding as Treatment: A Meta Causal Approach for Robust Sentiment Classification (2026.findings-acl)
Copied to clipboard
Fengxiang Cheng, Chuan Zhou, Xiang Li, Haoxuan Li, Wen-li Wang, Jinkun Chen, Mingming Gong, Kun Zhang
| Challenge: | Existing methods for sentiment classification use binary treatment of words . Existing approaches limit generalizability to novel words and low-frequency words if there is a word in a sentence that is not treated . |
| Approach: | They propose a meta-causal approach that uses a single training task to identify causal words for arbitrary words. |
| Outcome: | The proposed method reduces the spurious correlation between word treatment and sentiment classification by removing words with low treatment effects from a pre-trained language model. |
Learning to Solve Domain-Specific Calculation Problems with Knowledge-Intensive Programs Generator (2025.naacl-long)
Copied to clipboard
| Challenge: | Domain Large Language Models (LLMs) are developed for domain-specific tasks based on general LLMs, but it still requires professional knowledge to facilitate the expertise for some domain- specific tasks. |
| Approach: | They propose a pipeline to solve domain-specific calculation problems with KIPG . they use it to extract key variables and calculate outcomes dependent on domain knowledge . |
| Outcome: | The proposed pipeline solves domain-specific calculation problems more effectively . it generates knowledge-intensive programs according to the domain- specific documents . |
An Information Bottleneck Perspective for Effective Noise Filtering on Retrieval-Augmented Generation (2024.acl-long)
Copied to clipboard
Kun Zhu, Xiaocheng Feng, Xiyuan Du, Yuxuan Gu, Weijiang Yu, Haotian Wang, Qianglong Chen, Zheng Chu, Jingchang Chen, Bing Qin
| Challenge: | Experimental results show that retrieval-augmented generation improves accuracy and relevance of large language models. |
| Approach: | They propose to introduce the information bottleneck theory into retrieval-augmented generation by maximizing mutual information between compression and ground output while minimizing mutual information . |
| Outcome: | The proposed approach improves accuracy and correctness of answer generation and conciseness with 2.5% compression rate. |
Decentralized Arena: Towards Democratic and Scalable Automatic Evaluation of Language Models (2026.acl-long)
Copied to clipboard
Yanbin Yin, Kun Zhou, Zhen Wang, Xiangdong Zhang, Yifei Shao, Shibo Hao, Yi Gu, Jieyuan Liu, Somanshu Singla, Tianyang Liu, Eric P. Xing, Zhengzhong Liu, Haojian Jin, Zhiting Hu
| Challenge: | closed-ended question-based benchmarks struggle with saturation as newer models emerge . crowd-sourced leaderboards rely on costly and slow human judges . |
| Approach: | They propose a framework that leverages collective intelligence from all large language models to evaluate each other. |
| Outcome: | a new framework enables a democratic, pairwise evaluation of all large language models . it achieves 97% correlation with human judgements, while significantly reducing the cost. |
Extracting Multiple-Relations in One-Pass with Pre-Trained Transformers (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to extract multiple relations from a paragraph require multiple passes over the paragraph. |
| Approach: | They propose a method to extract multiple relations from a paragraph by encoding the paragraph only once. |
| Outcome: | The proposed approach can perform state-of-the-art on the benchmark ACE 2005. |
MAKAR: a Multi-Agent framework based Knowledge-Augmented Reasoning for Grounded Multimodal Named Entity Recognition (2025.emnlp-main)
Copied to clipboard
Xinkui Lin, Yuhui Zhang, Yongxiu Xu, Kun Huang, Hongzhang Mu, Yubin Wang, Gaopeng Gou, Li Qian, Li Peng, Wei Liu, Jian Luan, Hongbo Xu
| Challenge: | Existing methods for GMNER fail to address semantic ambiguity caused by polysemy and long-tail distribution of datasets. |
| Approach: | They propose a framework for Grounded Multimodal Named Entity Recognition that leverages a Multimodal Large Language Model to address semantic ambiguity. |
| Outcome: | Extensive experiments show that the proposed framework outperforms existing methods on two benchmark datasets. |
A Unified Framework for Synaesthesia Analysis (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Synaesthesia is a cognitive phenomenon structuring human thought and action, which makes understanding it challenging. |
| Approach: | They propose a framework for annotating synaesthetic elements and exploring their relationship . they propose to include sensory modalities, cues and stimuli in the framework . |
| Outcome: | The proposed framework yields state-of-the-art results, demonstrating its effectiveness. |
Enhancing Chain-of-Thought Reasoning via Neuron Activation Differential Analysis (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on optimizing external components of CoT, but lack internal explanations for the quality of the model's outputs. |
| Approach: | They propose an efficient method to identify reasoning-critical neurons by analyzing their activation patterns under reasoning chains of varying quality. |
| Outcome: | The proposed method shows that neurons in the feed-forward layers are critical in the generation of high-quality reasoning chains. |
Evaluating Object Hallucination in Large Vision-Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large vision-language models (LVLMs) suffer from object hallucinations, i.e., they tend to generate objects inconsistent with the target images in the descriptions. |
| Approach: | They propose to integrate powerful large vision-language models (LVLMs) they propose a polling-based query method to evaluate object hallucination . |
| Outcome: | The proposed model can evaluate object hallucination in a more stable and flexible way. |
Tailoring Diagnostic Modeling to Individual Learners: Personalized Distractor Generation via MCTS-Guided Reasoning Reconstruction (2026.acl-long)
Copied to clipboard
| Challenge: | Current distractor generation methods produce shared distractors for all students, ignoring individual variations in reasoning, which limits their diagnostic effectiveness. |
| Approach: | They propose a method which tailors distractors to each student’s specific cognitive flaws, inferred from their past question-answering (QA) history. |
| Outcome: | The proposed framework outperforms existing methods in generating plausible distractors and adapts to group-level settings. |
R2F: A General Retrieval, Reading and Fusion Framework for Document-level Natural Language Inference (2022.emnlp-main)
Copied to clipboard
| Challenge: | Document-level natural language inference (DOCNLI) is a new task in natural language processing. |
| Approach: | They propose a document-level natural language inference framework that fuses sentence-level tasks into a set of sentence-based tasks. |
| Outcome: | The proposed framework improves interpretability and performance with evidence. |
DeepSynth-Eval: Objectively Evaluating Information Consolidation in Deep Survey Writing (2026.findings-acl)
Copied to clipboard
Hongzhi Zhang, Yuanze Hu, Tinghai Zhang, Jia Fu, Tao Wang, Junwei Jing, Zhaoxin Fan, Wei Bi, Ruiming Tang, Han Li, Guorui Zhou, Kun Gai
| Challenge: | Large Language Models (LLMs) are evolving towards autonomous agents . retrieval capabilities are well-benchmarked, but post-retrieval synthesis is under-evaluated due to open-ended writing. |
| Approach: | They propose a benchmark to evaluate information consolidation capabilities using survey papers as gold standards. |
| Outcome: | The proposed benchmark analyzes the post-retrieval synthesis stage of large language models . it leverages high-quality survey papers as gold standards and reverse-engineers research requests . the proposed benchmark outperforms single-turn generation and reduces hallucinations . |
MasRouter: Learning to Route LLMs for Multi-Agent Systems (2025.acl-long)
Copied to clipboard
| Challenge: | Multi-agent systems (MAS) powered by Large Language Models (LLMs) have been demonstrated to push the boundaries of LLM capabilities, yet they often face significant costs and challenges in dynamic LLM selection. |
| Approach: | They propose a multi-agent system routing solution that integrates all components of MAS into a unified routing framework. |
| Outcome: | The proposed solution is high-performing, cost-effective, and efficient . it reduces overhead by up to 52.07 compared to current methods on HumanEval . |
SQL-to-Text Generation with Graph-to-Sequence Model (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to generate SQL-to-text using seq2seq models do not capture graph-structured information in SQL query. |
| Approach: | They propose a graph-to-sequence model to encode global structure information into node embeddings. |
| Outcome: | The proposed model outperforms the Seq2Seq and Tree2Sq baselines on the WikiSQL and Stackoverflow datasets. |
Federated LoRA Fine-Tuning with Pipelined Error-Mitigated Aggregation and Matrix-Wise Freezing (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning large language models often suffer from biased model aggregation and are hindered by significant communication and computation burden. |
| Approach: | They propose a Federated low-rank adaptation system for large language models that leverages pipelined error-mitigated model aggregation and adaptive matrix-wise parameter freezing to mitigate aggregations. |
| Outcome: | The proposed system improves time-to-target by 2.17-8.48 on real-world datasets. |
CR-GIS: Improving Conversational Recommendation via Goal-aware Interest Sequence Modeling (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to determine a goal item by sequentially tracking users’ interests ignore the rich goal-aware implicit interest sequence patterns in a dialog. |
| Approach: | They propose to model goal-aware implicit user interest sequence patterns in a dialog and a hierarchical Star Transformer to guide multi-turn utterances generation. |
| Outcome: | The proposed framework achieves more accurate recommendations with more fluent and coherent dialog utterances. |
Gold Panning in Vocabulary: An Adaptive Method for Vocabulary Expansion of Domain-Specific LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) struggle when it comes to specialized domains due to limited domain-specific knowledge. |
| Approach: | They propose an adaptive method that automatically identifies valuable words from a given domain vocabulary. |
| Outcome: | The proposed method has been validated on three Chinese datasets and performed on general tasks. |
Learn with Noisy Data via Unsupervised Loss Correction for Weakly Supervised Reading Comprehension (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to filter noise for machine reading comprehension (MRC) are difficult to control and introduce noisy data. |
| Approach: | They propose a hierarchical loss correction strategy to avoid fitting noise and enhance clean supervision signals by using an unsupervisedly fitted Gaussian mixture model and a hard bootstrapping loss method. |
| Outcome: | The proposed methods can help improve models significantly on weakly supervised machine reading comprehension datasets. |
Hybrid Self-evolving Structured Memory for Computer-Use Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | despite advances in vision–language models, real-world computer-use tasks remain challenging due to long-horizon workflows, diverse interfaces, and frequent intermediate errors. |
| Approach: | They propose a graph-based memory that couples discrete symbolic nodes with continuous trajectory embeddings. |
| Outcome: | The proposed system outperforms closed-source models in Qwen2.5-VL-7B and Gemini2.5-Pro-Vision on desktop and mobile platforms. |
ErrorRadar: Benchmarking Complex Mathematical Reasoning of Multimodal Large Language Models Via Error Detection (2026.findings-acl)
Copied to clipboard
Yibo Yan, Shen Wang, Jiahao Huo, Hang Li, Boyan Li, Jiamin Su, Xiong Gao, YiFan Zhang, Tianlong Xu, Zhendong Chu, Aoxiao Zhong, Kun Wang, Hui Xiong, Philip S. Yu, Xuming Hu, Qingsong Wen
| Challenge: | Current mathematical benchmarks focus on evaluating MLLMs’ problem-solving ability, yet there is a crucial gap in addressing more complex scenarios such as error detection. |
| Approach: | They propose to evaluate multimodal error detection by evaluating two sub-tasks error step identification and error categorization. |
| Outcome: | The proposed task evaluates MLLMs' ability to handle multimodal questions compared to text-only models. |
MolTC: Towards Molecular Relational Modeling In Language Models (2024.findings-acl)
Copied to clipboard
Junfeng Fang, Shuai Zhang, Chang Wu, Zhengyi Yang, Zhiyuan Liu, Sihang Li, Kun Wang, Wenjie Du, Xiang Wang
| Challenge: | Molecular Relational Learning (MRL) is a promising way to understand interactions between molecular pairs. |
| Approach: | They propose a novel LLM-based multi-modal framework for molecular interaction modeling following Chain-of-Thought (CoT) theory which integrates graphical information of two molecules in pair. |
| Outcome: | The proposed framework integrates graphical information of two molecules in pair. |
DemonAgent: Dynamically Encrypted Multi-Backdoor Implantation Attack on LLM-based Agent (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new method for detecting advanced backdoors is proposed to bypass safety audits. |
| Approach: | They propose a backdoor implantation strategy that introduces dynamic encryption to bypass safety audits. |
| Outcome: | The proposed method achieves an attack success rate approaching 100% while maintaining a detection rate of 0%. |
TaxPraBen: A Scalable Benchmark for Structured Evaluation of LLMs in Chinese Real-World Tax Practice (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models excel in general domains but lack real-world practical capabilities. |
| Approach: | They propose a benchmark for Chinese taxation practice that combines 10 traditional application tasks with 3 pioneering real-world scenarios. |
| Outcome: | The proposed benchmark combines 10 traditional tasks with 3 pioneering real-world scenarios. |
FactVerse: A Benchmark for Factual Consistency in Interleaved Image–Text Generation (2026.acl-long)
Copied to clipboard
Yubo Shan, Kun Zhang, Qiming Xu, Liping Cao, Yingying Cao, Jian Zhang, Yu Wang, Jingyuan Li, Yuanzhuo Wang
| Challenge: | Existing benchmarks lack effective mechanisms to evaluate factual consistency in interleaved image-text generation. |
| Approach: | They propose a benchmark dedicated to evaluating factual consistency in interleaved image-text generation. |
| Outcome: | The proposed framework outperforms existing evaluation methods in evaluating factual consistency in interleaved image-text generation. |
RSA-Bench: Benchmarking Audio Large Models in Real-World Acoustic Scenarios (2026.findings-acl)
Copied to clipboard
Yibo Zhang, Kaiwen Luo, Liang Lin, Shilinlu Yan, Jin Wang, Yaoqi Guo, Yitian Chen, Yalan Qin, Zhenhong Zhou, Kun Wang, Li Sun
| Challenge: | Existing evaluations rely on synthetic Gaussian noise or simplistic single-source interference, failing to capture the intricate, multi-layered acoustic dynamics that characterize authentic physical environments. |
| Approach: | They propose a robustness benchmark to stress-test Audio Large Models (ALLMs) using high-fidelity auditory scene simulations. |
| Outcome: | The proposed model performs well on a wide range of tasks, including automatic speech recognition, speech translation, and audio-based reasoning. |
AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)
Copied to clipboard
Kangan Qian, Sicong Jiang, Yang Zhong, Ziang Luo, Zilin Huang, Tianze Zhu, Kun Jiang, Mengmeng Yang, Zheng Fu, Jinyu Miao, Yining Shi, He Zhe Lim, Li Liu, Tianbao Zhou, Hongyi Wang, Huang Yu, Yifei Hu, Guang Li, Guang Chen, Hao Ye, Lijun Sun, Diange Yang
| Challenge: | Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning. |
| Approach: | AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks. |
| Outcome: | Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% . |
STORM-BORN: A Challenging Mathematical Derivations Dataset Curated via a Human-in-the-Loop Multi-Agent Framework (2025.findings-acl)
Copied to clipboard
Wenhao Liu, Zhenyi Lu, Xinyu Hu, Jerry Zhang, Dailin Li, Jiacheng Cen, Huilin Cao, Haiteng Wang, Yuhan Li, Xie Kun, Dandan Li, Pei Zhang, Chengbo Zhang, Yuxiang Ren, Xiaohong Huang, Yan Ma
| Challenge: | Existing datasets suffer from outdated and insufficient challenging content, neglecting human-like reasoning, and limited reliability due to single-LLM generation. |
| Approach: | They propose a human-in-the-loop, multi-agent data generation framework that integrates reasoning-dense filters, multiagent collaboration, and human mathematicians’ evaluations to ensure the reliability and quality of the dataset. |
| Outcome: | The proposed framework improves accuracy and quality of the 2,000-synthesized datasets by integrating reasoning-dense filters, multi-agent collaboration, and human mathematicians’ evaluations. |
LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wild (2024.findings-acl)
Copied to clipboard
| Challenge: | Low-Rank Adaptation (LoRA) is an effective yet efficient solution for fine-tuning large language models. |
| Approach: | They propose a low-rank Adaptation framework that retrieves and composes multiple LoRAs according to input prompts. |
| Outcome: | Experimental results show that LoraRetriever outperforms baselines in terms of performance and versatility. |
Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that powerful pre-trained language models can be fooled by small perturbations or intentional attacks. |
| Approach: | They propose a framework for fine-tuning PLMs using a masked language model and Gaussian noise to augment semantically relevant examples with sufficient diversity. |
| Outcome: | The proposed framework improves the robustness of pre-trained language models and alleviates performance degradation under adversarial attacks. |
DyLex: Incorporating Dynamic Lexicons into BERT for Sequence Labeling (2021.emnlp-main)
Copied to clipboard
Baojun Wang, Zhao Zhang, Kun Xu, Guang-Yuan Hao, Yuyang Zhang, Lifeng Shang, Linlin Li, Xiao Chen, Xin Jiang, Qun Liu
| Challenge: | Existing approaches to integrate lexical knowledge into deep learning models are limited by large-scale dynamic lexicons. |
| Approach: | They propose a plug-in lexicon incorporation approach for BERT based sequence labeling tasks . they adopt word-agnostic tag embeddings to avoid re-training the representation . |
| Outcome: | The proposed framework achieves new SOTA even with large scale lexicons, the authors show . they adopt word-agnostic tag embeddings to avoid re-training the representation . |
G-Safeguard: A Topology-Guided Security Lens and Treatment on LLM-based Multi-agent Systems (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Model (LLM)-based Multi-agent Systems (MAS) have demonstrated remarkable capabilities in various complex tasks, but their vulnerability to adversarial attacks, misinformation propagation, and unintended behaviors have raised significant concerns. |
| Approach: | They propose a topology-guided security lens and treatment for robust LLM-MAS that leverages graph neural networks to detect anomalies on the multi-agent utterance graph and employ topological intervention for attack remediation. |
| Outcome: | Experiments show that the proposed security lens recovers 40% of the performance under various attack strategies and integrates with mainstream MAS with security guarantees. |
CRSLab: An Open-Source Toolkit for Building Conversational Recommender System (2021.acl-demo)
Copied to clipboard
Kun Zhou, Xiaolei Wang, Yuanhang Zhou, Chenzhan Shang, Yuan Cheng, Wayne Xin Zhao, Yaliang Li, Ji-Rong Wen
| Challenge: | Existing studies on conversational recommender systems lack a unified and standardized implementation or comparison. |
| Approach: | They propose to use a unified framework and highly-decoupled modules to develop CRSs. |
| Outcome: | The proposed framework collects 6 commonly used human-annotated CRS datasets and implements 19 models that include advanced techniques such as graph neural networks and pre-training models. |
JARVIS or Ultron? A Survey on the Safety and Security Threats of Computer-Using Agents (2026.acl-long)
Copied to clipboard
Ada Chen, Yongjiang Wu, Junyuan Zhang, Jingyu Xiao, Shu Yang, Jen-tse Huang, Kun Wang, Wenxuan Wang, Shuai Wang
| Challenge: | Recent advances in computer-using agents have created new safety and security risks . despite the impressive capabilities of CUAs, there are still significant security risks. |
| Approach: | They propose a systematization of knowledge on the safety and security threats of Computer-Using Agents. |
| Outcome: | The proposed framework provides a framework for assessing the safety and security risks of computer-using agents. |
DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AI (2024.findings-eacl)
Copied to clipboard
Jianguo Zhang, Kun Qian, Zhiwei Liu, Shelby Heinecke, Rui Meng, Ye Liu, Zhou Yu, Huan Wang, Silvio Savarese, Caiming Xiong
| Challenge: | DialogStudio is the largest and most diverse collection of dialogue datasets . existing datasets lack diversity and comprehensiveness, authors say . |
| Approach: | They introduce DialogStudio: the largest and most diverse collection of dialogue datasets . DialogStuio aggregates more than 80 diverse dialogue dataset . |
| Outcome: | a new dataset is created to improve the quality and diversity of dialogue datasets . DialogStudio is the largest and most diverse collection of dialogue data . |
Decoding-Unlearning: Fact Forgetting via Entropy-Guided Inference (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for large-scale modeling memorize sensitive information . however, they are limited in real-world scenarios and require updating parameters . |
| Approach: | They propose a training-free, plug-and-play inference-time unlearning strategy that uses a probe to detect queries involving forgettable concepts and applies entropy-guided decoding to suppress target knowledge. |
| Outcome: | Experiments on MUSE, RWKU, and WMDP datasets show that SEGUE outperforms existing methods. |
UniLR: Unleashing the Power of LLMs on Multiple Legal Tasks with a Unified Legal Retriever (2025.acl-long)
Copied to clipboard
Ang Li, Yiquan Wu, Yifei Liu, Ming Cai, Lizhi Qing, Shihang Wang, Yangyang Kang, Chengyuan Liu, Fei Wu, Kun Kuang
| Challenge: | Existing retrieval methods are designed for general domains, struggling with legal knowledge, or tailored for specific legal tasks, unable to handle diverse legal knowledge types. |
| Approach: | They propose a novel retrieval method that integrates specialized knowledge into LLMs. |
| Outcome: | The proposed method can perform multiple legal retrieval tasks for LLMs. |
Reinforcement Learning on Pre-Training Data (2026.acl-long)
Copied to clipboard
Siheng Li, Kejiao Li, Zenan Xu, Guanhua Huang, Kun Li, Haoyuan Wu, null Wujiajia, Zihao Zheng, Chenchen Zhang, Kun Shi, Xue Gong, Qi Yi, Ruibin Xiong, Tingqiang Xu, Yuhao Jiang, Jianfeng Yan, Yuyuan Zeng, Guanghui Xu, Jinbao Xue, Zhijiang xu, Zheng Fang, Shuai LI, Qibin Liu, Xiaoxue Li, Zhuoyu Li, Yangyu Tao, Fei Gao, Cheng Jiang, Bochao Wang, Kai Liu, Jianchen Zhu, Wai Lam, Bo Zhou, Di Wang
| Challenge: | Recent progress in large language models is driven by scaling of training compute through pre-training with nexttoken prediction (NTP) or post-training (RL) Pre-training using NTP enables models to acquire extensive knowledge and skills from general data, but it suffers from data inefficiency and catastrophic forgetting in continual learning settings. |
| Approach: | They propose to scale training compute through pre-training with next-token prediction (NTP) or post-training by scaling reinforcement learning (RL) to improve learning from general data. |
| Outcome: | Experiments on multiple benchmarks and models show that the proposed approach improves continual pre-training and provides a strong foundation for post-training on Qwen3-8B-Base. |
Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Persona (2023.acl-long)
Copied to clipboard
| Challenge: | Existing personalized dialogue agents model persona profiles from sparse or dense persona descriptions and dialogue histories. |
| Approach: | They propose a model that clusters dense persona descriptions into sparse categories and generates personalized responses from dialogue histories. |
| Outcome: | The proposed model improves on Chinese and English datasets. |
TopKG: Target-oriented Dialog via Global Planning on Knowledge Graph (2022.coling-1)
Copied to clipboard
| Challenge: | Existing target-oriented dialogs take a local and greedy strategy for response generation, where global planning is absent. |
| Approach: | They propose a global planning method for target-oriented dialog on a commonsense knowledge graph to adjust local response generation towards the global target. |
| Outcome: | The proposed method can reach the target with a higher success rate, fewer turns, and more coherent responses. |
CLEAR: Can Language Models Really Understand Causal Graphs? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing language models lack a conceptual framework for understanding causal graphs, but there is still potential for improvement. |
| Approach: | They develop a framework to define causal graph understanding by assessing language models’ behaviors through four practical criteria derived from diverse disciplines. |
| Outcome: | The proposed framework defines three complexity levels and encompasses 20 causal graph-based tasks across 20 different levels. |
iAgent: LLM Agent as a Shield between User and Recommender Systems (2025.findings-acl)
Copied to clipboard
Wujiang Xu, Yunxiao Shi, Zujie Liang, Xuying Ning, Kai Mei, Kun Wang, Xi Zhu, Min Xu, Yongfeng Zhang
| Challenge: | Traditional recommender systems focus on the user-platform paradigm, where users are directly exposed under the control of the platform's recommendation algorithms. |
| Approach: | They propose a user-agent-platform paradigm where agent serves as the protective shield between user and recommender system that enables indirect exposure. |
| Outcome: | The proposed model improves 16.6% over baselines on four datasets and mitigates echo chamber effects and reduces model bias in disadvantaged users. |
More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs (2024.emnlp-main)
Copied to clipboard
Chengyuan Liu, Yangyang Kang, Shihang Wang, Lizhi Qing, Fubang Zhao, Chao Wu, Changlong Sun, Kun Kuang, Fei Wu
| Challenge: | a recent study shows that performance on general tasks decreases after Large Language Models are fine-tuned on domain-specific tasks. |
| Approach: | They propose a general capability integration approach to integrate general capabilities and domain knowledge within a single instance. |
| Outcome: | The proposed method improves performance on domain-specific tasks by integrating general capabilities and domain knowledge. |
How to Build User Simulators to Train RL-based Dialog Systems (D19-1)
Copied to clipboard
| Challenge: | RL-based dialog systems require interaction with the environment and obtaining real human users to interact with the system is time-consuming and labor-intensive. |
| Approach: | They propose a method to standardize user simulator building to compare dialog system quality using the same set of user simulators. |
| Outcome: | The proposed method can be used by the community to compare dialog system quality using the same set of user simulators fairly. |
MMEKG: Multi-modal Event Knowledge Graph towards Universal Representation across Modalities (2022.acl-demo)
Copied to clipboard
Yubo Ma, Zehao Wang, Mukai Li, Yixin Cao, Meiqi Chen, Xinze Li, Wenqi Sun, Kunquan Deng, Kun Wang, Aixin Sun, Jing Shao
| Challenge: | Recent Knowledge Graphs (KGs) store billions of world facts in a directed graph, but expression ability of such entity-centric KGs is limited. |
| Approach: | They propose a large-scale multi-modal event knowledge graph named MMEKG that unifies different modalities of knowledge via events. |
| Outcome: | The proposed system unifies different modalities of knowledge via events, which complement and disambiguate each other. |
NetSafe: Exploring the Topological Safety of Multi-agent System (2025.findings-acl)
Copied to clipboard
Miao Yu, Shilong Wang, Guibin Zhang, Junyuan Mao, Chenlong Yin, Qijiong Liu, Kun Wang, Qingsong Wen, Yang Wang
| Challenge: | Large language models (LLMs) have fueled significant progress in intelligent Multi-agent Systems (MAS), with expanding academic and industrial applications. |
| Approach: | They propose a framework that unifies diverse MAS workflows via iterative RelCom interactions to enable generalized analysis. |
| Outcome: | The proposed framework unifies diverse MAS workflows via iterative RelCom interactions to enable generalized analysis. |
DEMO: Reframing Dialogue Interaction with Fine-grained Element Modeling (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) enabled dialogue systems are one of the central modes in human-machine interaction. |
| Approach: | They propose a benchmark task for dialogue element MOdeling and Element Awareness and a new benchmark for dialogue agent interaction that allows the agent to model dialogue elements via imitation learning. |
| Outcome: | The proposed agent performs well in both dialogue element modeling and out-of-domain tasks. |
Deploying Multi-task Online Server with Large Language Model (2025.coling-industry)
Copied to clipboard
| Challenge: | In the industry, numerous natural language processing tasks are deployed online . traditional approaches tackle each task separately by its own network and pipeline . |
| Approach: | They propose a three-stage multi-task learning framework for large language models . it involves task filtering, fine-tuning on high-resource tasks, and finally fine- tuning on all tasks . |
| Outcome: | The proposed framework reduces up to 90% of overhead while reducing latency and resource usage. |
Structural Information Preserving for Graph-to-Text Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing models that mess up or drop the core structural information of input graphs are lacking in graph-to-text generation. |
| Approach: | They propose to leverage richer training signals to guide a graph-to-text generation model by focusing on autoencoding losses and back-propagating the losses to better calibrate the model. |
| Outcome: | Experiments on two benchmarks show the proposed model over a state-of-the-art model . two types of autoencoding losses are used to back-propagate the model based on multitask training . |
Calibrating Inference Time Alignment with Sequence-level Risk Accumulation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to decode large language models (LLMs) often over-reject benign information, limiting their generalizability in real-world scenarios where harmful and benign information coexist. |
| Approach: | They propose a framework to regulate decoding alignments for Large Language Models (LLMs) they employ a reward-guided branch decoding paradigm to incorporate safety awareness during generation. |
| Outcome: | The proposed framework achieves superior performance on four attack benchmarks and two neutral datasets. |
Extracting and Combining Abilities For Building Multi-lingual Ability-enhanced Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing work relies on training with multi-lingual ability-related data, which may not be available for low-resource languages. |
| Approach: | They propose a multi-lingual ability-enhanced LLM that extracts language-agnostic ability-related weights from LLMs and combine them across different languages by simple addition and subtraction operations without training. |
| Outcome: | The proposed approach extracts language-agnostic ability-related weights from LLMs and combine them across different languages without training. |
WikiSeeker: Rethinking the Role of Vision-Language Models in Knowledge-Based Visual Question Answering (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for Knowledge-Based Visual Question Answering rely on images as the retrieval key, and often overlook or misplace the role of Vision-Language Models (VLMs) |
| Approach: | They propose a multi-modal RAG framework that assigns VLMs two specialized agents: a Refiner and an Inspector. |
| Outcome: | Experiments on EVQA, InfoSeek, and M2KR show that the proposed framework achieves state-of-the-art performance with significant improvements in both retrieval accuracy and answer quality. |
YuLan-Mini: Pushing the Limits of Open Data-efficient Language Model (2025.acl-long)
Copied to clipboard
Hu Yiwen, Huatong Song, Jie Chen, Jia Deng, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Zican Dong, Yang Lu, Xu Miao, Xin Zhao, Ji-Rong Wen
| Challenge: | prevailing pre-training approaches for large language models involve several complexities. |
| Approach: | They propose a low-cost training recipe and a robust optimization approach to mitigate training instability . they also propose synthesis, curriculum, and data selection pipelines to integrate data . |
| Outcome: | The proposed model achieves top-tier performance among models with similar parameter scale . it is comparable to industry-leading models that require significantly more data . |
InspireDebate: Multi-Dimensional Subjective-Objective Evaluation-Guided Reasoning and Optimization for Debating (2025.acl-long)
Copied to clipboard
| Challenge: | Existing LLMs focus on responding to specific arguments while neglecting objective assessments such as authenticity and logical validity. |
| Approach: | They propose a multi-dimensional evaluation system and an optimized debating framework . they propose to use coT reasoning enhancement, web-based Retrieval Augmented Generation to optimize across various dimensions. |
| Outcome: | The proposed framework outperforms baseline models in argument quality assessment and debate process simulation by 57%. |
CoEvo: Coevolution of LLM and Retrieval Model for Domain-Specific Information Retrieval (2025.emnlp-main)
Copied to clipboard
Ang Li, Yiquan Wu, Yinghao Hu, Lizhi Qing, Shihang Wang, Chengyuan Liu, Tao Wu, Adam Jatowt, Ming Cai, Fei Wu, Kun Kuang
| Challenge: | Recent methods to enhance queries by generating intermediary elements can degrade retrieval performance . combining LLMs and retrievers can be difficult, resulting in unreliable or irrelevant intermediaries . |
| Approach: | They propose a framework that facilitates the coevolution of large language models and retrieval models. |
| Outcome: | The proposed framework facilitates the coevolution of LLMs and retrieval models. |
Automatic Slide Updating with User-Defined Dynamic Templates and Natural Language Instructions (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing automation methods follow fixed template filling and cannot support dynamic updates for diverse, user-authored decks. |
| Approach: | They propose a framework that combines multimodal slide parsing, natural language instruction grounding, and tool-augmented reasoning for tables, charts, and textual conclusions. |
| Outcome: | The proposed framework updates content while preserving layout and style while maintaining a strong reference baseline on DynaSlide. |
ERGO: Event Relational Graph Transformer for Document-level Event Causality Identification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to identify event-event causal relations in a document are noisy and require heuristic rules or external tools. |
| Approach: | They propose a document-level event-event causality identification framework that uses heuristic rules to design edges between events. |
| Outcome: | The proposed framework outperforms existing state-of-the-art methods on two benchmark datasets. |
Meta-CQG: A Meta-Learning Framework for Complex Question Generation over Knowledge Bases (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods train one encoder-decoder-based model to fit all questions . however, such a one-size-fits-all strategy may not perform well for complex questions involving multiple KB relations or functional constraints. |
| Approach: | They propose a meta-learning framework for complex question generation over knowledge bases . they propose he meta-trained generator can acquire universal meta-knowledge . |
| Outcome: | The proposed framework can acquire universal and transferable meta-knowledge and quickly adapt to long-tailed samples under different dimensions. |
A Comparison between Pre-training and Large-scale Back-translation for Neural Machine Translation (2021.findings-acl)
Copied to clipboard
| Challenge: | BERT is a promising technique to improve NMT, but how it outperforms standard NMT is understudied. |
| Approach: | We compare MT engines trained with pre-trained BERT and back-translation with incrementally larger amounts of data. |
| Outcome: | The proposed technique outperforms standard NMT models on morphology and syntax. |
Question Tells You Where the Answer Is: Intention-aware Long-Context KV Cache Compression (2026.acl-long)
Copied to clipboard
Liang Zhao, Xiaocheng Feng, Weihong Zhong, Lei Huang, Kun Zhu, Baoxin Wang, Dayong Wu, Guoping Hu, Ting Liu, Bing Qin
| Challenge: | Recent methods to reduce the KV cache size fail to identify crucial KVs for generation while excluding others accurately, resulting in severe information loss. |
| Approach: | They propose an intention-aware KV cache eviction method that identifies and retains crucial KVs according to the attention distribution of intention, which semantically reflects the user’s goal and determines which part of the context is relevant. |
| Outcome: | The proposed method can maintain the model performance while reducing the KV cache size from 128K to 2K, leading to a 6.3x increase in decoding speed and 7.8x enhancement in memory efficiency compared to the default setting. |
Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All Scenarios (2024.findings-acl)
Copied to clipboard
Lei Lin, Jiayi Fu, Pengli Liu, Qingyang Li, Yan Gong, Junchen Wan, Fuzheng Zhang, Zhongyuan Wang, Di Zhang, Kun Gai
| Challenge: | chain-of-thought (CoT) prompting has been shown to be effective on complex reasoning tasks, but the naive greedy decoding used in CoT prompting causes the repetitiveness and local optimality. |
| Approach: | They propose a generalizable ensemble-optimization method that uses a set of reasoning paths to prompt a language model one more time to determine the optimal answer. |
| Outcome: | The proposed method can be generalized to almost all scenarios where the type of input questions and answer format of reasoning paths may be unknown. |
Robustness-Aware Word Embedding Improves Certified Robustness to Adversarial Word Substitutions (2023.findings-acl)
Copied to clipboard
| Challenge: | Embedding interval bound constraint is important for NLP models to be certified robust, but adversarial examples can be crafted by synonym substitutions. |
| Approach: | They propose a triplet loss to train robustness-aware word embeddings for better certified robustness. |
| Outcome: | The proposed method outperforms state-of-the-art certified defense baselines and generalizes well to unseen substitutions. |
Identifying Tension in Holocaust Survivors’ Interview: Code-switching/Code-mixing as Cues (2022.lrec-1)
Copied to clipboard
| Challenge: | Using CS/CM as a linguistic phenomenon could be a sign of tension in Holocaust survivors’ interviews. |
| Approach: | They annotated CS/CM codes and annotate silence situations in an open corpus . they found that most annotations were captured in the tension places . |
| Outcome: | The proposed method shows that annotations are captured in the tension places . the study calls for more research endeavors on tension detection . |
Crowdsource, Crawl, or Generate? Creating SEA-VL, a Multicultural Vision-Language Dataset for Southeast Asia (2025.acl-long)
Copied to clipboard
Samuel Cahyawijaya, Holy Lovenia, Joel Ruben Antony Moniz, Tack Hwa Wong, Mohammad Rifqi Farhansyah, Thant Thiri Maung, Frederikus Hudi, David Anugraha, Muhammad Ravi Shulthan Habibi, Muhammad Reza Qorib, Amit Agarwal, Joseph Marvin Imperial, Hitesh Laxmichand Patel, Vicky Feliren, Bahrul Ilmi Nasution, Manuel Antonio Rufino, Genta Indra Winata, Rian Adam Rajagede, Carlos Rafael Catalan, Mohamed Fazli Mohamed Imam, Priyaranjan Pattnayak, Salsabila Zahirah Pranida, Kevin Pratama, Yeshil Bangera, Adisai Na-Thalang, Patricia Nicole Monderin, Yueqi Song, Christian Simon, Lynnette Hui Xian Ng, Richardy Lobo Sapan, Taki Hasan Rafi, Bin Wang, null Supryadi, Kanyakorn Veerakanjana, Piyalitt Ittichaiwong, Matthew Theodore Roque, Karissa Vincentio, Takdanai Kreangphet, Phakphum Artkaew, Kadek Hendrawan Palgunadi, Yanzhi Yu, Rochana Prih Hastuti, William Nixon, Mithil Bangera, Adrian Xuan Wei Lim, Aye Hninn Khine, Hanif Muhammad Zhafran, Teddy Ferdinan, Audra Aurora Izzani, Ayushman Singh, Evan Evan, Jauza Akbar Krito, Michael Anugraha, Fenal Ashokbhai Ilasariya, Haochen Li, John Amadeo Daniswara, Filbert Aurelian Tjiaranata, Eryawan Presma Yulianrifat, Can Udomcharoenchaikit, Fadil Risdian Ansori, Mahardika Krisna Ihsani, Giang Nguyen, Anab Maulana Barik, Dan John Velasco, Rifo Ahmad Genadi, Saptarshi Saha, Chengwei Wei, Isaiah Edri W. Flores, Kenneth Chen Ko Han, Anjela Gail D. Santos, Wan Shen Lim, Kaung Si Phyo, Tim Santos, Meisyarah Dwiastuti, Jiayun Luo, Jan Christian Blaise Cruz, Ming Shan Hee, Ikhlasul Akmal Hanif, M.Alif Al Hakim, Muhammad Rizky Sya’ban, Kun Kerdthaisong, Lester James Validad Miranda, Fajri Koto, Tirana Noor Fatyanosa, Alham Fikri Aji, Jostin Jerico Rosal, Jun Kevin, Robert Wijaya, Onno P. Kampman, Ruochen Zhang, Börje F. Karlsson, Peerat Limkonchotiwat
| Challenge: | Southeast Asia is underrepresented in vision-language research . SEA-VL is an open-source initiative dedicated to developing culturally relevant datasets for SEA languages. |
| Approach: | They propose to use crowdsourced, automated image crawling and synthetic image generation to develop culturally relevant datasets for SEA languages. |
| Outcome: | The proposed datasets capture SEA cultural nuances and contexts better than existing datasets. |
MTGP: Multi-turn Target-oriented Dialogue Guided by Generative Global Path with Flexible Turns (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches focus on global planning, which plans toward the target before the conversation. |
| Approach: | They propose to generate a global path as a natural language sentence instead of a sequence of nodes. |
| Outcome: | The proposed method has fewer turns, more coherent semantics, and higher success rate than baselines. |
TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Rapid advances in Large Language Models have spurred demand for processing extended context sequences . however, performance degradation due to sequence lengths out-of-distribution and excessively long inference times are limiting LLMs in long-context scenarios. |
| Approach: | They propose a training-free method for efficient and accurate long-context inference . they selectively involves a few critical KV cache tokens in attention calculation . |
| Outcome: | The proposed method speeds up attention computation and accelerates inference time while reducing selection overhead. |
Knowledge Graph-Driven Memory Editing with Directional Interventions (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are hampered by inaccuracies and outdated information. |
| Approach: | They propose a framework that constructs knowledge graphs using available information to guide the direction of knowledge editing. |
| Outcome: | The proposed framework allows consistent, aligned, and stable information during large-scale editing scenarios. |
Towards Effective and Efficient Continual Pre-training of Large Language Models (2025.acl-long)
Copied to clipboard
Jie Chen, Zhipeng Chen, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Yingqian Min, Xin Zhao, Zhicheng Dou, Jiaxin Mao, Yankai Lin, Ruihua Song, Jun Xu, Xu Chen, Rui Yan, Zhewei Wei, Di Hu, Wenbing Huang, Ji-Rong Wen
| Challenge: | Continual pre-training (CPT) has been an important approach for adapting language models to specific domains or tasks. |
| Approach: | They propose a Continual pre-training method that can greatly improve Chinese language ability and scientific reasoning ability of LLMs. |
| Outcome: | The proposed method can greatly improve Chinese language ability and scientific reasoning ability of LLMs. |
Streaming Hallucination Detection in Long Chain-of-Thought Reasoning (2026.findings-acl)
Copied to clipboard
Haolang Lu, Minghui Pan, Ripeng LI, Guoshun Nan, Jialin Zhuang, Zijie Zhao, Zhongxiang Sun, Kun Wang, Yang Liu
| Challenge: | Long chain-of-thought reasoning improves performance of large language models, yet hallucinations in such settings often emerge subtly and propagate across reasoning steps. |
| Approach: | They propose to treat step-level hallucination judgments as local observations and introduce a cumulative prefix-level signal that tracks the global evolution of the reasoning state over the entire trajectory. |
| Outcome: | The proposed method enables streaming hallucination detection in long CoT reasoning, providing real-time, interpretable evidence. |
Enhancing Key-Value Memory Neural Networks for Knowledge Based Question Answering (N19-1)
Copied to clipboard
| Challenge: | Existing Key-value Memory Neural Networks are effective for shallow reasoning over documents . but extending them to Knowledge Based Question Answering is not trivial . |
| Approach: | They propose a mechanism to enable conventional KV-MemNNs models to perform interpretable reasoning for complex questions. |
| Outcome: | The proposed solution provides better reasoning abilities on complex questions and achieves state-of-the-art performance. |
Length Controlled Generation for Black-box LLMs (2025.acl-long)
Copied to clipboard
Yuxuan Gu, Wenjie Wang, Xiaocheng Feng, Weihong Zhong, Kun Zhu, Lei Huang, Ting Liu, Bing Qin, Tat-Seng Chua
| Challenge: | Existing length control methods involve fine-tuning the parameters of LLMs, which is inefficient and suboptimal for practical use. |
| Approach: | They propose an iterative sampling framework that regulates LLMs to generate length-constrained text without modifying the underlying parameters. |
| Outcome: | The proposed method achieves 100% success rates on Llama3.1 tasks with minimal additional computational overhead. |
ODTQA-FoRe: An Open-Domain Tabular Question Answering Dataset for Future Data Forecasting and Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing tabular question answering systems cannot perform future-oriented numerical prediction . open-domain tabular questions are a popular approach for QA tasks . |
| Approach: | They propose a task that covers time-series forecasting and forecast-based reasoning scenarios using real estate data. |
| Outcome: | The proposed framework decomposes the problem into three collaborative roles that synthesize the results to construct a precise and consistent final answer. |
Continual Pre-training of Language Models for Math Problem Understanding with Syntax-Aware Memory Network (2022.acl-long)
Copied to clipboard
| Challenge: | a fundamental challenge in modeling math problems is how to fuse semantics of textual description and formulas. |
| Approach: | They propose a method to continually pre-train language models for improving understanding of math problems with syntax-aware memory networks. |
| Outcome: | The proposed approach outperforms competitive baselines on four math tasks. |
DynamicNER: A Dynamic, Multilingual, and Fine-Grained Dataset for LLM-based Named Entity Recognition (2025.emnlp-main)
Copied to clipboard
Hanjun Luo, Yingbin Jin, Yiran Wang, Xinfeng Li, Tong Shang, Xuecheng Liu, Ruizhe Chen, Kun Wang, Hanan Salam, Qingsong Wen, Zuozhu Liu
| Challenge: | Existing datasets designed for Named Entity Recognition methods are inadequate for LLMs. |
| Approach: | They propose a dataset that is multilingual and multi-granular and enables LLMs to be applied to Named Entity Recognition methods. |
| Outcome: | The proposed dataset is multilingual and multi-granular, covering 8 languages and 155 entity types, with corpora spanning a diverse range of domains. |
HearSay Benchmark: Do Audio LLMs Leak What They Hear? (2026.findings-acl)
Copied to clipboard
Jin Wang, Kaiwen Luo, Liang Lin, Weiliu Wang, Yitian Chen, Moayad Aloqaily, Xuehai Tang, Zhenhong Zhou, Kun Wang, Li Sun, Qingsong Wen
| Challenge: | Recent advances in audio large language models have led to their potential privacy implications unexplored. |
| Approach: | They propose a benchmark to examine whether ALLMs leak user privacy through acoustic voiceprints. |
| Outcome: | The proposed benchmark is constructed from over 22,000 real-world audio clips. |
Can LLMs Really Judge? A Progressive Argumentation-Mining Framework for Distinguishing Understanding from Aggregation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluations of large language models rely on dataset-based generation accuracy . however, generative correctness does not guarantee discriminative capability to verify solutions . |
| Approach: | They propose a diagnostic framework that explicitly controls context and isolates discriminative behaviors. |
| Outcome: | The proposed framework explicitly controls context and isolates discriminative behaviors. |
Towards Topic-Guided Conversational Recommender System (2020.coling-main)
Copied to clipboard
| Challenge: | Existing CRS datasets focus on immediate requests from users, while lack proactive guidance to the recommendation scenario. |
| Approach: | They propose a topic-guided conversational recommendation dataset . it incorporates topic threads to enforce natural semantic transitions towards the recommendation scenario . |
| Outcome: | The proposed approach is more reasonable and controllable than previous approaches. |
Improving Open-Domain Dialogue Systems via Multi-Turn Incomplete Utterance Restoration (D19-1)
Copied to clipboard
| Challenge: | Experimental results show that restoring incomplete utterances from context improves the performance of open-domain dialogue systems. |
| Approach: | They propose to use a dataset to restore incomplete utterances from context . they propose to pick and combine the data to restore the incomplete . |
| Outcome: | The proposed model significantly boosts response quality of open-domain dialogue systems. |
VisCRA: A Visual Chain Reasoning Attack for Jailbreaking Multimodal Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in Large Reasoning Models (LRMs) have enabled sophisticated visual reasoning capabilities by integrating reinforcement learning and Chain-of-Thought (CoT) supervision. |
| Approach: | They propose a jailbreak framework that exploits visual reasoning chains to bypass safety mechanisms. |
| Outcome: | The proposed framework achieves high attack success rates on leading closed-source MLRMs. |
OTExtSum: Extractive Text Summarisation with Optimal Transport (2022.findings-naacl)
Copied to clipboard
| Challenge: | Extractive text summarisation aims to select salient sentences from a document to form a short yet informative summary. |
| Approach: | They propose to formulate extractive text summarisation as an Optimal Transport (OT) problem and use it to obtain an optimal summary that minimises the transportation cost to a given document. |
| Outcome: | The proposed method outperforms state-of-the-art methods and learning-based methods on multiNews, PubMed, BillSum, and CNN/DM datasets. |
A General Knowledge Injection Framework for ICD Coding (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to improve ICD coding focus on a single type of knowledge and design specialized modules that are complex and incompatible with each other. |
| Approach: | They propose a general knowledge injection framework that integrates three key types of knowledge without specialized design of additional modules. |
| Outcome: | The proposed framework outperforms baseline models and is comparable to models relying on extra human annotations. |
ODUTQA-MDC: A Task for Open-Domain Underspecified Tabular QA with Multi-turn Dialogue-based Clarification (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to tabular QA are limited to closed-domain scenarios . existing approaches do not solve the core challenge of generating correct answers without user clarification . |
| Approach: | They propose a benchmark to tackle underspecified or uncertain queries in tabular question answering . they propose ODUTQA-MDC task and a multi-agent framework to detect ambiguities . |
| Outcome: | The proposed framework excels at detecting ambiguities, clarifying them through dialogue, and refining answers. |
Prompt for Extraction? PAIE: Prompting Argument Interaction for Event Argument Extraction (2022.acl-long)
Copied to clipboard
| Challenge: | Using a prompt-based model, we find that event argument extraction is efficient and generalized well to few-shot settings. |
| Approach: | They propose a model PAIE for event argument extraction using prompt tuning for extractive objectives. |
| Outcome: | The proposed model can extract arguments with the same role instead of heuristic threshold tuning. |
A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challenges (2025.findings-acl)
Copied to clipboard
Yibo Yan, Jiamin Su, Jianxiang He, Fangteng Fu, Xu Zheng, Yuanhuiyi Lyu, Kun Wang, Shen Wang, Qingsong Wen, Xuming Hu
| Challenge: | This survey provides **the first comprehensive analysis of mathematical reasoning in the era of multimodal large language models** . integrating large language model with mathematical reasoning tasks is becoming significant as AI advances . |
| Approach: | They review over 200 studies published since 2021 and examine the state-of-the-art developments in Math-LLMs . they identify five major challenges hindering the realization of AGI in this domain . |
| Outcome: | The authors examine the state-of-the-art developments in Math-LLMs with a focus on multimodal settings. |
Exploiting Contrastive Learning and Numerical Evidence for Confusing Legal Judgment Prediction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies fail to distinguish different classification errors with a standard cross-entropy classification loss and ignore the numbers in the fact description for predicting the term of penalty. |
| Approach: | They propose to extract crime amounts from fact description and use them to learn distinguishable representations to exploit the numbers in the fact description for predicting the term of penalty. |
| Outcome: | The proposed method achieves state-of-the-art results on real-world datasets and ablation studies demonstrate the effectiveness of each component. |
RAST: Domain-Robust Dialogue Rewriting as Sequence Tagging (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for dialogue rewriting suffer from the robustness issue, i.e., performances drop dramatically when testing on a different dataset. |
| Approach: | They propose a sequence-tagging-based approach that reduces the search space while preserving the core of the task. |
| Outcome: | The proposed model significantly reduces the search space while still covering the core of the task. |
CIA: Inferring the Communication Topology from LLM-based Multi-Agent Systems (2026.acl-long)
Copied to clipboard
| Challenge: | LLM-based multi-agent systems (MAS) have demonstrated remarkable capabilities in solving complex tasks. |
| Approach: | They propose a communication inference attack that constructs new adversarial queries to induce intermediate agents’ reasoning outputs and models their semantic correlations through the global bias disentanglement and LLM-guided weak supervision. |
| Outcome: | The proposed attack achieves an average AUC of 0.87 and a peak AUC up to 0.99, revealing the privacy risk in MAS. |
Exploiting Rich Syntactic Information for Semantic Parsing with Graph-to-Sequence Model (D18-1)
Copied to clipboard
| Challenge: | Existing neural semantic parsers extract word order features while neglecting other valuable syntactic information. |
| Approach: | They propose to use syntactic graph to represent three types of syntaktic information . they then employ a graph-to-sequence model to encode the syntastic graph and decode a logical form . |
| Outcome: | The proposed model is comparable to the state-of-the-art on Jobs640, ATIS, and Geo880. |
DuSQL: A Large-Scale and Pragmatic Chinese Text-to-SQL Dataset (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing text-to-SQL parsing methods mainly focus on English, but there is no labeled data available for the language . a larges-scale and pragmatic Chinese dataset is used for cross-domain text- to-Sql task . |
| Approach: | They propose a larges-scale Chinese dataset for a cross-domain text-to-SQL task . they analyze questions from several representative applications and use an effective data construction framework . |
| Outcome: | The proposed dataset contains 200 databases, 813 tables, and 23,797 question/SQL pairs. |
PASUM: A Pre-training Architecture for Social Media User Modeling Based on Text Graph (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have incorporated different digital traces to better learn the representations of social media users, limited by overloaded text information and hard-to-collect social network information. |
| Approach: | They propose a Pre-training Architecture for Social Media User Modeling based on Text Graph and combine microblogs to represent social media users based upon the text graph model. |
| Outcome: | The proposed framework can represent users based on text even without social network information on microblogs. |
Position: LLMs Can be Good Tutors in English Education (2025.emnlp-main)
Copied to clipboard
Jingheng Ye, Shen Wang, Deqing Zou, Yibo Yan, Kun Wang, Hai-Tao Zheng, Ruitong Liu, Zenglin Xu, Irwin King, Philip S. Yu, Qingsong Wen
| Challenge: | Recent efforts to integrate large language models into English education lack adaptability to language learning. |
| Approach: | They argue that large language models can be effective tutors in English education . they encourage interdisciplinary research to explore these roles, fostering innovation and risks . |
| Outcome: | The proposed models can play three critical roles: 1) as data enhancers, 2) as task predictors, 3) as agents, enabling personalized and inclusive education. |
What Have We Achieved on Text Summarization? (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text summarization have been investigated, but there are still gaps between them and human professionals. |
| Approach: | They analyze 8 major sources of errors on 10 representative summarization models manually. |
| Outcome: | Aiming to gain more understanding of summarization systems with respect to their strengths and limitations on a fine-grained syntactic and semantic level, we use 8 major sources of errors on 10 representative summarizing models. |
Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsing (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to parse text-to-SQL data are lacking labeled data for unseen evaluation databases. |
| Approach: | They propose a framework for enhancing SQL queries by automatically producing large numbers of SQL queries based on an abstract syntax tree grammar. |
| Outcome: | The proposed framework can produce high-quality natural language questions over strong baselines. |
GaLa: Hypergraph-Guided Visual Language Models for Procedural Planning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for procedural planning over-rely on visual inputs and lack structured semantic information. |
| Approach: | They propose a vision–language framework for multimodal procedural planning that exploits implicit spatial relations and deep semantics encoded in object attributes. |
| Outcome: | The proposed framework outperforms existing methods in terms of execution success rate, LCS, and planning correctness. |
Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are becoming increasingly popular in education, enabling researchers to simulate students' learning patterns and learning patterns. |
| Approach: | They propose a training-free framework for student simulation that takes into account student cognitive diversity and realism. |
| Outcome: | The proposed model outperforms baseline models and achieves 100% improvement in simulation accuracy and realism. |
LLMBox: A Comprehensive Library for Large Language Models (2024.acl-demos)
Copied to clipboard
Tianyi Tang, Hu Yiwen, Bingqian Li, Wenyang Luo, ZiJing Qin, Haoxiang Sun, Jiapeng Wang, Shiyi Xu, Xiaoxue Cheng, Geyang Guo, Han Peng, Bowen Zheng, Yiru Tang, Yingqian Min, Yushuo Chen, Jie Chen, Ranchi Zhao, Luran Ding, Yuhao Wang, Zican Dong, Xia Chunxuan, Junyi Li, Kun Zhou, Xin Zhao, Ji-Rong Wen
| Challenge: | a library to facilitate the development, use, and evaluation of large language models (LLMs) is presented. |
| Approach: | They propose a unified library to facilitate the development, use and evaluation of large language models (LLMs). |
| Outcome: | The proposed library is based on extensive experiments in a variety of evaluation settings. |
Synonym Knowledge Enhanced Reader for Chinese Idiom Reading Comprehension (2020.coling-main)
Copied to clipboard
| Challenge: | Experimental results show that our model achieves state-of-the-art performance for Chinese idiom comprehension. |
| Approach: | They propose a model that can mitigate the inconsistency between literal and literal meanings by incorporating the synonym knowledge enhanced reader into the model. |
| Outcome: | The proposed model achieves state-of-the-art on a Chinese idiom reading comprehension dataset. |
Unleashing the Native Recommendation Potential: LLM-Based Generative Recommendation via Structured Term Identifiers (2026.findings-acl)
Copied to clipboard
Zhiyang Zhang, Junda She, Kuo Cai, Bo Chen, Shiyao Wang, Xinchen Luo, Qiang Luo, Ruiming Tang, Han Li, Kun Gai, Guorui Zhou
| Challenge: | Existing methods for constructing item identifiers face bottlenecks due to their large output space and expensive vocabulary expansion and alignment training. |
| Approach: | They propose to use Large Language Models to develop general-purpose, semantically-aware recommender systems that can be generalized and reusable. |
| Outcome: | Experiments on real-world datasets show that GRAM outperforms baselines and significantly outperformed baselines. |
Stick to the Facts: Learning towards a Fidelity-oriented E-Commerce Product Description Generation (D19-1)
Copied to clipboard
Zhangming Chan, Xiuying Chen, Yongliang Wang, Juntao Li, Zhiqiang Zhang, Kun Gai, Dongyan Zhao, Rui Yan
| Challenge: | Existing models for product description generation do not take the product attribute information into account. |
| Approach: | They propose a model that takes the embedding and the entity label of each word into account . they establish a keyword memory that stores the entity labels as keys and keywords as values . |
| Outcome: | The proposed model increases the fidelity of the generated descriptions by 25%. |
TextHacker: Learning based Hybrid Local Search Algorithm for Text Hard-label Adversarial Attack (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing textual adversarial attacks use gradient or prediction confidence to generate adversarials, making it hard to be deployed in real-world applications. |
| Approach: | They propose a textual adversarial attack that randomly perturbs lots of words to craft an adversarial example. |
| Outcome: | The proposed attack outperforms existing hard-label attacks in terms of attack performance and adversary quality. |
FiDeLiS: Faithful Reasoning in Large Language Models for Knowledge Graph Question Answering (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing retrieval-based or agent-based methods are prone to generating erroneous or hallucinated outputs. |
| Approach: | They propose a framework to leverage knowledge graphs as external knowledge sources to improve the factuality of LLM responses by anchoring answers to verifiable reasoning steps retrieved from KGs. |
| Outcome: | The proposed framework improves factuality and interpretability across benchmarks and reduces computational costs. |
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)
Copied to clipboard
Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu
| Challenge: | a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide. |
| Approach: | They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions . |
| Outcome: | The proposed agents are based on operating systems (OS) and operating systems frameworks. |
What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Instruction Tuning (2025.coling-main)
Copied to clipboard
Yifan Du, Hangyu Guo, Kun Zhou, Wayne Xin Zhao, Jinpeng Wang, Chuyuan Wang, Mingchen Cai, Ruihua Song, Ji-Rong Wen
| Challenge: | Experimental results show that visual instruction tuning improves performance of Multi-modal Large Language Models (MLLMs) to extend the application scope of Large Language Modells, a surge of work augments LLMs with vision encoders to endow the ability of multi-modal cognition and reasoning. |
| Approach: | They propose a systematic approach to create high-quality visual reasoning instructions using a synthesize-complicate-reformulate paradigm. |
| Outcome: | The proposed method improves performance of MLLMs by 27.86% and 27.60% on MME-Perception and MME Cognition. |
Guiding Dialogue Agents to Complex Semantic Targets by Dynamically Completing Knowledge Graph (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge graphs are incomplete in tracking complex semantic relations of the target-oriented dialogue. |
| Approach: | They combine methods of knowledge retrieval and relationship prediction to construct a context-related dynamic KG and a metric to evaluate the tracked path automatically. |
| Outcome: | The proposed method can control the agent more logically and smoothly toward the complex target. |
Decoding at the Speed of Thought: Harnessing Parallel Decoding of Lexical Units for LLMs (2024.lrec-main)
Copied to clipboard
Chenxi Sun, Hongzhi Zhang, Zijia Lin, Jingyuan Zhang, Fuzheng Zhang, Zhongyuan Wang, Bin Chen, Chengru Song, Di Zhang, Kun Gai, Deyi Xiong
| Challenge: | Large language models have demonstrated exceptional capability in natural language understanding and generation, but their generation speed is limited by the inherently sequential nature of their decoding process. |
| Approach: | They propose a method that accelerates decoding process without sacrificing quality . they propose lexical unit decoding, which can be integrated with other methods . |
| Outcome: | The proposed method significantly reduces decoding time while maintaining quality while maintaining output quality. |
Detecting Customer Complaint Escalation with Recurrent Neural Networks and Manually-Engineered Features (N19-2)
Copied to clipboard
Wei Yang, Luchen Tan, Chunwei Lu, Anqi Cui, Han Li, Xi Chen, Kun Xiong, Muzi Wang, Ming Li, Jian Pei, Jimmy Lin
| Challenge: | e-commerce companies often have the option of escalating complaints by filing grievances with a government authority . this is detrimental to an ecommerce company, but this problem is challenging to solve by integrating recurrent neural networks with manually-engineered features. |
| Approach: | They propose a model that integrates recurrent neural networks with manually-engineered features to identify cases where the customer expresses such an intent. |
| Outcome: | The proposed model outperforms baseline models and provides better recall and triage for specialized agents. |
Code-Switching for Enhancing NMT with Pre-Specified Translation (N19-1)
Copied to clipboard
| Challenge: | Existing methods to constrain NMT use placeholder tags for lexicon words and hard constraints during decoding. |
| Approach: | They propose to use placeholder tags to replace lexicon words with target translations . they use a data augmentation method to make code-switched training data . |
| Outcome: | The proposed method improves translation quality without hurting unconstrained words. |
BeamAggR: Beam Aggregation Reasoning over Multi-source Knowledge for Multi-hop Question Answering (2024.acl-long)
Copied to clipboard
Zheng Chu, Jingchang Chen, Qianglong Chen, Haotian Wang, Kun Zhu, Xiyuan Du, Weijiang Yu, Ming Liu, Bing Qin
| Challenge: | Large language models (LLMs) have demonstrated strong reasoning capabilities, but they still suffer from factual errors when tackling knowledge-intensive tasks. |
| Approach: | They propose a reasoning framework for knowledge-intensive multi-hop QA that prioritizes promising answers at each hop of question. |
| Outcome: | The proposed framework outperforms SOTA methods on four open-domain multi-hop reasoning datasets by 8.5%. |
OneRec-Think: In-Text Reasoning for Generative Recommendation (2026.acl-long)
Copied to clipboard
Zhanyu Liu, Shiyao Wang, Xingmei Wang, Rongzhou Zhang, Jiaxin Deng, Honghui Bao, Jinghao Zhang, Wuchao Li, PengFei Zheng, Xiangyu Wu, Yifei Hu, Qigen Hu, Xinchen Luo, Lejian Ren, Zhang Zixing, Qianqian Wang, Kuo Cai, Yunfan Wu, Hongtao Cheng, Zexuan Cheng, Lu Ren, Huanjie Wang, Yi Su, Ruiming Tang, Kun Gai, Guorui Zhou
| Challenge: | Existing generative models lack the capacity for explicit and controllable reasoning, a key advantage of LLMs. |
| Approach: | They propose a framework that integrates dialogue, reasoning, and personalized recommendation. |
| Outcome: | Experiments across public benchmarks show state-of-the-art performance. |
Aligning Recommendation and Conversation via Dual Imitation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing conversational recommendation systems ignore the advantage of user interest shift in connecting recommendation and conversation, leading to an ineffective loose coupling structure. |
| Approach: | They propose a dual imitation to explicitly align recommendation and conversation paths . they propose to generate high-quality responses with accurate recommendations and coherent explanations . |
| Outcome: | The proposed model outperforms the state-of-the-art models on recommendation and conversation performance with automatic, human, and novel explainability metrics. |
Not Everything is All You Need: Toward Low-Redundant Optimization for Large Language Model Alignment (2024.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that large language models are struggling to align with human preference in complex tasks and scenarios. |
| Approach: | They propose a low-redundant alignment method that selects the top-10% most updated parameters in LLMs for alignment training. |
| Outcome: | The proposed method improves on 10 datasets and shows that it is redundant . it can be used to train LLMs on QA and ECQA datasets, but it is not feasible to test it on a large dataset. |
Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Network (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual knowledge graph (KG) alignment rely on entity embeddings derived from monolingual KG structural information. |
| Approach: | They propose a topic entity graph to represent entities with contextual information in KGs. |
| Outcome: | The proposed model outperforms state-of-the-art methods by a large margin. |
CORES: Code-Oriented Reasoning for Complex Text-to-SQL and Generalizable TableQA (2026.findings-acl)
Copied to clipboard
Meng Zhang, Ruochun Jin, Yuanxi Peng, Wenjing Yang, Haotian Wang, Liting Sun, Kun Hu, Silin Yang, Zhang Ke-di
| Challenge: | Text-to-SQL models struggle with complex analytical tasks such as generating simple SQL queries. |
| Approach: | They propose a text-to-sql model that leverages Python as a procedural reasoning pivot to enhance both complex SQL generation and tabular reasoning. |
| Outcome: | The proposed model outperforms baseline models on six text-to-SQL benchmarks by 6.44% on average while maintaining good capability on three tableQA benchmarks. |
VarBench: Robust Language Model Benchmarking Through Dynamic Variable Perturbation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent benchmarks release only training and validation sets, keeping the test set labels closed-source. |
| Approach: | They propose to extract variables from each test case and define a value range for each variable. |
| Outcome: | The proposed method improves the accuracy of the evaluations on four datasets covering mathematical generation and multiple-choice tasks. |
Scaling Law for Multimodal Large Language Model Supervised Fine-Tuning (2026.acl-long)
Copied to clipboard
YiFan Zhang, Tao Yu, Feng Li, Chaoyou Fu, Yibo Hu, Kun Wang, Qingsong Wen, Zhang Zhang, Liang Wang, Rong Jin
| Challenge: | supervised fine-tuning (SFT) is crucial for multimodal large language models, yet a comprehensive scaling law is lacking . et al.: scaling laws focus on model size, pre-training tokens, and MLLM SFT data volumes . |
| Approach: | They propose two scaling laws to guide optimal model-data configuration . they propose one applicable when training data volumes are well defined by researchers . |
| Outcome: | The proposed scaling laws provide valuable recommendations for optimal resource allocation . they show that the proposed laws are more accurate than existing models . |
CORBA: Contagious Recursive Blocking Attacks on Multi-Agent Systems Based on Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing security models rely on open-ended communication, but the collaborative process itself can be exploited and disrupted. |
| Approach: | They propose a new threat class, called Denial-of-Collaboration, which corrupts collaborative structure and transforms communication topology into self-sabotage. |
| Outcome: | The proposed attacks bypass conventional safety alignments that are not designed to detect behavioral or systemic attacks. |