Papers by Yang Wei
HateModerate: Testing Hate Speech Detectors against Content Moderation Policies (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies on hate speech detection have failed to answer this question. |
| Approach: | They propose a dataset for testing the behaviors of automated content moderators against content policies. |
| Outcome: | The proposed dataset includes hateful and non-hateful examples matching the 41 community standards guideline policies of Facebook. |
We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning? (2025.acl-long)
Copied to clipboard
Runqi Qiao, Qiuna Tan, Guanting Dong, MinhuiWu MinhuiWu, Chong Sun, Xiaoshuai Song, Jiapeng Wang, Zhuoma GongQue, Shanglin Lei, YiFan Zhang, Zhe Wei, Miaoxuan Zhang, Runfeng Qiao, Xiao Zong, Yida Xu, Peiqing Yang, Zhimin Bao, Muxi Diao, Chen Li, Honggang Zhang
| Challenge: | Existing benchmarks focus more on end-to-end performance, but neglect the underlying principles of knowledge acquisition and generalization. |
| Approach: | They propose a benchmark specifically designed to explore the problem-solving principles by decomposing 6.5K visual math problems into 10.9K step-level questions for evaluation. |
| Outcome: | The proposed benchmark covers 6.5K visual math problems and 10.9K step-level questions spanning 5 layers of knowledge granularity and 67 hierarchical knowledge concepts. |
Beyond Chunks and Graphs: Retrieval-Augmented Generation through Triplet-Driven Thinking (2026.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is critical for reducing hallucinations and incorporating external knowledge into Large Language Models (LLMs). |
| Approach: | They propose a framework that leverages an LLM to decompose questions into searchable triplets with placeholders. |
| Outcome: | Empirical results show that T2RAG outperforms state-of-the-art multi-round and Graph RAG methods while reducing retrieval costs by up to 45%. |
Reinforcement Tuning for Detecting Stances and Debunking Rumors Jointly with Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Social media has become a fertile ground for nurturing rumors and misinformation due to its lack of systematic moderation. |
| Approach: | They propose a framework to enhance the joint predictive capabilities of LLMs for stance detection and rumor verification tasks. |
| Outcome: | The proposed framework outperforms state-of-the-art methods and generalizes to non-LLMs accommodated as task models. |
MoNMT: Modularly Leveraging Monolingual and Bilingual Knowledge for Neural Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing models for multi-domain translation tasks only use monolingual data, whereas bilingual data is indispensable for improving the models. |
| Approach: | They propose a modular strategy that facilitates the cooperation of monolingual and bilingual knowledge in translation tasks by avoiding catastrophic forgetting. |
| Outcome: | The proposed model exhibits superior generalization and robustness over the conventional approach. |
Unsupervised Neural Machine Translation with Weight Sharing (P18-1)
Copied to clipboard
| Challenge: | Unsupervised neural machine translation (NMT) is a new approach for machine translation . the model uses only one shared encoder to map pairs of sentences from different languages to a shared-latent space . |
| Approach: | They propose an unsupervised approach which trains the model without labeling data . they propose two independent encoders but share some partial weights to extract high-level representations of input sentences. |
| Outcome: | The proposed approach achieves significant improvements on English-German, English-French and Chinese-to-English translation tasks. |
Dynamic Programming in Rank Space: Scaling Structured Inference with Low-Rank HMMs and PCFGs (2022.naacl-main)
Copied to clipboard
| Challenge: | Hidden Markov Models (HMMs) and Probabilistic Context-Free Grammars (PCFGs) are widely used structured models. |
| Approach: | They use tensor rank decomposition to reduce computational complexities for a subset of FGGs subsuming HMMs and PCFGs. |
| Outcome: | The proposed model performs better on HMM modeling and unsupervised PCFG parsing than previous work. |
Jigsaw-Puzzles: From Seeing to Understanding to Reasoning in Vision-Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing vision-language models lack spatial reasoning capability, despite their ability to comprehend spatial arrangements and model structural relations. |
| Approach: | They propose a benchmark to evaluate vision-language models' spatial perception, structural understanding, and reasoning capabilities by minimizing reliance on domain-specific knowledge. |
| Outcome: | The proposed benchmark is based on 1,100 carefully curated real-world images with high spatial complexity. |
Language Models as Inductive Reasoners (2024.eacl-long)
Copied to clipboard
| Challenge: | Inductive reasoning is a core component of human intelligence. |
| Approach: | They propose a task to induce natural language rules from natural language facts using natural language as representation for knowledge instead of formal language. |
| Outcome: | The proposed task surpasses baselines in both automatic and human evaluations. |
Scaling Laws for Code: Every Programming Language Matters (2026.findings-acl)
Copied to clipboard
Jian Yang, Shuyue Guo, Linzheng Chai, Wei Zhang, Aishan Liu, Chuan Hao, Zhoujun Li, Xin Zhao, Xianglong Liu, Weifeng Lv, Bryan Dai
| Challenge: | Existing studies focus on language-agnostic settings, neglecting the inherently multilingual nature of modern software development. |
| Approach: | They propose a proportion-dependent scaling law that prioritizes high-utility languages . they propose PLs to have varying effects during pre-training that affect model performance . |
| Outcome: | The proposed scaling law is based on 1000+ experiments across multiple languages and models. |
Fantastic Expressions and Where to Find Them: Chinese Simile Generation with Multiple Constraints (2023.acl-long)
Copied to clipboard
| Challenge: | Existing attempts to generate similes as context-free tasks are not suitable for simile generation . however, simile generated under such settings might be undesirable, we argue . |
| Approach: | They propose a model to generate a simile with multiple simile elements . they propose to use a vehicle retrieval module to obtain the explicable comparison . |
| Outcome: | The proposed model can generate a simile with multiple simile elements, e.g., context and vehicle. |
TURING: an Accurate and Interpretable Multi-Hypothesis Cross-Domain Natural Language Database Interface (2021.acl-demo)
Copied to clipboard
Peng Xu, Wenjie Zi, Hamidreza Shahidi, Ákos Kádár, Keyi Tang, Wei Yang, Jawad Ateeq, Harsh Barot, Meidan Alon, Yanshuai Cao
| Challenge: | Existing text-to-SQL semantic parsers cannot achieve high accuracy in cross-database setting . TURING is a NLDB system that can be used to democratize data-driven insights for non-technical users . |
| Approach: | They propose a TURING system that provides high-precision natural language explanations of SQL queries in a beam. |
| Outcome: | The proposed system achieves 75.1% execution accuracy and 78.3% top-5 beam execution accuracy on the Spider validation set. |
LightSeq: A High Performance Inference Library for Transformers (2021.naacl-industry)
Copied to clipboard
| Challenge: | Existing inference frameworks for natural language processing are not the best choice for online service of sequence processing problems. |
| Approach: | They propose a highly efficient inference library for Transformer models that includes GPU optimization techniques to streamline computation and reduce memory footprint. |
| Outcome: | The proposed library achieves 14x speedup compared with TensorFlow and 1.4x speed up compared to a concurrent CUDA implementation. |
README: Bridging Medical Jargon and Lay Understanding for Patient Education through Data-Centric NLP (2024.findings-emnlp)
Copied to clipboard
Zonghai Yao, Nandyala Siddharth Kantu, Guanghao Wei, Hieu Tran, Zhangqi Duan, Sunjae Kwon, Zhichao Yang, Hong Yu
| Challenge: | a new task is to generate lay definitions of medical terms in EHRs that are difficult to understand for patients. |
| Approach: | They propose a task of automatically generating lay definitions to simplify medical terms into patient-friendly lay language. |
| Outcome: | The proposed model can match or surpass state-of-the-art closed-source large language models like ChatGPT with high-quality data. |
Two Pathways to Truthfulness: On the Intrinsic Encoding of LLM Hallucinations (2026.acl-long)
Copied to clipboard
Wen Luo, Guangyue Peng, Wei Li, Shaohang Wei, Feifan Song, Liang Wang, Nan Yang, Xingxing Zhang, Jing Jin, Furu Wei, Houfeng Wang
| Challenge: | Previous work shows that large language models generate hallucinations, yet the origins and mechanisms of these signals remain unclear. |
| Approach: | They propose to validate and disentangle two different pathways for truthfulness cues . they also propose to use the same mechanism to derive self-contained evidence from the generated answer . |
| Outcome: | The proposed applications improve hallucination detection performance by integrating two different inputs. |
USB: A COMPREHENSIVE AND UNIFIED SAFETY EVALUATION BENCHMARK FOR MULTIMODAL LARGE LANGUAGE MODELS (2026.acl-long)
Copied to clipboard
Baolin Zheng, Guanlin Chen, Qingyang Teng, Hongqiong Zhong, Yingshui Tan, Zhendong Liu, Weixun Wang, Jiaheng Liu, Jian Yang, Huiyun Jing, Jincheng Wei, Wenbo Su, Xiaoyong Zhu, Bo Zheng, Kaifu Zhang
| Challenge: | Existing safety benchmarks fail to provide reliable assessments due to limited risk coverage, insufficient scale and the oversight of complex modality combinations. |
| Approach: | They propose a framework that covers 61 risk categories across four modality interactions to address this gap. |
| Outcome: | The proposed framework covers 61 risk categories across four distinct modality interactions. |
Optimizing Deeper Transformers on Small Datasets (2021.acl-long)
Copied to clipboard
Peng Xu, Dhruv Kumar, Wei Yang, Wenjie Zi, Keyi Tang, Chenyang Huang, Jackie Chi Kit Cheung, Simon J.D. Prince, Yanshuai Cao
| Challenge: | a common belief that training deep transformers from scratch requires large datasets is wrong . however, with proper initialization and optimization, the benefits of very deep transformer can carry over to challenging tasks with small datasets. |
| Approach: | They train 48 layers of transformers from pre-trained RoBERTa and 24 relation-aware layers from scratch. |
| Outcome: | The proposed scheme achieves state-of-the-art performance on a text-to-sql parsing benchmark . it uses 24 fine-tuned layers from pre-trained RoBERTa and 24 relation-aware layers from scratch . |
Self-Supervised Learning for Pairwise Data Refinement (2020.aacl-main)
Copied to clipboard
| Challenge: | Pairwise data constructed from weakly supervised signals is widely used for training deep learning models. |
| Approach: | They propose two methods to refine pairwise data that are aimed to obtain subsets that are more useful as learning examples. |
| Outcome: | The proposed methods achieve most machine translation gains in the first iteration, but following iterations further improve its intrinsic evaluation. |
Rethinking LLM Uncertainty: A Multi-Agent Approach to Estimating Black-Box Model Uncertainty (2025.findings-emnlp)
Copied to clipboard
Yu Feng, Phu Mon Htut, Zheng Qi, Wei Xiao, Manuel Mager, Nikolaos Pappas, Kishaloy Halder, Yang Li, Yassine Benajiba, Dan Roth
| Challenge: | Existing methods to gauge model’s uncertainty through self-consistency in responses to the target query are misleading: an LLM may confidently provide an incorrect answer to a target query, yet give a confident and accurate answer to that same query when answering a knowledge-preserving perturbation of the query. |
| Approach: | They propose a method that uses multi-agent interaction to estimate black-box LLMs' uncertainty. |
| Outcome: | The proposed method outperforms existing self-consistency based methods and improves hallucination detection. |
Generalizable Cross-Lingual Cognitive Distortion Detection with Standardized Annotations and Multi-Task Learning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on cognitive distortion have limited generalizability and performance of models in large-scale and cross-linguistic contexts. |
| Approach: | They propose a multi-task learning model based on teacher student architecture solution which improves generalization performance. |
| Outcome: | The proposed model improves generalizability and interpretability of the proposed model. |
Enhancing Self-Attention with Knowledge-Assisted Attention Maps (2022.naacl-main)
Copied to clipboard
Jiangang Bai, Yujing Wang, Hong Sun, Ruonan Wu, Tianmeng Yang, Pengfei Tang, Defu Cao, Mingliang Zhang1, Yunhai Tong, Yaming Yang, Jing Bai, Ruofei Zhang, Hao Sun, Wei Shen
| Challenge: | Existing works of knowledge infusion depend on multi-task learning frameworks, which are inefficient and require large-scale retraining when new knowledge is considered. |
| Approach: | They propose a method which integrates knowledge-generated attention maps into the self-attention mechanism and integrates it into the model. |
| Outcome: | The proposed model outperforms existing methods on academic datasets and industry-scale ad relevance applications. |
CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation (2022.findings-emnlp)
Copied to clipboard
Jian Yang, Shaohan Huang, Shuming Ma, Yuwei Yin, Li Dong, Dongdong Zhang, Hongcheng Guo, Zhoujun Li, Furu Wei
| Challenge: | Named entity recognition (NER) suffers from the scarcity of annotated training data, especially for low-resource languages without labeled data. |
| Approach: | They propose a cross-lingual entity projection framework to enable zero-shot cross-linguistic NER with the help of a multilingual labeled sequence translation model. |
| Outcome: | The proposed method outperforms the baseline method on two benchmarks by a large margin of +3 7 F1 scores and achieves state-of-the-art performance. |
Chart-MRAG: Benchmarking Multimodal Retrieval Augmented Generation on Chart-based Documents (2026.acl-long)
Copied to clipboard
null Ymyang, Jiang Zhong, Li Jin, Xiao Sun, Jingwang Huang, null Gaojinpeng, Qing Liu, Yang Bai, Jingyuan Zhang, Rui Jiang, Qin Lei, Kaiwen Wei
| Challenge: | Existing benchmarks focus on simple image-text interactions, overlooking complex visual formats like charts. |
| Approach: | They propose a semi-automatic framework for generating evaluation samples through multi-modal keypoint extraction, knowledge graph construction, and qa pair synthesis. |
| Outcome: | The proposed framework generates 4,738 question-answering pairs across 8 domains from real-world documents. |
GMH: A General Multi-hop Reasoning Model for KG Completion (2021.emnlp-main)
Copied to clipboard
| Challenge: | Knowledge graphs are incomplete with many facts missing, causing performance bottlenecks in many applications. |
| Approach: | They propose a general multi-hop reasoning task that can be formulated as a search process and can be extended to long-distance reasoning scenarios. |
| Outcome: | The proposed model improves on baselines in short and long distance reasoning scenarios. |
CodeArena: Evaluating and Aligning CodeLLMs on Human Preference (2025.emnlp-main)
Copied to clipboard
Jian Yang, Jiaxi Yang, Wei Zhang, Jin Ke, Yibo Miao, Lei Zhang, Liqun Yang, Zeyu Cui, Yichang Zhang, Zhoujun Li, Binyuan Hui, Junyang Lin
| Challenge: | Code large language models (codeLLMs) focus on synthesizing the correct code snippet, ignoring the alignment with human preferences. |
| Approach: | They propose a benchmark code-based on 40 categories and 44 programming languages to emulate real-world coding tasks. |
| Outcome: | The proposed benchmarks show that open-source code LLMs perform better than open-sourced ones. |
CLOMO: Counterfactual Logical Modification with Large Language Models (2024.acl-long)
Copied to clipboard
Yinya Huang, Ruixin Hong, Hongming Zhang, Wei Shao, Zhicheng Yang, Dong Yu, Changshui Zhang, Xiaodan Liang, Linqi Song
| Challenge: | Existing studies on evaluating model reasoning are limited in both form and content. |
| Approach: | They propose a task to cultivate counterfactual thought processes within large language models and an evaluation metric to evaluate their natural language output instead of modeling the task as a multiple-choice problem. |
| Outcome: | The proposed evaluation metric aligns well with human preference. |
OpenHuEval: Evaluating Large Language Model on Hungarian Specifics (2025.findings-acl)
Copied to clipboard
Haote Yang, Xingjian Wei, Jiang Wu, Noémi Ligeti-Nagy, Jiaxing Sun, Yinfan Wang, Győző Zijian Yang, Junyuan Gao, Jingchao Wang, Bowen Jiang, Shasha Wang, Nanjun Yu, Zihao Zhang, Shixin Hong, Hongwei Liu, Wei Li, Songyang Zhang, Dahua Lin, Lijun Wu, Gábor Prószéky, Conghui He
| Challenge: | Recent advances in Large Language Models (LLMs) represent significant strides toward artificial general intelligence (AGI). |
| Approach: | They introduce OpenHuEval, the first benchmark for LLMs focusing on the Hungarian language and specifics. |
| Outcome: | The framework reveals intrinsic patterns and mechanisms of LLMs in non-English languages, with Hungarian serving as an example. |
Context-DPO: Aligning Language Models for Context-Faithfulness (2025.findings-acl)
Copied to clipboard
Baolong Bi, Shaohan Huang, Yiwei Wang, Tianchi Yang, Zihan Zhang, Haizhen Huang, Lingrui Mei, Junfeng Fang, Zehao Li, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang, Shenghua Liu
| Challenge: | Context-DPO is the first alignment method specifically designed to enhance contextfaithfulness for large language models. |
| Approach: | They propose a benchmark that simulates Retrieval-Augmented Generation scenarios with knowledge conflicts to evaluate context-faithfulness. |
| Outcome: | The proposed method improves LLMs' context-faithfulness by 35% to 280% over open-source models. |
Revealing COVID-19’s Social Dynamics: Diachronic Semantic Analysis of Vaccine and Symptom Discourse on Twitter (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Social media data provide a new source for social science and cultural analysis research, but its analysis is challenging due to the semantic shift phenomenon, where word meanings evolve over time. |
| Approach: | They propose an unsupervised dynamic word embedding method to capture longitudinal semantic shifts in social media data without predefined anchor words. |
| Outcome: | The proposed method captures longitudinal semantic shifts in social media data without predefined anchor words and leverages word co-occurrence statistics and dynamic updating to adapt embeddings over time. |
ShifCon: Enhancing Non-Dominant Language Capabilities with a Shift-based Multilingual Contrastive Framework (2025.acl-long)
Copied to clipboard
Hengyuan Zhang, Chenming Shang, Sizhe Wang, Dongdong Zhang, Yiyao Yu, Feng Yao, Renliang Sun, Yujiu Yang, Furu Wei
| Challenge: | Experiments show that ShifCon significantly enhances the performance of non-dominant languages due to the imbalance in training data across languages. |
| Approach: | They propose a Shift-based multilingual Contrastive framework that aligns the internal forward process of other languages toward that of the dominant one. |
| Outcome: | The proposed framework significantly improves performance of non-dominant languages, particularly for low-resource ones. |
Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning (2023.findings-emnlp)
Copied to clipboard
Zhuolin Yang, Wei Ping, Zihan Liu, Vijay Korthikanti, Weili Nie, De-An Huang, Linxi Fan, Zhiding Yu, Shiyi Lan, Bo Li, Mohammad Shoeybi, Ming-Yu Liu, Yuke Zhu, Bryan Catanzaro, Chaowei Xiao, Anima Anandkumar
| Challenge: | Existing methods for image-to-text generation store all knowledge within parameters, thus requiring computational-expensive fine-tuning. |
| Approach: | They propose a Retrieval-augmented Visual Language Model that stores all the knowledge within parameters and can be used to retrieve it from the external database. |
| Outcome: | The proposed model significantly boosts performance for image-to-text generation tasks with 4x less parameters compared with baseline methods. |
ROSE: A Reward-Oriented Data Selection Framework for LLM Task-Specific Instruction Tuning (2025.findings-emnlp)
Copied to clipboard
Yang Wu, Huayi Zhang, Yizheng Jiao, Lin Ma, Xiaozhong Liu, Jinhong Yu, Dongyu Zhang, Dezhi Yu, Wei Xu
| Challenge: | Prevailing methods for task-specific instruction tuning use similarity metrics to select training data . but instruction tuning loss often fails to exhibit a monotonic relationship with actual task performance . |
| Approach: | They propose a task-specific instruction tuning method that leverages pairwise preference loss as a reward signal. |
| Outcome: | The proposed method surpasses state-of-the-art methods for task-specific instruction tuning. |
IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Web (2025.findings-acl)
Copied to clipboard
Hongcheng Guo, Wei Zhang, Junhao Chen, Yaonan Gu, Jian Yang, Junjia Du, Shaosheng Cao, Binyuan Hui, Tianyu Liu, Jianxin Ma, Chang Zhou, Zhoujun Li
| Challenge: | Existing models have been introduced to improve image comprehension, but there is no robust benchmark for imagetoweb conversion. |
| Approach: | They propose a benchmark to assess imagetoweb conversion proficiency of large multimodal models . they propose to measure layout information of web pages by parsing the Document Object Model tree . |
| Outcome: | The proposed benchmark measures the layout information of web pages—i.e., the positional relationships between elements—which has been overlooked by prior work. |
WebClipper: Efficient Evolution of Web Agents with Graph-based Trajectory Pruning (2026.acl-long)
Copied to clipboard
Junjie Wang, Zequn Xie, Dan Yang, Jie Feng, Yue Shen, Duolin Sun, Meixiu Long, Yihan Jiao, Zhehao Tan, Jian Wang, Peng Wei, Jinjie Gu
| Challenge: | Open-source web agents rely on long tool-call trajectories with cyclic reasoning loops and exploration of unproductive branches. |
| Approach: | They propose a framework that compresses web agent trajectories via graph-based pruning. |
| Outcome: | The proposed framework reduces tool-call rounds by 20% while improving accuracy and efficiency while maintaining the same level of performance as existing models. |
CREATER: CTR-driven Advertising Text Generation with Controlled Pre-Training and Contrastive Fine-Tuning (2022.naacl-industry)
Copied to clipboard
| Challenge: | a paper focuses on automatically generating the text of an ad to capture user interest for achieving higher click-through rate. |
| Approach: | They propose a CTR-driven advertising text generation approach to generate ad texts based on user reviews. |
| Outcome: | The proposed approach outperforms existing approaches on industrial datasets and on large-scale unpaired reviews. |
WebDART: Dynamic Decomposition and Re-planning for Complex Web Tasks (2026.findings-acl)
Copied to clipboard
| Challenge: | Large-language-model (LLM) agents are competent at straightforward web tasks, but struggle with complex tasks. |
| Approach: | They propose a general framework that decomposes web tasks into three subtasks . they show that WebDART lifts end-to-end success rates by 13.7 percentage points . |
| Outcome: | Evaluated on WebChoreArena, WebDART lifts success rates by 13.7 percentage points over previous state-of-the-art agents. |
MERMAID: Multi-perspective Self-reflective Agents with Generative Augmentation for Emotion Recognition (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing multimodal large language models struggle to handle ambiguous emotional expressions and implicit affective cues, which are crucial for affective understanding but largely overlooked. |
| Approach: | They propose a multi-agent framework that integrates a self-reflection module, an emotion-guided visual augmentation module, and a cross-modal verification module to enhance emotion recognition. |
| Outcome: | Extensive experiments show that MERMAID outperforms existing methods and achieves absolute accuracy gains of 8.70%–27.90% across diverse benchmarks. |
LoopCoder: Scaling Code Intelligence via Looped Language Models (2026.findings-acl)
Copied to clipboard
Jian Yang, Wei Zhang, Shuyue Guo, Yizhi LI, Linzheng Chai, Zhengmao Ye, Shukai Liu, Yuyang Song, Jiajun Wu, Che Liu, Tianyu Zheng, Siwei Wu, Leo L, Xudong Ma, Chuan Hao, Ran Tao, Yan Xing, Jianzhou Wang, Mingjie Tang, Aishan Liu, Zhoujun Li, Xianglong Liu, Weifeng Lv, Bryan Dai
| Challenge: | Large language models have mastered syntax-level code generation, but complex algorithmic reasoning remains a challenge. |
| Approach: | They propose a recurrent inductive bias that aligns with the recursive nature of programming logic. |
| Outcome: | The proposed model achieves comparable performance to standard dense models with more parameters. |
Turning the Tide: Repository-based Code Reflection (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Code large language models (LLMs) enhance programming by understanding and generating code across languages. |
| Approach: | a new benchmark evaluates code understanding and generation in repositories using code large language models. |
| Outcome: | The proposed model improves code understanding and generation in repositories by evaluating 1,888 test cases across 6 programming languages. |
Attention-Guided Answer Distillation for Machine Reading Comprehension (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to reading comprehension systems are vulnerable to adversarial attacks. |
| Approach: | They propose to use knowledge distillation to transfer knowledge from an ensemble to a single model. |
| Outcome: | The proposed methods outperform the teacher on adversarial datasets and NarrativeQA benchmarks. |
Task-Aware Self-Supervised Framework for Dialogue Discourse Parsing (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing discourse parsing approaches are constrained by predefined relation types, which can impede the adaptability of the parser for downstream tasks. |
| Approach: | They propose to introduce a task-aware paradigm to improve the versatility of the parser. |
| Outcome: | Empirical studies on dialogue discourse parsing datasets and a downstream task demonstrate the proposed framework. |
MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning (2025.findings-acl)
Copied to clipboard
Ke Wang, Junting Pan, Linda Wei, Aojun Zhou, Weikang Shi, Zimu Lu, Han Xiao, Yunqiao Yang, Houxing Ren, Mingjie Zhan, Hongsheng Li
| Challenge: | Large Language Models (LMMs) struggle with simple tasks such as geometry, e.g., arithmetic, and reasoning. |
| Approach: | They propose to leverage code as supervision for cross-modal alignment . they propose to use FigCodifier and ImgCode-8.6M to synthesize novel mathematical figures . |
| Outcome: | The proposed model surpasses GPT-4o and Claude 3.5 Sonnet in the geometry problem-solving subset of MathVista, achieving improvements of 8.9% and 9.2%. |
Generative Annotation for ASR Named Entity Correction (2025.emnlp-main)
Copied to clipboard
Yuanchang Luo, Daimeng Wei, Shaojun Li, Hengchao Shang, Jiaxin Guo, Zongyao Li, Zhanglin Wu, Xiaoyu Chen, Zhiqiang Rao, Jinlong Yang, Hao Yang
| Challenge: | Existing named entity correction models fail to transcribe domain-speciffcnamed entities when theforms of the wrongly-transcribed words and the ground-truth entity are signiffcantly different. |
| Approach: | They propose a method that utilizes speech sound features to retrieve candidate entities . it uses speech sound feature to annotate entityerrors in ASR transcripts . |
| Outcome: | The proposed method can bring signiffcant improvement to entity accuracy. |
Data Interpreter: An LLM Agent for Data Science (2025.findings-acl)
Copied to clipboard
Sirui Hong, Yizhang Lin, Bang Liu, Bangbang Liu, Binhao Wu, Ceyao Zhang, Danyang Li, Jiaqi Chen, Jiayi Zhang, Jinlin Wang, Li Zhang, Lingyao Zhang, Min Yang, Mingchen Zhuge, Taicheng Guo, Tuo Zhou, Wei Tao, Robert Tang, Xiangtao Lu, Xiawu Zheng, Xinbing Liang, Yaying Fei, Yuheng Cheng, Yongxin Ni, Zhibin Gou, Zongze Xu, Yuyu Luo, Chenglin Wu
| Challenge: | Large Language Models (LLMs) excel in various domains but face challenges when applied to data science workflows due to their complex, multi-stage nature. |
| Approach: | They propose a hierarchical graph-based agent that represents complexity and a progressive strategy for step-by-step verification, refinement, and consistent context management. |
| Outcome: | The proposed agent surpasses state-of-the-art baselines on the MATH dataset and performs better on InfiAgent-DABench. |
SafeSteer: A Decoding-level Defense Mechanism for Multimodal Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing defense methods rely on fine-tuning or inefficient post-hoc interventions, limiting their ability to address novel attacks. |
| Approach: | They propose a decoding-level defense mechanism that employs a lightweight discriminator to iteratively steer the decoding process toward safety. |
| Outcome: | The proposed method improves safety performance by up to 33.40% without fine-tuning on multiple MLLMs. |
Applying BERT to Document Retrieval with Birch (D19-3)
Copied to clipboard
| Challenge: | Birch is an open-source document retrieval system that integrates with the Anserini information retrieval toolkit to demonstrate end-to-end search over large document collections. |
| Approach: | They propose to integrate Anserini with a BERT-based document ranking model that provides an end-to-end open-source search engine. |
| Outcome: | The proposed system outperforms existing approaches to document retrieval and question answering on standard newswire and social media test collections. |
Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs (2024.findings-emnlp)
Copied to clipboard
Junjie Wang, Mingyang Chen, Binbin Hu, Dan Yang, Ziqi Liu, Yue Shen, Peng Wei, Zhiqiang Zhang, Jinjie Gu, Jun Zhou, Jeff Pan, Wen Zhang, Huajun Chen
| Challenge: | Recent studies have attempted to enhance the performance of large language models (LLMs) in complex question-answering (QA) tasks by combining step-wise planning with external retrieval. |
| Approach: | They propose a framework for enhancing LLMs’ planning capabilities by using planning data derived from knowledge graphs (KGs). |
| Outcome: | The proposed framework improves LLMs’ planning capabilities by using knowledge graphs (KGs) the proposed framework is compared with existing frameworks on multiple datasets and shows that it is effective for large language models. |
Multilingual Agreement for Multilingual Neural Machine Translation (2021.acl-short)
Copied to clipboard
| Challenge: | Existing models that only use auxiliary languages to encourage multilingual agreement ignore the relationships between different language pairs. |
| Approach: | They propose a multilingual agreement-based method which explicitly models the agreement between different translation directions by randomly substituting some fragments of the source language with their counterpart translations of auxiliary languages. |
| Outcome: | The proposed method improves on the multilingual translation task of 10 language pairs. |
Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training (2024.emnlp-main)
Copied to clipboard
Yixuan Wang, Xianzhen Luo, Fuxuan Wei, Yijun Liu, Qingfu Zhu, Xuanyu Zhang, Qing Yang, Dongliang Xu, Wanxiang Che
| Challenge: | Existing speculative decoding methods require additional model structure and training processes to assist the model for draft token generation. |
| Approach: | They propose a make some noise training framework that introduces some noise at the input for the model to learn the denoising task. |
| Outcome: | The proposed model improves inference speed by 2.3-2.7x times without compromising model performance. |
Disentangled Information Bottleneck for Adversarial Text Defense (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have proven that these deep models are super vulnerable to adversarial examples, which are slightly modified inputs. |
| Approach: | They propose a novel text defense method that separates the robust and non-robust features with a disentangled two-line framework rather than the one-line compression network in IB. |
| Outcome: | The proposed method outperforms six baselines on four datasets with accuracy improvements ranging from 3.8% to 20.7%. |
Title2Event: Benchmarking Open Event Extraction with a Large-scale Chinese Title Dataset (2022.emnlp-main)
Copied to clipboard
Haolin Deng, Yanan Zhang, Yangfan Zhang, Wangyang Ying, Changlong Yu, Jun Gao, Wei Wang, Xiaoling Bai, Nan Yang, Jin Ma, Xiang Chen, Tianhua Zhou
| Challenge: | Existing EE datasets define fixed event types and design specific schemas for each of them, failing to cover diverse events emerging from the online text. |
| Approach: | They propose to use a sentence-level dataset to benchmark Open Event Extraction without restricting event types. |
| Outcome: | The proposed dataset contains more than 42,000 news titles in 34 topics collected from Chinese web pages. |
RubricHub: A Comprehensive and Highly Discriminative Rubric Dataset via Automated Coarse-to-Fine Generation (2026.acl-long)
Copied to clipboard
Sunzhu Li, Jiale Zhao, Huimin Ren, Zhenlin Wei, Yang Zhou, Jingwen Yang, Shunyu Liu, Kaike Zhang, Chen Wei
| Challenge: | Existing methods for generating open-ended rubrics suffer from scalability bottlenecks and coarse criteria resulting in a supervision ceiling effect. |
| Approach: | They propose a framework for automated Coarse-to-Fine Rubric Generation . their framework uses principle-guided synthesis, multi-model aggregation, difficulty evolution . |
| Outcome: | The proposed framework produces comprehensive and highly discriminative criteria capable of capturing the subtle nuances. |
Modeling Temporal-Modal Entity Graph for Procedural Multimodal Machine Comprehension (2022.acl-long)
Copied to clipboard
| Challenge: | Procedural Multimodal Documents organize textual instructions and corresponding images step by step. |
| Approach: | They propose a novel temporal-modal entity Graph for comprehending PMDs . they propose encoding and reasoning modules to capture textual and visual entities . |
| Outcome: | The proposed model can capture textual and visual entities and trace their temporal-modal evolution. |
When Inverse Data Outperforms: Exploring the Pitfalls of Mixed Data in Multi-Stage Fine-Tuning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for o1-level performance focus on unidirectional supervised fine-tuning (SFT), overlooking the intricate interplay between diverse reasoning patterns. |
| Approach: | They construct a reverse reasoning dataset and examine how it is supervised . they find that naively mixing forward and reverse data during SFT weakens the directional distinction . |
| Outcome: | The proposed model improves accuracy by 1.6%–6.8% over a standard model. |
Learning a Multi-Domain Curriculum for Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing data selection methods do not work well for multiple domains . multiple aspects need to be considered for training a multi-domain model . |
| Approach: | They propose a dynamic data selection method to multi-domain NMT that incorporates instance-level domain-relevance features and a curriculum to gradually focus on multi- domain relevant data batches. |
| Outcome: | The proposed model outperforms no-curriculum training on multiple domains and reaches or outperformed individual performance. |
Distributed LLM Serving on Consumer-Grade GPUs by Reconciling Computation and Communication (2025.findings-emnlp)
Copied to clipboard
Lewei Jin, Kui Zhang, Yongqi Chen, null Zhuoyifan, Renjie Li, Yi Gao, Bowei Yang, Zhengong Cai, Wei Dong
| Challenge: | Large language models are reshaping internet services, and serving them is costly. |
| Approach: | They propose an efficient distributed LLM serving system that splits prefill and decode requests into smaller chunks . |
| Outcome: | The proposed system reduces TTFT, TPOT, and latency compared to the state-of-the-art system. |
Modeling Adversarial Attack on Pre-trained Language Models as Sequential Decision Making (2023.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) have shown strong potential in various downstream tasks. |
| Approach: | They propose to model adversarial attack task as a sequential decision-making problem where the whole attack process is sequential with two decision- making problems, i.e., word finder and word substitution. |
| Outcome: | The proposed approach achieves the highest attack success rate with a comparable modification rate and semantic similarity to attack fine-tuned BERT. |
ImPart: Importance-Aware Delta-Sparsification for Improved Model Compression and Merging in LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Recent approaches to reduce resource requirements for task-specific large language models have been developed. |
| Approach: | They propose a delta compression approach that optimizes for importance of a model . they use SVD to dynamically adjust the sparsity ratios of different vectors based on their importance . |
| Outcome: | The proposed approach achieves state-of-the-art in retaining task-specific knowledge even at high sparsity ratios. |
HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition (2024.acl-long)
Copied to clipboard
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
| Challenge: | Large language models (LLMs) are a promising alternative to expensive human evaluations. |
| Approach: | They propose a framework that iteratively aligns LLM-based evaluators with human preference . they decompose a given evaluation task into finer-grained criteria . |
| Outcome: | The proposed framework iteratively aligns LLM-based evaluators with human preference . it decomposes a given evaluation task into finer-grained criteria . the framework is efficient to train and more explainable than relying solely on prompts . |
A Data-Efficient Path to Multilingual LLMs: Language Expansion via Post-training PARAM𝛥 Integration into Upcycled MoE (2026.acl-long)
Copied to clipboard
Hao Zhou, Tianhao Li, Zhijun Wang, Shuaijie She, Linjuan Wu, Hao-Ran Wei, Baosong Yang, Jiajun Chen, Shujian Huang
| Challenge: | Large Language Models (LLMs) are expensive and require extensive Continued Pre-Training and data-intensive alignment to expand. |
| Approach: | They propose a method which upcycles a dense model into a Mixture-of-Experts architecture, allocating different experts to different languages. |
| Outcome: | Experiments show that the proposed model upcycles a dense model into a Mixture-of-Experts(MoE) architecture, allocating different experts to different languages. |
KACC: A Multi-task Benchmark for Knowledge Abstraction, Concretization and Completion (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing studies focus on partial aspects of knowledge abstraction, concretization, and completion (KACC). |
| Approach: | They propose a unified knowledge graph benchmark to improve existing benchmarks . they collect new datasets that contain larger concept graphs and cross-view links . |
| Outcome: | The proposed benchmark improves existing benchmarks in terms of dataset scale, task coverage, and difficulty. |
Visual Evidence Prompting Mitigates Hallucinations in Large Vision-Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | LVLMs have shown impressive progress by integrating visual perception with linguistic understanding to produce contextually grounded outputs. |
| Approach: | They propose a visual evidence prompting method to mitigate hallucinations in large vision-language models by using small visual models to complement them. |
| Outcome: | The proposed method reduces hallucinations by reducing false activation and enhancing correct ones. |
Do VLMs Have a Moral Backbone? A Study on the Fragile Morality of Vision-Language Models (2026.findings-acl)
Copied to clipboard
Zhining Liu, Tianyi Wang, Xiao Lin, Penghao Ouyang, Gaotang Li, Ze Yang, Hui Liu, Sumit Keswani, Vishwa Pardeshi, Huijun Zhao, Wei Fan, Hanghang Tong
| Challenge: | Vision-Language Models (VLMs) have advanced multimodal learning, driving progress in cross-modal reasoning. |
| Approach: | They propose to examine moral robustness of vision-language models by analyzing their moral stances under multimodal perturbations. |
| Outcome: | The proposed model-agnostic multimodal perturbations expose VLMs to a variety of moral vulnerabilities, including a sycophancy trade-off where stronger instruction-following models are more susceptible to persuasion. |
Bridging the Gap between Relevance Matching and Semantic Matching for Short Text Similarity Modeling (D19-1)
Copied to clipboard
| Challenge: | Existing techniques for relevance and semantic matching cannot be easily adapted to the other. |
| Approach: | They propose a model that incorporates a hybrid encoder module, a relevance matching module and co-attention mechanisms that capture context-aware semantic relatedness. |
| Outcome: | The proposed model incorporates a hybrid encoder module, a relevance matching module and co-attention mechanisms that capture context-aware semantic relatedness. |
Towards Fine-Grained and Multi-Granular Contrastive Language-Speech Pre-training (2026.acl-long)
Copied to clipboard
Yifan Yang, Bing Han, Hui Wang, Wei Wang, Ziyang Ma, Long Zhou, Zengrui Jin, Guanrou Yang, Tianrui Wang, Xu Tan, Xie Chen
| Challenge: | Existing models for fine-grained speaking styles are limited in terms of accuracy, coverage, and naturalness. |
| Approach: | They propose a model that pre-trains with coarse captions and annotates with a pipeline that grounds captions in audio. |
| Outcome: | The proposed model outperforms existing models with fine-grained style annotations . it integrates global and fine-granular supervision, enabling unified representations based on the proposed model . |
MAssistant: A Personal Knowledge Assistant for MOOC Learners (D19-3)
Copied to clipboard
| Challenge: | Massive Open Online Courses (MOOCs) have experienced a rapid development since 2012 . many MOOC platforms have been launched, including Coursera1 , edX2 , and Udacity3 etc. |
| Approach: | They present a personal knowledge assistant system called MAssistant for MOOC learners . MAsistants has a large-scale concept graph built from open data . it also provides a browser extension which interacts with users during video lectures . |
| Outcome: | The proposed system helps users trace the concepts they have learned in MOOCs, and to build their own concept graphs. |
Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning (2024.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that fine-tuning of large language models for specific tasks can be challenging . distribution shift during fine-timing can lead to performance degradation in general task capabilities . |
| Approach: | They propose a new approach that bridges the distribution gap between task datasets and LLMs by guiding fine-tuning with a distilled dataset generated by the model itself. |
| Outcome: | The proposed approach achieves comparable or superior performance on downstream tasks compared to the vanilla approach. |
Towards Scalable and Reliable Capsule Networks for Challenging NLP Applications (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to generalize deep neural networks are datahungry and generalize poorly from small datasets. |
| Approach: | They propose an agreement score to evaluate routing processes at instance-level and an adaptive optimizer to enhance routing. |
| Outcome: | The proposed approach improves on two NLP tasks and in low-resource settings with few training instances. |
Adapting General-Purpose Embedding Models to Private Datasets Using Keyword-based Retrieval (2025.findings-acl)
Copied to clipboard
| Challenge: | Text embedding models show strong performance on generic benchmarks, but their effectiveness diminishes when applied to private datasets. |
| Approach: | They propose a method for adapting general-purpose text embedding models to private datasets . they construct supervisory signals from the ranking of keyword-based retrieval results . |
| Outcome: | The proposed method improves retrieval performance across domains, datasets, and models. |
Towards Comprehensive Description Generation from Factual Attribute-value Tables (P19-1)
Copied to clipboard
| Challenge: | Existing models for comprehensive descriptions for factual attribute-value tables might suffer from missing key attributes and groundless information problems. |
| Approach: | They propose a force attention method to encourage the generator to pay more attention to uncovered attributes to avoid potential key attributes missing. |
| Outcome: | The proposed model outperforms the state-of-the-art baselines on automatic and human evaluation. |
Improving Alignment in LVLMs with Debiased Self-Judgment (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for aligning LVLMs rely on external datasets, human annotations or complex post-processing. |
| Approach: | They propose a method that generates a debiased self-judgment score for LVLMs . this self-evaluation metric is created internally by the model without external resources . |
| Outcome: | The proposed approach outperforms existing methods in reducing hallucinations and safety concerns. |
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator (2023.acl-long)
Copied to clipboard
Jian Yang, Shuming Ma, Li Dong, Shaohan Huang, Haoyang Huang, Yuwei Yin, Dongdong Zhang, Liqun Yang, Furu Wei, Zhoujun Li
| Challenge: | Existing pre-training methods underutilize the benefits of language understanding for generation. |
| Approach: | They propose a GAN-style model for encoder-decoder pre-training with an auxiliary discriminator. |
| Outcome: | The proposed model outperforms existing pre-trained models and achieves state-of-the-art performance. |
Unveiling the Unknown: Open-Set Entity Typing via Two-Stage Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing fine-grained entity typing models are susceptible to misclassify unknown-type instances . manual collection and annotation of large unknown-Type instances is time-consuming and labor-intensive in open environments. |
| Approach: | They propose a novel task that uses open-set entity typing to classify entities of unknown types . they propose 'two-stage generation model' that automatically produces large-scale pseudo unknown-type instances . |
| Outcome: | The proposed framework surpasses baselines on two newly established benchmark datasets. |
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning (2025.emnlp-demos)
Copied to clipboard
Zhong Zhang, Yaxi Lu, Yikun Fu, Yupeng Huo, Shenzhi Yang, Yesai Wu, Han Si, Xin Cong, Haotian Chen, Yankai Lin, Xie Xie, Wei Zhou, Wang Xu, Zhou Su, Zhongwu Zhai, Xiaoming Liu, null Meiyudong, Jianming Xu, Hongyan Tian, Chongyi Wang, Chi Chen, Yuan Yao, Zhiyuan Liu, Maosong Sun
| Challenge: | Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs. |
| Approach: | They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction. |
| Outcome: | The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI. |
AgentSense: Benchmarking Social Intelligence of Language Agents through Interactive Scenarios (2025.naacl-long)
Copied to clipboard
Xinyi Mou, Jingcong Liang, Jiayu Lin, Xinnong Zhang, Xiawei Liu, Shiyue Yang, Rong Ye, Lei Chen, Haoyu Kuang, Xuanjing Huang, Zhongyu Wei
| Challenge: | Large language models are increasingly employed to empower autonomous agents to simulate human behavior. |
| Approach: | They propose to evaluate LLM-driven agents through multi-turn interactions using a bottom-up approach to create diverse social scenarios constructed from extensive scripts. |
| Outcome: | The proposed model evaluates LLM-driven agents through multi-turn interactions emphasizing goal completion and implicit reasoning. |
Beyond Sequences: Two-dimensional Representation and Dependency Encoding for Code Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing code generation approaches represent code as a linear sequence of tokens, but positional encodings compromise generalization . explicit positional encoders sacrifice permutation invariance, imposes a strict order on the input sequence . |
| Approach: | They propose to represent code snippets as two-dimensional entities with explicit encodings . they propose to use dictionary learning to perform semantic matching between code lines . |
| Outcome: | The proposed model captures the hierarchical and spatial structure of code, especially the dependencies between code lines. |
Learning to Refine: Self-Refinement of Parallel Reasoning in LLMs (2026.findings-acl)
Copied to clipboard
Qibin Wang, Pu Zhao, Shaohan Huang, Fangkai Yang, Lu Wang, Furu Wei, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang
| Challenge: | Existing approaches to test-time scaling are limited due to the quality of candidate responses. |
| Approach: | They propose a new metric to quantify the relative improvement of self-refinement beyond majority voting. |
| Outcome: | The proposed method achieves state-of-the-art performance across five benchmarks over other methods. |
AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments (2025.acl-long)
Copied to clipboard
Zhiheng Xi, Yiwen Ding, Wenxiang Chen, Boyang Hong, Honglin Guo, Junzhe Wang, Xin Guo, Dingwen Yang, Chenyang Liao, Wei He, Songyang Gao, Lu Chen, Rui Zheng, Yicheng Zou, Tao Gui, Qi Zhang, Xipeng Qiu, Xuanjing Huang, Zuxuan Wu, Yu-Gang Jiang
| Challenge: | Large language models (LLMs) are promising foundations to build generally-capable agents . however, the community lacks a unified interactive framework that covers diverse environments for comprehensive evaluation of agents. |
| Approach: | They propose a framework that features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction. |
| Outcome: | The proposed framework features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction. |
MCS: An In-battle Commentary System for MOBA Games (2022.coling-1)
Copied to clipboard
Xiaofeng Qi, Chao Li, Zhongping Liang, Jigang Liu, Cheng Zhang, Yuanxin Wei, Lin Yuan, Guang Yang, Lanxiao Huang, Min Li
| Challenge: | In-battle commentary is an important component of live streaming of e-sports competitions and is applicable to a wide range of scenarios like combat information analysis and live streaming. |
| Approach: | They propose a generative system for in-battle real-time commentary in mobile MOBA games and propose 'transform' method to convert match statistics and utterances into consistent encoding space. |
| Outcome: | The proposed system is based on real-time match statistics and events and can be used for live streaming, e-sports commentary and combat information analysis. |
Granular Privacy Control for Geolocation with Vision Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Vision Language Models (VLMs) are rapidly advancing in their capability to answer information-seeking questions. |
| Approach: | They develop a benchmark to evaluate the ability of VLMs to moderate geolocation dialogues with users. |
| Outcome: | a new benchmark evaluates the ability of VLMs to moderate geolocation conversations with users. |
Past Meets Present: Creating Historical Analogy with Large Language Models (2025.acl-long)
Copied to clipboard
Nianqi Li, Siyu Yuan, Jiangjie Chen, Jiaqing Liang, Feng Wei, Zujie Liang, Deqing Yang, Yanghua Xiao
| Challenge: | Historical analogies are important abilities that help people make decisions and understand the world. |
| Approach: | They propose a historical analogy acquisition task that uses large language models to acquire historical analogies. |
| Outcome: | The proposed method mitigates hallucinations and stereotypes when LLMs generate historical analogies. |
Multi-Agent Collaboration via Cross-Team Orchestration (2025.findings-acl)
Copied to clipboard
Zhuoyun Du, Chen Qian, Wei Liu, Zihao Xie, YiFei Wang, Rennai Qiu, Yufan Dang, Weize Chen, Cheng Yang, Ye Tian, Xuantang Xiong, Lei Han
| Challenge: | Large Language Models (LLMs) have significantly impacted various domains, especially through organized LLM-driven autonomous agents. |
| Approach: | They propose a framework that enables orchestrated teams to jointly propose various task-oriented solutions and interact with their insights in a self-independence while cross-team collaboration environment for superior solutions generation. |
| Outcome: | Experiments show that the framework can generate better software quality compared to state-of-the-art frameworks. |
Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension (D19-58)
Copied to clipboard
| Challenge: | Experimental results show that unified model outperforms other models that treat encoding and matching separately. |
| Approach: | They evaluate a unified model with Transformer layers for machine reading comprehension . they find that the model learns different modeling strategies compared with previous models . |
| Outcome: | The unified model outperforms models with Transformer layers on the machine reading comprehension task. |
HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | In-depth research on the specific capabilities needed by the RAG generation model is lacking, leading to inconsistent document quality and retrieval system imperfections. |
| Approach: | They propose that RAG models should possess three progressively hierarchical abilities: (1) Filtering: the ability to select relevant information; (2) Combination: the capability to combine semantic information across paragraphs; (3) RAG-specific reasoning: the capacity to further process external knowledge using internal knowledge. |
| Outcome: | Experiments show that the proposed method significantly improves the model’s open-book examination capability on datasets such as RGB, PopQA, MuSiQue, HotpotQA, and PubmedQA. |
InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflection (2026.eacl-long)
Copied to clipboard
Yuhang Liu, Pengxiang Li, Zishu Wei, Congkai Xie, Xueyu Hu, Xinchen Xu, Shengyu Zhang, Xiaotian Han, Hongxia Yang, Fei Wu
| Challenge: | Existing GUI Agents face challenges in multi-step reasoning and reliance on textual annotations, limiting their effectiveness. |
| Approach: | They propose an MLLM-based GUI Agent with a two-stage supervised fine-tuning pipeline that enhances GUI understanding and grounding. |
| Outcome: | InfiGUIAgent achieves competitive performance on several GUI benchmarks, highlighting the impact of native reasoning skills in enhancing GUI interaction for automation tasks. |
MentalGLM Series: Explainable Large Language Models for Mental Health Analysis on Chinese Social Media (2025.emnlp-main)
Copied to clipboard
Wei Zhai, Nan Bai, Qing Zhao, Jianqiang Li, Fan Wang, Hongzhi Qi, Meng Jiang, Xiaoqin Wang, Bing Xiang Yang, Guanghui Fu
| Challenge: | Social media is a key platform for emotional expression, yet deep learning lacks flexibility and interpretability. |
| Approach: | They propose to use Chinese social media to train interpretable mental health instruction datasets to test models' ability to explain their decisions. |
| Outcome: | The proposed models outperform deep learning and LLMs on three mental health downstream tasks and demonstrate their potential for clinical applications. |
NUMINA: A Natural Understanding Benchmark for Multi-dimensional Intelligence and Numerical Reasoning Abilities (2025.findings-emnlp)
Copied to clipboard
Changyu Zeng, Yifan Wang, Zimu Wang, Wei Wang, Zhengni Yang, Muyi Bao, Jimin Xiao, Anh Nguyen, Yutao Yue
| Challenge: | Existing 3D benchmarks lack fine-grained numerical reasoning task annotations, limiting MLLMs’ ability to perform precise spatial measurements and complex numerical reasoning. |
| Approach: | They propose a 3D-based benchmark to enhance indoor perceptual understanding by using multi-scale annotations and question-answer pairs. |
| Outcome: | The proposed benchmark improves indoor perceptual understanding by incorporating multi-scale annotations and question-answer pairs. |
TabularMath: Understanding Math Reasoning over Tables with Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Mathematical reasoning has long been a key benchmark for evaluating large language models. |
| Approach: | They propose a framework that transforms math word problems into scalable tabular reasoning tasks. |
| Outcome: | The proposed framework transforms math word problems into scalable and verified tabular reasoning tasks. |
Extract, Transform and Filling: A Pipeline Model for Question Paraphrasing based on Template (D19-55)
Copied to clipboard
| Challenge: | Recent approaches for paraphrasing generate unpredictable results . |
| Approach: | They propose a question paraphrasing pipeline model based on templates that identifies template and retrieves candidate templates and fills them with original topic words. |
| Outcome: | The proposed model outperforms the seq2seq model on two datasets and is more promising when the training sample is small. |
Language Scaling for Universal Suggested Replies Model (2021.naacl-industry)
Copied to clipboard
Qianlan Ying, Payal Bajaj, Budhaditya Deb, Yu Yang, Wei Wang, Bojia Lin, Milad Shokouhi, Xia Song, Yang Yang, Daxin Jiang
| Challenge: | We consider scaling automated suggested replies (SR) to multiple languages for a commercial email application. |
| Approach: | They propose a multi-lingual multi-task continual learning framework with auxiliary tasks and language adapters to train universal language representation across regions. |
| Outcome: | The proposed model reduces catastrophic forgetting and improves cross-lingual transfer across languages while reducing training costs. |
Simple Hardware-Efficient PCFGs with Independent Left and Right Productions (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to scaling dense PCFGs to thousands of nonterminals have shown to be beneficial for unsupervised parsing, but they still perform poorly as a language model and as an unsupervised model. |
| Approach: | They propose a simple PCFG formalism with independent left and right productions that scales more effectively as a language model and as an unsupervised parser. |
| Outcome: | The proposed formalism scales better as a language model and as an unsupervised parser despite imposing a stronger independence assumption compared to low-rank approaches. |
A Black-Box Attack on Code Models via Representation Nearest Neighbor Search (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for generating adversarial code examples face challenges such as limted availability of substitute variables and the creation of adversarials with noticeable perturbations. |
| Approach: | They propose a search seed based on historical attacks to find adversarial substitutes . they employ a pre-trained variable name encoder to map the search seed to a continuous vector space . |
| Outcome: | The proposed approach outperforms baseline methods in terms of ASR and QT. |
TestAug: A Framework for Augmenting Capability-based NLP Tests (2022.coling-1)
Copied to clipboard
| Challenge: | Existing work on capability-based testing requires the developer to compose each individual test template from scratch. |
| Approach: | They propose a capability-based NLP testing framework that requires the developer to only annotate a few test templates while leveraging the GPT-3 engine to generate the majority of test cases. |
| Outcome: | The proposed framework saves the developer's manual efforts and guarantees the correctness of the generated suites with a validity checker. |
Guide the Many-to-One Assignment: Open Information Extraction via IoU-aware Optimal Transport (2023.acl-long)
Copied to clipboard
Kaiwen Wei, Yiran Yang, Li Jin, Xian Sun, Zequn Zhang, Jingyuan Zhang, Xiao Li, Linhao Zhang, Jintao Liu, Guo Zhi
| Challenge: | Open Information Extraction (OIE) aims to extract structured information from text without the limitations of close ontology. |
| Approach: | They propose a method to assign ground truth labels to parallelly generated tuple proposals . they leverage intersection-over-union (IoU) as assignment quality measurement . |
| Outcome: | The proposed method outperforms the state-of-the-art models on three benchmarks. |
Examining False Positives under Inference Scaling for Mathematical Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in language models have led to significant improvements in mathematical reasoning across benchmarks. |
| Approach: | They analyze the prevalence of false positives in language models by using heuristic evaluation methods . they find that false positive models produce correct final answers but with flawed deduction paths . |
| Outcome: | The proposed model performance improvements are based on the proposed model and its evaluation metrics. |
WR-One2Set: Towards Well-Calibrated Keyphrase Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that keyphrase generation has serious calibration errors . ONE2SET generates short phrases summarizing an input document . |
| Approach: | They propose a paradigm for keyphrase generation that generates short phrases summarizing an input document. |
| Outcome: | The proposed model over-estimates tokens and makes it well-calibrated on common datasets. |
SARA: Salience-Aware Reinforced Adaptive Decoding for Large Language Models in Abstractive Summarization (2025.acl-long)
Copied to clipboard
| Challenge: | Existing decoding strategies neglect the explicit use of salient contextual information and rely on static hyperparameters to fix the balance between contextual and prior knowledge. |
| Approach: | They propose a salience-aware reinforced adaptive decoding (SARA) which incorporates salient contextual information and allows the model to determine reliance on source document's context, salient context, and model's prior knowledge based on pointwise mutual information. |
| Outcome: | The proposed model improves the quality and faithfulness of summaries across LLMs without modifying their weights. |
Enhancing the Transferability of Jailbreak Attacks on Large Language Models via Exploiting Reparameterization Invariance (2026.acl-long)
Copied to clipboard
| Challenge: | Existing token-level attacks have shown efficacy on open-source models but suffer from poor cross-model transferability. |
| Approach: | They propose a framework to improve cross-model transferability by modifying model parameters and generating update directions according to differences in output distributions rather than parameter-space distances. |
| Outcome: | The proposed framework improves cross-model transferability and success rates on open-source models. |
Read, Attend and Comment: A Deep Architecture for Automatic News Comment Generation (D19-1)
Copied to clipboard
| Challenge: | Existing methods for news comment generation have not been well studied. |
| Approach: | They propose a “read-attend-comment” procedure for automatic news comment generation and formalize it with a reading network and a generation network. |
| Outcome: | The proposed procedure outperforms existing methods in terms of automatic evaluation and human judgment on two public datasets. |
Logical Phase Transitions: Understanding Collapse in LLM Logical Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Symbolic logical reasoning is a critical yet underexplored capability of large language models (LLMs). |
| Approach: | They propose a framework that aligns natural language with logical symbols to establish a shared representation and reshapes training dynamics around phase-transition boundaries to progressively strengthen reasoning at increasing logical depths. |
| Outcome: | The proposed framework mitigates logical reasoning collapse at high complexity while improving generalization to unseen logical compositions. |
Transfer Learning for Context-Aware Question Matching in Information-seeking Conversations in E-commerce (P18-2)
Copied to clipboard
| Challenge: | Recent researches focus on deep learning and reinforcement learning for multi-turn information seeking conversation systems. |
| Approach: | They propose an efficient and effective multi-turn conversation model based on convolutional neural networks and extend it to adapt the knowledge learned from a resource-rich domain to enhance the performance. |
| Outcome: | The proposed model performs better than the existing model on an industrial chatbot called AliMe Assist. |
WSDMS: Debunk Fake News via Weakly Supervised Detection of Misinforming Sentences with Contextualized Social Wisdom (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for debunking fake news rely on blending of authentic and fabricated content by creators. |
| Approach: | They propose a model that detects misinformation at sentence-level using social media conversations . they use a bag-level annotation system to train the model . |
| Outcome: | The proposed model outperforms existing state-of-the-art models on three real-world benchmarks and outperformed existing state of the art models in debunking fake news at sentence and article levels. |
Where to Attack: A Dynamic Locator Model for Backdoor Attack in Text Classifications (2022.coling-1)
Copied to clipboard
| Challenge: | BackDoor Attack (BDA) study aims to train a poisoned model with clean data and some trigger-embedded instances to perform normally on normal inputs. |
| Approach: | They propose to train a poisoned model with clean and poisonest inputs . they propose to use triggers to predict those poisonets as target labels . |
| Outcome: | The proposed model can predict P2P dynamically without human intervention. |
Tackling Modality Heterogeneity with Multi-View Calibration Network for Multimodal Sentiment Detection (2023.acl-long)
Copied to clipboard
| Challenge: | Existing studies focus on fusing different features but ignore the challenge of modality heterogeneity. |
| Approach: | They propose a text-guided fusion module with novel Sparse-Attention to reduce the negative impacts of redundant visual elements and a sentiment-based congruity constraint task to calibrate the feature shift in the representation space. |
| Outcome: | The proposed model is competitive against existing methods and achieves state-of-the-art results on two public benchmark datasets. |
Compressing then Matching: An Efficient Pre-training Paradigm for Multimodal Embedding (2026.acl-long)
Copied to clipboard
Da Li, Yuxiao Luo, Keping Bi, Jiafeng Guo, Wei Yuan, Biao Yang, Yan Wang, Fan Yang, Tingting Gao, Guorui Zhou
| Challenge: | Recent approaches demonstrate that MLLMs can be adapted into competitive embedding models via large-scale contrastive learning. |
| Approach: | They propose a compressed pre-training phase which serves as a warm-up stage for contrastive learning. |
| Outcome: | The proposed model achieves state-of-the-art among MLLMs of comparable size on the MMEB, realizing optimization in both efficiency and effectiveness. |
DESED: Dialogue-based Explanation for Sentence-level Event Detection (2022.coling-1)
Copied to clipboard
Yinyi Wei, Shuaipeng Liu, Jianwei Lv, Xiangyu Xi, Hailei Yan, Wei Ye, Tong Mo, Fan Yang, Guanglu Wan
| Challenge: | Existing methods for sentence-level event detection depend on manual annotations or domain expertise to design sophisticated templates and rules. |
| Approach: | They propose a dialogue-based explanation paradigm to enhance sentence semantics for event detection. |
| Outcome: | The proposed method can be applied to two event detection datasets. |
Identifying Cellular Niches in Spatial Transcriptomics: An Investigation into the Capabilities of Large Language Models (2025.acl-long)
Copied to clipboard
Huanhuan Wei, Xiao Luo, Hongyi Yu, Jinping Liang, Luning Yang, Lixing Lin, Alexandra Popa, Xiting Yan
| Challenge: | Spatial transcriptomic technologies allow measuring gene expression profile and spatial information of cells in tissues simultaneously. |
| Approach: | They propose a spatial transcriptomic approach to identify spatial niches using a zero-shot large language models by transforming spatial transcriptomics data into spatial context prompts. |
| Outcome: | The proposed model improves performance by leveraging gene expression of neighboring cells/spots, cell type composition, tissue information, and external knowledge. |
FlashAudio: Rectified Flow for Fast and High-Fidelity Text-to-Audio Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Recent advances in latent diffusion models (LDMs) have markedly enhanced text-to-audio generation, yet their iterative sampling processes impose substantial computational demands, limiting practical deployment. |
| Approach: | They propose to learn straight flow for fast simulation by using flashAudio with rectified flows and immiscible flow to minimize the total distance of data-noise pairs in a batch vias assignment. |
| Outcome: | The proposed method can learn straight flow for fast simulations and reduce noise distribution. |
GNN-encoder: Learning a Dual-encoder Architecture via Graph Neural Networks for Dense Passage Retrieval (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to perform large-scale query-passage retrieval are term-based, but they lose interaction between query-pastage pairs. |
| Approach: | They propose to fuse query (passage) information into query representations via graph neural networks that are constructed by queries and their top retrieved passages. |
| Outcome: | The proposed model outperforms existing models on MSMARCO, Natural Questions and TriviaQA datasets and achieves the new state-of-the-art on these datasets. |
KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction (2024.acl-long)
Copied to clipboard
Zixuan Li, Yutao Zeng, Yuxin Zuo, Weicheng Ren, Wenxuan Liu, Miao Su, Yucan Guo, Yantao Liu, Lixiang Lixiang, Zhilei Hu, Long Bai, Wei Li, Yidan Liu, Pan Yang, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng
| Challenge: | None. None.. None! |
| Approach: | None. None.. None! |
| Outcome: | None. None. No. : |
Automatic Mathematic In-Context Example Generation for LLM Using Multi-Modal Consistency (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for in-context learning require annotated datasets, resulting in higher computational costs and lower quality examples. |
| Approach: | They propose a framework that automatically generates high-quality in-context examples to enhance LLMs’ mathematical reasoning. |
| Outcome: | Evaluated on four math problem datasets, the proposed framework outperforms baseline methods with LLM accuracy ranging from 87.0% to 99.3%. |
ASAP: A Chinese Review Dataset Towards Aspect Category Sentiment Analysis and Rating Prediction (2021.naacl-main)
Copied to clipboard
| Challenge: | Sentiment analysis is a key task in e-commerce to detect fine-to-coarse sentiment polarities. |
| Approach: | They propose to use a large-scale Chinese restaurant review dataset ASAP to investigate the sentiment polarities underlying user reviews. |
| Outcome: | The proposed model outperforms state-of-the-art models on both tasks. |
From Imitation to Discrimination: Progressive Curriculum Learning for Robust Web Navigation (2026.findings-acl)
Copied to clipboard
| Challenge: | Text-based web agents offer computational efficiency for autonomous web navigation, yet they lack discrimination capabilities to reject plausible but incorrect elements in densely populated pages. |
| Approach: | They propose a model that uses a text-based web agent to learn to discriminate against incorrect elements in densely populated HTML and a training curriculum to synthesize diverse cross-domain tasks with strict verification. |
| Outcome: | Empirical evaluation shows that the model performs better than open-source models with 58.7% step success rate. |
PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice (2026.acl-long)
Copied to clipboard
Yuzhen Shi, Huanghai Liu, Yiran HU, Song Gaojie, Xu Xinran, Yubo Ma, Tianyi Tang, Li Zhang, Qingjing Chen, Feng Di, Wenbo Lv, Weiheng Wu, Kexin Yang, Sen Yang, Wei Wang, Rongyao Shi, Qiu Yuanyang, Yuemeng Qi, Zhang Jingwen, Sui Xiaoyu, Yifan Chen, Zhang Yi, An Yang, Bowen Yu, Dayiheng Liu, Junyang Lin, Weixing Shen, Bing Zhao, Charles L. A. Clarke, HU Wei
| Challenge: | Existing benchmarks for large language models (LLMs) are coarse, single-dimensional metrics and do not explicitly assess fine-grained legal reasoning. |
| Approach: | They propose a Practical Law Benchmark to evaluate large language models in real-world legal practice scenarios. |
| Outcome: | The proposed model is based on 850 questions and 13 scenarios with expert-designed evaluation rubrics. |
Dialectical Structured Reasoning for Explainable Multimodal Fake News Detection (2026.findings-acl)
Copied to clipboard
Ruichao Yang, Yufan Bian, Wei Gao, Bo-Wen Zhang, Jing Ma, Hongzhan Lin, Ziyang Luo, Xiaobin Zhu, Xu-Cheng Yin
| Challenge: | Existing fake news detection models are opaque and lack deductive transparency . a framework for dialectical structured reasoning is proposed to address this limitation . |
| Approach: | They propose a framework that model fake news detection as an explicit dialectical process over multimodal social context. |
| Outcome: | The proposed framework achieves state-of-the-art while producing transparent explanations that mirror human reasoning process. |
Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey (2025.findings-naacl)
Copied to clipboard
Xiaoyu Liu, Paiheng Xu, Junda Wu, Jiaxin Yuan, Yifan Yang, Yuhang Zhou, Fuxiao Liu, Tianrui Guan, Haoliang Wang, Tong Yu, Julian McAuley, Wei Ai, Furong Huang
| Challenge: | Large Language Models (LLMs) have shown great potential to enhance Natural Language Processing (NLP) models in areas such as predictive accuracy, fairness, robustness, and explainability. |
| Approach: | They evaluate or improve generative Large Language Models from a causal perspective in areas such as reasoning capacity, fairness and safety issues, explainability, and handling multimodality. |
| Outcome: | The proposed models can be used to perform causal relationship discovery and causal effect estimation tasks. |
Beyond Quantity: Trajectory Diversity Scaling for Code Agents (2026.findings-acl)
Copied to clipboard
Guhong Chen, Chenghao Sun, Cheng Fu, Qiyao Wang, Zhihong Huang, ChaoPeng Wei, Guangxu Chen, Feiteng Fang, Ahmadreza Argha, Bing Zhao, Xander Xu, Qi Han, Hamid Alinejad-Rokny, Qiang Qu, Binhua Li, Shiwen Ni, Min Yang, HU Wei, Yongbin Li
| Challenge: | Code large language models (LLMs) are becoming tool-interactive agents . quantity-centric scaling exhibits an early bottleneck that underutilizes trajectory data . et al.: a new approach to scale trajectory diversity improves tool-use generalization . |
| Approach: | They propose a Trajectory Diversity Scaling-based data synthesis framework for code agents that scales performance through diversity rather than raw volume. |
| Outcome: | Experiments on general tool-use benchmarks and code agent tasks show that TDScaling improves tool-user generalization and inherent coding proficiency. |
Agent-GWO: Collaborative Agents for Dynamic Prompt Optimization in Large Language Models (2026.findings-acl)
Copied to clipboard
Xudong Wang, Chaoning Zhang, Chenghao Li, Shuxu Chen, Qigan Sun, Jiaquan Zhang, Fachrina Dewi Puspitasari, Tae-Ho Kim, Jiwei Wei, Malu Zhang, Guoqing Wang, Yang Yang, Heng Tao Shen
| Challenge: | Existing automatic prompt optimization methods fail to optimize prompts and decoding hyperparameters within a unified framework to achieve stable global improvements. |
| Approach: | They propose a dynamic prompt optimization framework for complex reasoning that unifies prompt templates and decodes hyperparameters as inheritable agent configurations. |
| Outcome: | Experiments on multiple mathematical and hybrid reasoning benchmarks show that Agent-GWO improves accuracy and stability over existing prompt optimization methods. |
Semantic-Aware Logical Reasoning via a Semiotic Framework (2026.acl-long)
Copied to clipboard
Yunyao Zhang, Xinglang Zhang, Junxi Sheng, Wenbing Li, Junqing Yu, Yi-Ping Phoebe Chen, Wei Yang, Zikai Song
| Challenge: | Existing studies largely overlook the interplay between logical complexity and semantic complexity, limiting their robustness under abstract propositions, ambiguous contexts, and conflicting stances. |
| Approach: | They propose a semiotic-square-guided framework that integrates automated deduction with reflective verification to manage logical complexity across deeper reasoning chains. |
| Outcome: | The proposed framework achieves state-of-the-art performance on RepublicQA with 6.25% average gain, and generalizes well to four mainstream logical reasoning benchmarks with an additional 7.05% improvement. |
Exploring the Effectiveness of Multi-Lingual Commonsense Knowledge-Aware Open-Domain Dialogue Response Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have shown that commonsense knowledge-aware models can improve informativeness while reducing the hallucination issue. |
| Approach: | They propose a task to use commonsense knowledge in other languages to enhance the current dialogue generation by using commonsensical knowledge in different languages. |
| Outcome: | The proposed model improves the current dialogue generation while reducing the hallucination issue. |
DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to improve the robustness of text classification models are token-, sentence-, and hiddenlevel augmentation. |
| Approach: | They propose an interpolation-based data augmentation approach called DoubleMix to improve the robustness of text classification models by learning the “shifted” features in hidden space. |
| Outcome: | The proposed approach outperforms several popular methods on six text classification benchmark datasets and visual analysis shows that the model features are highly interpretable. |
A Frustratingly Simple Decoding Method for Neural Text Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Neural text generation is notorious for repetitive loops and tedious outputs. |
| Approach: | They propose a method that penalizes future generation of repetitive content . they construct an anti-LM based on previously generated text . |
| Outcome: | The proposed method outperforms established baselines in terms of generation quality, decoding speed, and universality. |
Neural CRF Model for Sentence Alignment in Text Simplification (2020.acl-main)
Copied to clipboard
| Challenge: | Text simplification systems are based on the quality and quantity of complex-simple sentence pairs extracted by aligning sentences between parallel articles. |
| Approach: | They propose a neural CRF alignment model which leverages the sequential nature of sentences in parallel documents and utilizes a sentence pair model to capture semantic similarity. |
| Outcome: | The proposed model outperforms previous work on monolingual sentence alignment task by more than 5 points in F1. |
Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence (2024.findings-acl)
Copied to clipboard
| Challenge: | Emotional Intelligence (EI) is a key concept in the field of human intelligence. |
| Approach: | They propose a method to enhance EI of large language models by naive fine-tuning on EI-related tasks. |
| Outcome: | The proposed method improves EI of two LLM-based assistants without compromising GI. |
Cross-Domain Audio Deepfake Detection: Dataset and Analysis (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing audio deepfake detection datasets are outdated and lack generalization capabilities. |
| Approach: | They construct a new cross-domain audio deepfake detection dataset comprising over 300 hours of speech data that is generated by five advanced zero-shot TTS models. |
| Outcome: | The proposed models achieve 4.1% and 6.5% error rates in the cross-domain ADD dataset generated by five advanced zero-shot TTS models. |
Can Large Language Models Translate Unseen Languages in Underrepresented Scripts? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated impressive performance in machine translation, but struggle with unseen low-resource languages. |
| Approach: | They propose a benchmark to evaluate translation for Mongolian and Yi using linguistic resources. |
| Outcome: | The proposed model can translate Mongolian (in traditional script) and Yi with the help of linguistic resources, but is limited in its ability to handle these languages effectively. |
Improved Pseudo Data for Machine Translation Quality Estimation with Constrained Beam Search (2023.emnlp-main)
Copied to clipboard
Xiang Geng, Yu Zhang, Zhejian Lai, Shuaijie She, Wei Zou, Shimin Tao, Hao Yang, Jiajun Chen, Shujian Huang
| Challenge: | evaluating the quality of machine translation outputs becomes increasingly essential with the rapid development of machine language (MT). |
| Approach: | They propose to generate pseudo data using the MT model with constrained beam search (CBSQE) they propose to preserve the reference parts with high MT probabilities as correct translations . |
| Outcome: | The proposed model outperforms strong baselines in both supervised and unsupervised settings. |
Cross-Domain Modeling of Sentence-Level Evidence for Document Retrieval (D19-1)
Copied to clipboard
| Challenge: | Existing test collections provide only document-level relevance judgments, and documents exceed the length that BERT was designed to handle. |
| Approach: | They propose to aggregate sentence-level evidence to rank news articles using BERT . they also leverage passage-level relevance judgments available in other domains to fine-tune BERT models that capture cross-domain notions of relevance. |
| Outcome: | The proposed model aggregates sentence-level evidence to rank documents on three standard test collections. |
xMoCo: Cross Momentum Contrastive Learning for Open-Domain Question Answering (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to find relevant passages using sparse keywords are not effective for open domain question answering. |
| Approach: | They propose a new contrastive learning method for learning a dual-encoder model for question-passage matching using a large pool of negative samples. |
| Outcome: | The proposed method maintains large pool of negative samples and optimizes question-to-passage and passage-to question matching tasks. |
Stephanie: Step-by-Step Dialogues for Mimicking Human Interactions in Social Conversations (2025.findings-naacl)
Copied to clipboard
Hao Yang, Hongyuan Lu, Xinhua Zeng, Yang Liu, Xiang Zhang, Haoran Yang, Yumeng Zhang, Shan Huang, Yiran Wei, Wai Lam
| Challenge: | a new paradigm for dialogue systems is being developed to mimic human interactions . the current single-step dialogue paradigm lacks the depth and fluidity of human interactions. |
| Approach: | They propose a step-by-step dialogue paradigm that mimics human interactions . they use a dataset to fine-tune existing language models . |
| Outcome: | The proposed system mimics the dynamic nature of human conversations . it is compared with existing paradigms and will be released later this year . |
Learning to Rewrite: Generalized LLM-Generated Text Detection (2025.acl-long)
Copied to clipboard
| Challenge: | Existing detectors for Large Language Models (LLMs) struggle to generalize in open-world settings. |
| Approach: | They propose a framework to detect LLM-generated text with exceptional generalization to unseen domains by reinforcing LLMs’ inherent rewriting tendencies. |
| Outcome: | The proposed framework outperforms state-of-the-art detection methods by 23.04% in AUROC, 35.10% for out-of distribution tests, and 48.66% under adversarial attacks. |
Structured Mean-Field Variational Inference for Higher-Order Span-Based Semantic Role Labeling (2023.findings-acl)
Copied to clipboard
| Challenge: | Span-based semantic role labeling is traditionally tackled by BIObased sequence labeling approaches. |
| Approach: | They propose to decompose the edge from predicate word to argument span into three different edges, enabling higher-order inference. |
| Outcome: | The proposed model outperforms vanilla MFVI on span-based semantic role labeling benchmarks. |
PAPERMIND: Benchmarking Agentic Reasoning and Critique over Scientific Papers in Multimodal LLMs (2026.findings-acl)
Copied to clipboard
Yanjun Zhao, Tianxin Wei, Jiaru Zou, Xuying Ning, Yuanchen Bei, Lingjie Chen, Simmi Rana, Wendy H. Yang, Hanghang Tong, Jingrui He
| Challenge: | Existing benchmarks assess integrated and agent-oriented scientific reasoning in isolation . Existing systems assess integrated reasoning in isolated tasks . |
| Approach: | They propose a benchmark to evaluate integrated and agent-oriented scientific reasoning over research papers. |
| Outcome: | The proposed benchmark evaluates integrated and agent-oriented scientific reasoning over scientific papers. |
INarIG: Iterative Non-autoregressive Instruct Generation Model For Word-Level Auto Completion (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for word-level autocompletion (WLAC) only use human typed sequences as prefixes in decoding module. |
| Approach: | They propose a novel iterative nonautoregressive instruct generation model for WLAC task . it uses human typed sequences and iterating decoding with subwords to fully utilize input information. |
| Outcome: | The proposed model is more competent in dealing with low-frequency words, and achieves state-of-the-art results on the WMT22 and benchmark datasets. |
Bloom-Eval: A Hierarchical Evaluation Benchmark for Automatic Survey Generation Based on Bloom’s Taxonomy (2026.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation methods suffer from cognitive dimensional simplification and methodological unreliability due to the ”LLM-as-a-Judge” approach. |
| Approach: | They propose a six-tiered benchmark that evaluates ASG systems by prioritizing deterministic algorithms and introducing a GRADE approach for abstract abilities. |
| Outcome: | The proposed method provides the ASG field with a systematic, reproducible, and theoretically grounded benchmark to guide future research. |
SUN: Exploring Intrinsic Uncertainties in Text-to-SQL Parsers (2022.coling-1)
Copied to clipboard
Bowen Qin, Lihan Wang, Binyuan Hui, Bowen Li, Xiangpeng Wei, Binhua Li, Fei Huang, Luo Si, Min Yang, Yongbin Li
| Challenge: | Existing methods that learn from multiple semantically-equivalent questions are limited to one-to-one mapping . |
| Approach: | They propose a constraint to explore the underlying complementary semantic information among multiple semantically-equivalent questions and learn robust feature representations with reduced spurious associations. |
| Outcome: | The proposed method outperforms strong competitors and achieves state-of-the-art results on five benchmark datasets. |
Analyzing Code Embeddings for Coding Clinical Narratives (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent work on automated ICD coding learn mappings between low-dimensional representations of clinical text reports and codes. |
| Approach: | They propose novel neural networks for encoding medical codes based on textual, structural and statistical characteristics using a single deep learning baseline model. |
| Outcome: | The proposed methods improve the accuracy of medical codes based on their textual, structural and statistical characteristics. |
AI-Press: A Multi-Agent News Generating and Feedback Simulation System Powered by Large Language Models (2025.coling-demos)
Copied to clipboard
Xiawei Liu, Shiyue Yang, Xinnong Zhang, Haoyu Kuang, Libo Sun, Yihang Yang, Siming Chen, Xuanjing Huang, Zhongyu Wei
| Challenge: | We introduce AI-Press, an automated news drafting and polishing system based on multi-agent collaboration and Retrieval-Augmented Generation. |
| Approach: | They introduce AI-Press, an automated news drafting and polishing system based on multi-agent collaboration and Retrieval-Augmented Generation. |
| Outcome: | The proposed system generates public responses considering demographic distributions. |
Refining Corpora from a Model Calibration Perspective for Chinese Spelling Correction (2024.findings-acl)
Copied to clipboard
| Challenge: | Chinese Spelling Correction (CSC) lacks large-scale high-quality corpora due to labor-intensive labeling of spelling errors in real-life writing or typing scenarios. |
| Approach: | They propose to use OCR/ASR-based generation to refine Chinese Spelling Correction models on random replacement-based corpora and filter them based on prediction confidence. |
| Outcome: | The proposed model outperforms existing models on three widely-used benchmarks while significantly alleviating over-correction. |
Boosting Policy and Process Reward Models with Monte Carlo Tree Search in Open-Domain QA (2025.findings-acl)
Copied to clipboard
Chi-Min Chan, Chunpu Xu, Junqi Zhu, Jiaming Ji, Donghai Hong, Pengcheng Wen, Chunyang Jiang, Zhen Ye, Yaodong Yang, Wei Xue, Sirui Han, Yike Guo
| Challenge: | Experimental results show that our approach can effectively improve the performance of both the policy model and the reward model. |
| Approach: | They propose to use Monte Carlo Tree Search for both policy model improvement and reward model improvement to bridge it to more subtle open-domain question answering. |
| Outcome: | The proposed approach surpasses existing methods for annotation and training data with fewer data points and achieves better performance in test-time scaling strategies. |
MdEval: Massively Multilingual Code Debugging (2026.findings-acl)
Copied to clipboard
Shukai Liu, Linzheng Chai, Jian Yang, Jiajun Shi, He Zhu, Liran Wang, Jin Ke, Wei Zhang, Hualei Zhu, Shuyue Guo, Tao Sun, Jiaheng Liu, Yunlong Duan, Yu Hao, Liqun Yang, Guanglin Niu, Ge Zhang, Zhoujun Li
| Challenge: | Existing benchmarks primarily focus on Python and are limited in terms of language diversity. |
| Approach: | They propose a multilingual debugging benchmark that includes 3.9K test samples of 20 programming languages and introduces the debug instruction corpora MdEval-Instruct by injecting bugs into the correct multilingual queries and solutions. |
| Outcome: | The proposed benchmark includes 3.9K test samples of 20 programming languages and covers the automated program repair task, bug localization task, and bug identification task. |
Diagnosing and Remedying Representation Deficiencies for Deterministic Reasoning in KGQA (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to solve non-deterministic reasoning problems in large language models are limited by their complexity and lack of a clear understanding of the problem. |
| Approach: | They propose a method to diagnose and correct non-deterministic reasoning behaviors in large language models. |
| Outcome: | The proposed method outperforms baselines and WebQSP benchmarks on the widely used WebQ SP and CWQ benchmarks. |
From Long Videos to Engaging Clips: A Human-Inspired Video Editing Framework with Multimodal Narrative Understanding (2025.emnlp-industry)
Copied to clipboard
Xiangfeng Wang, Xiao Li, Yadong Wei, null Songxueyu, Yang Song, null Xiaxiaoqiang, Fangrui Zeng, Zaiyi Chen, null Liuliu, Gu Xu, Tong Xu
| Challenge: | Existing methods for video editing rely on textual cues from ASR transcripts and segment selection, often neglecting rich visual context. |
| Approach: | They propose a human-inspired automatic video editing framework that leverages multimodal narrative understanding to address these limitations. |
| Outcome: | The proposed framework outperforms existing baselines across general and advertisement-oriented editing tasks. |
PLAY2PROMPT: Zero-shot Tool Instruction Optimization for LLM Agents via Tool Play (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing solutions for large language models rely on manual rewriting or labeled data for validation . Existing approaches rely only on comprehensive tool documentation and in-context demonstrations . |
| Approach: | They propose a framework that "plays" with each tool to explore its input-output behaviors. |
| Outcome: | Experiments show that PLAY2PROMPT improves zero-shot tool performance across open and closed models. |
P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs (2025.emnlp-main)
Copied to clipboard
Yidan Zhang, Yu Wan, Boyi Deng, Baosong Yang, Hao-Ran Wei, Fei Huang, Bowen Yu, Dayiheng Liu, Junyang Lin, Fei Huang, Jingren Zhou
| Challenge: | Recent advances in large language models showcase varied multilingual capabilities across tasks . previous assessments focused on fundamental natural language processing (NLP) or isolated capability-specific tasks. |
| Approach: | They propose a multilingual multitask benchmark to assess multilingual capabilities . they use a large-scale benchmark covering fundamental and capability-specialized datasets . |
| Outcome: | The proposed benchmark compares models and tasks across languages and tasks and examines knowledge transfer from English to other languages. |
LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding (2021.acl-long)
Copied to clipboard
Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou
| Challenge: | Existing pre-training tasks for text and layout are effective in visually-rich document understanding tasks. |
| Approach: | They propose to combine pre-training tasks with a multi-modal model to model interaction between text, layout and image in a single multi-module framework. |
| Outcome: | The proposed model outperforms LayoutLM by a large margin on visual-rich document understanding tasks. |
Incorporating Contextual and Syntactic Structures Improves Semantic Similarity Modeling (D19-1)
Copied to clipboard
| Challenge: | Semantic similarity modeling is central to many NLP problems such as question answering. |
| Approach: | They propose a pairwise word interaction model with syntactic structure priors to explore their effectiveness. |
| Outcome: | Extensive evaluations on eight benchmark datasets show that incorporating structural information improves over strong baselines. |
Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective Rewards (2024.acl-long)
Copied to clipboard
| Challenge: | Reinforcement Learning from Human Feedback (RLHF) relies on scalar rewards to capture user preferences. |
| Approach: | They propose a framework that integrates multi-objective reward modeling to represent diverse preference profiles. |
| Outcome: | The proposed method improves performance across reward objectives and targets. |
SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution (2026.findings-acl)
Copied to clipboard
Zhenyu He, Qingping Yang, Wei Shen, Xiaojian Zhong, Kechi Zhang, Chenxin An, Wenlei Shi, Tianle Cai, Di He, Jiaze Chen, Jingjing Xu
| Challenge: | SWE-Swiss-32B demonstrates strong generalization to other common LLM benchmarks. |
| Approach: | They propose a two-phase training recipe that decomposes issue resolution into three core skills: Localization, Repair, and Unit Test Generation. |
| Outcome: | The proposed model achieves a 60.2% score on the SWE-bench Verified benchmark and is in the top-tier performance bracket of much larger models. |
DoCIA: An Online Document-Level Context Incorporation Agent for Speech Translation (2025.findings-acl)
Copied to clipboard
Xinglin Lyu, Wei Tang, Yuang Li, Xiaofeng Zhao, Ming Zhu, Junhui Li, Yunfei Lu, Min Zhang, Daimeng Wei, Hao Yang, Min Zhang
| Challenge: | Document-level context is crucial for speech translation due to noise from ASR . incorporating document-level contextual information into ST remains a challenge . |
| Approach: | They develop an online framework that integrates document-level context into machine translation . they use document-based modules to integrate document- level context into ST . |
| Outcome: | The proposed framework outperforms baselines in sentence and discourse metrics . it can correct ASR transcription errors and improve translation performance . |
SUPERT: Towards New Frontiers in Unsupervised Evaluation Metrics for Multi-Document Summarization (2020.acl-main)
Copied to clipboard
| Challenge: | Existing evaluation methods for document summarization require human annotations and annotations. |
| Approach: | They propose a method which measures the quality of a summary by measuring its semantic similarity with a pseudo reference summary, using contextualized embeddings and soft token alignment techniques. |
| Outcome: | The proposed method correlates better with human ratings by 18- 39% compared to the state-of-the-art evaluation metrics. |
A Reinforcement Learning Framework for Natural Question Generation using Bi-discriminators (C18-1)
Copied to clipboard
| Challenge: | Existing research on visual question generation is focused on training models to fit the annotated data set that makes them indifferent from other language generation tasks. |
| Approach: | They propose to use two discriminators to enhance the training of a visual question generator to ask natural questions about an image. |
| Outcome: | The proposed model outperforms state-of-the-art models in terms of automatic and human evaluation metrics. |
AutoEvolve: Automatically Evolving Queries for Applicable and Scalable Retrieval-Augmented Generation Benchmarking (2025.findings-emnlp)
Copied to clipboard
Ding-Chu Zhang, Xiaowen Zhang, Yue Fei, Renjun Hu, Xiao-Wen Yang, Zhi Zhou, Baixuan Li, Yu-Feng Li, Xing Shi, Wei Lin
| Challenge: | Existing automated generation methods exhibit Weak Applicability and Weak Scalability . existing methods are limited by their reliance on metadata from specific corpora . |
| Approach: | They propose an approach to generate scalable RAG benchmarks using corpus-agnostic methods . they propose a difficulty-guided metric that directs query evolution process . |
| Outcome: | The proposed approach evolves queries significantly more challenging than existing methods . it is able to dynamically increase difficulty, limiting scalability of the query . |
Dynamic Transformers Provide a False Sense of Efficiency (2023.acl-long)
Copied to clipboard
| Challenge: | Pre-trained language models typically lead to high computational cost during inference. |
| Approach: | They propose a slowdown attack framework that can reduce inference efficiency by 80% by leveraging existing adversarial attacks targeting model accuracy. |
| Outcome: | The proposed framework can reduce the efficiency of multi-exit models by 80% on average, validating its effectiveness and generalization ability. |
SGM: Sequence Generation Model for Multi-label Classification (C18-1)
Copied to clipboard
| Challenge: | Existing methods ignore the correlations between labels and different parts of the text can contribute differently for predicting different labels. |
| Approach: | They propose to view the multi-label classification task as a sequence generation problem and apply a decoder-based sequence generation model to solve it. |
| Outcome: | The proposed methods outperform previous work by a substantial margin. |
Cogito: A Cognitive Agentic Framework Driven by Dynamic Graph of Thoughts for Financial Report Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to financial report generation are insufficient to handle dynamic uncertainties of real-world financial environments. |
| Approach: | They propose a cognitively grounded agentic framework for professional financial report generation that is driven by Dynamic Graph of Thoughts and a social collaboration mechanism to facilitate coordinated agent interaction. |
| Outcome: | The proposed framework is based on a dynamic reasoning model and social collaboration mechanism. |
Task-oriented Word Embedding for Text Classification (C18-1)
Copied to clipboard
| Challenge: | Existing word embeddings only consider contextual information, which is suboptimal when used in various tasks due to a lack of task-specific features. |
| Approach: | They propose a task-oriented word embedding method that regularizes the distribution of words to enable a clear classification boundary. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on a text classification task. |
Exploiting Intrinsic Multilateral Logical Rules for Weakly Supervised Natural Language Video Localization (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for WS-NLVL rarely consider complex temporal relations enclosing the language query, yielding illogical predictions. |
| Approach: | They propose a plug-and-play method to exploit temporal relations and logical rules for WS-NLVL. |
| Outcome: | The proposed method is able to retrieve the moment corresponding to a language query in a video with only video-language pairs utilized during training. |
MARIO-0.5B: A Multi-Agent Lightweight Model for Real-Time Open Information Extraction in Low-Resource Settings (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have shown remarkable capabilities in open information extraction, but their resource requirements often restrict their deployment in resource-constrained industrial settings. |
| Approach: | They introduce an ultra-lightweight large language model trained on instruction-based samples in Chinese, English, Korean, and Russian. |
| Outcome: | The proposed model outperforms large-scale models with up to 70B parameters, reducing computational resources by 140x and delivering 11x faster response times. |
Towards Automatic Evaluation of Dialog Systems: A Model-Free Off-Policy Evaluation Approach (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for evaluation of dialog systems are expensive and not scalable . a framework for estimating human evaluation scores is proposed to bridge this gap . |
| Approach: | They propose a framework for estimating human evaluation scores based on off-policy evaluation . they use language quality metrics for single-turn response generation given a fixed context . |
| Outcome: | The proposed framework outperforms existing methods in terms of correlation with human evaluation scores. |
Explore-Instruct: Enhancing Domain-Specific Instruction Coverage through Active Exploration (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing data for instruction-tuning are inadequate for a wide range of tasks, limiting the scope for nuanced comprehension and interactions within these domains. |
| Approach: | They propose to use Large Language Models to explore a multitude of variations or possibilities to improve instruction-tuning data by active exploration. |
| Outcome: | The proposed approach improves domain-specific instruction coverage and shows significant improvements over baselines. |
M-Ped: Multi-Prompt Ensemble Decoding for Large Language Models (2025.findings-emnlp)
Copied to clipboard
Jiaxin Guo, Daimeng Wei, Yuanchang Luo, Hengchao Shang, Zongyao Li, Jinlong Yang, Zhanglin Wu, Zhiqiang Rao, Shimin Tao, Hao Yang
| Challenge: | a new ensemble decoding approach enhances the performance of Large Language Models. |
| Approach: | They propose a multi-prompt ensemble decoding approach to enhance LLM performance . they submit n variations of prompts with X to LLMs in batch mode to decode and derive probability distributions . |
| Outcome: | The proposed method improves pass@k rates, LENS metrics and BLEU scores on diverse NLP tasks. |
Double-Checker: Large Language Model as a Checker for Few-shot Named Entity Recognition (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have demonstrated remarkable performance on few-shot Named Entity Recognition tasks due to the high cost of obtaining high-quality labeled data. |
| Approach: | They propose to decompose the task into entity span detection and entity type classification using a type-independent entity span detector and then classify the detected spans based on their types. |
| Outcome: | The proposed method consistently yields improvements over two baseline approaches. |
Local Interpretation of Transformer Based on Linear Decomposition (2023.acl-long)
Copied to clipboard
| Challenge: | Existing work on local explanation generation attempts to understand model dynamics on word-level or phraselevel by assigning importance scores on input features. |
| Approach: | They propose to interpret neural networks by linear decomposition by a Transformer model on a single input and a linear decomposing of the output to generate local explanations. |
| Outcome: | The proposed method achieves competitive performance in sentiment classification and machine translation, and fidelity of explanation. |
Investigating Capsule Networks with Dynamic Routing for Text Classification (D18-1)
Copied to clipboard
| Challenge: | Earlier efforts in text modeling have achieved limited success on word meanings . convolutional neural networks (CNNs) are used to model higher level concepts and facts in texts . |
| Approach: | They propose three strategies to stabilize dynamic routing process to alleviate disturbance of noise capsules. |
| Outcome: | The proposed methods achieve state-of-the-art on 4 out of 6 datasets . they show that capsule networks exhibit significant improvement over baseline methods . |
Bootstrapping Code Translation with Weighted Multilanguage Exploration (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods to improve code translation depend on abundant parallel code of high quality, which may not always be available. |
| Approach: | They propose a method that leverages functional invariance and cross-lingual portability of test suites to serve as universal verification oracles for multilingual reinforcement learning. |
| Outcome: | The proposed method leverages functional invariance and cross-lingual portability of test suites to serve as universal verification oracles for multilingual reinforcement learning (RL) training. |
Memo-SQL: Structured Decomposition and Experience-Driven Self-Correction for Training-Free NL2SQL (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing NL2SQL systems rely on in-context learning with only correct examples . current test-time scaling methods often decompose questions arbitrarily, resulting in poor performance . |
| Approach: | They propose a structured decomposition and experience-aware self-correction framework for NL2SQL . they build a dynamic memory of successful queries and historical error–fix pairs . |
| Outcome: | The proposed framework achieves 68.5% execution accuracy on BIRD, setting new state of the art among open, zero-fine-tuning methods. |
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)
Copied to clipboard
Jiaxin Bai, Wei Fan, Qi Hu, Qing Zong, Chunyang Li, Hong Ting Tsang, Hongyu Luo, Yauwai Yim, Haoyu Huang, Xiao Zhou, Feng Qin, Tianshi Zheng, Xi Peng, Xin Yao, Huiwen Yang, Leijie Wu, JI Yi, Gong Zhang, Renhai Chen, Yangqiu Song
| Challenge: | Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage. |
| Approach: | They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas. |
| Outcome: | The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality. |
A Sentence is Worth 128 Pseudo Tokens: A Semantic-Aware Contrastive Learning Framework for Sentence Embeddings (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to contrastive learning are heavily affected by superficial features like sentence length and syntax. |
| Approach: | They propose a semantic-aware contrastive learning framework for sentence embeddings that explores the pseudo-token space representation of a sentence while eliminating the impact of superficial features such as sentence length and syntax. |
| Outcome: | The proposed framework outperforms the state-of-the-art on six standard semantic textual similarity tasks while maintaining an additional queue to store the representation of sentence embeddings. |
FusionFlow: Enabling Deep Structural Exploration for Automated Agentic Workflow Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing workflow generation methods rely on incremental refinement or tree-based search over a single evolving workflow. |
| Approach: | They propose a framework centered on workflow fusion that synthesizes multiple independently evolved workflows and allows exploration of deeper regions of the workflow space within a finite budget. |
| Outcome: | Experiments show that FusionFlow outperforms existing workflow generation methods on six reasoning benchmarks. |
Diversity Helps Jailbreak Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for jailbreaking large language models rely on laborious human engineering and whitebox access to model internals. |
| Approach: | They propose a method that instructs large language models to deviate from prior context and generate harmful outputs by instructing them to deviat from previous attacks. |
| Outcome: | The proposed method achieves a 62.83% higher success rate in compromising ten leading chatbots, while using only 12.9% of the queries. |
WIKIBIAS: Detecting Multi-Span Subjective Biases in Language (2021.findings-emnlp)
Copied to clipboard
| Challenge: | a particular type of bias is subjective bias, which introduces improper attitudes or presents a statement with the presupposition of truth. |
| Approach: | They propose to annotate a Wikipedia edits corpus with 4,000 sentence pairs to detect subjective bias. |
| Outcome: | The proposed dataset can be used as a research benchmark and generalize to multiple domains. |
End-to-End Optimization of LLM-Driven Multi-Agent Search Systems via Heterogeneous-Group-Based Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing multi-agent reinforcement learning methods depend on large critic networks to evaluate joint actions, leading to instability and high memory costs. |
| Approach: | They propose a method to optimize large language models for agent-specific roles . they propose combining agent-based frameworks with retrieval-augmented generation . |
| Outcome: | Experiments show that multi-agent group policy optimization outperforms baselines in task performance and computational efficiency. |
VIRT: Improving Representation-based Text Matching via Virtual Interaction (2022.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that representation-based text matching methods suffer from performance degradation due to the lack of interactions between the pair of texts. |
| Approach: | They propose a virtual interaction mechanism that enables deep interaction between texts . they propose 'inteRacTion mechanism' that can be integrated into existing methods as plugins . |
| Outcome: | The proposed method outperforms state-of-the-art models on six text matching benchmarks. |
Exploring Label Hierarchy in a Generative Way for Hierarchical Text Classification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for hierarchical text classification are lacking in the field of natural language processing. |
| Approach: | They propose a hierarchy-aware T5 model with path-adaptive attention mechanism to exploit hierarchical dependency across different levels. |
| Outcome: | The proposed model outperforms state-of-the-art models especially in Macro-F1 and low Macro. |
Grammar-Based Patches Generation for Automated Program Repair (2021.findings-acl)
Copied to clipboard
| Challenge: | Automated program repair (APR) aims to find an automatic solution to program language bugs without human intervention. |
| Approach: | They propose a grammar-based rule-rule model which regards the repair process as the transformation of grammar rules and employs a tree-based self-attention approach to guarantee grammar correctness. |
| Outcome: | The proposed model outperforms the state-of-the-art models on a Java dataset in terms of generated code accuracy. |
Human-in-the-loop Evaluation for Early Misinformation Detection: A Case Study of COVID-19 Treatments (2023.acl-long)
Copied to clipboard
| Challenge: | Existing evaluations of human-in-the-loop systems to combat misinformation are often set up automatically using datasets that were retrospectively constructed. |
| Approach: | They propose a human-in-the-loop evaluation framework for fact-checking novel misinformation claims and identifying social media messages that support them. |
| Outcome: | The proposed framework is based on modern NLP methods for human-in-the-loop fact-checking in the domain of COVID-19 treatments. |
DMN: A Compositional Framework for Jailbreaking Multimodal LLMs with Multi-Image Inputs (2026.acl-long)
Copied to clipboard
| Challenge: | Existing jailbreak methods only use a single image, restricting the attack space . Existing frameworks only use single image to distribute harmful requests across multiple images . |
| Approach: | They propose a compositional jailbreak framework that leverages Distributed instruction, Multimodal evidence and a Number chain task to fully enhance the jailbreak performance. |
| Outcome: | The proposed framework achieves attack success rates of over 90% on GPT-4o, Gemini-2.5-pro and Claude Sonnet 4 . |
Dual Dynamic Memory Network for End-to-End Multi-turn Task-oriented Dialog Systems (2020.coling-main)
Copied to clipboard
| Challenge: | Existing task-oriented dialog systems struggle to dynamically model long dialog context for interactions and effectively incorporate knowledge base (KB) information into dialog generation. |
| Approach: | They propose a dual dynamic memory network for multi-turn dialog generation . the model dynamically expands the dialog memory turn by turn and keeps track of dialog history . |
| Outcome: | The proposed model outperforms baseline models on three benchmark datasets on human evaluation and automatic evaluation. |
SeqAR: Jailbreak LLMs with Sequential Auto-Generated Characters (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on the potential misuse of large language models (LLMs) however, the ability to align LLMs with human values is still vulnerable to malicious attacks. |
| Approach: | They propose a red-teaming strategy to enhance LLM safety by using a framework to design jailbreak prompts automatically. |
| Outcome: | The proposed framework achieves attack success rates of 88% and 60% in cold-start scenarios. |
V-GameGym: Visual Game Generation for Code Large Language Models (2026.findings-acl)
Copied to clipboard
Wei Zhang, Jian Yang, Renshuai Tao, Linzheng Chai, Shuyue Guo, Jiajun Wu, Xiaoming Chen, Ganqu Cui, Ning Ding, Xander Xu, HU Wei, Bowen Zhou
| Challenge: | Existing code-related benchmarks focus on single modality rather than visual game development. |
| Approach: | They propose a multimodal benchmark for evaluating code large language models in visual game generation that integrates a clustering-based curation methodology and a pipeline for visual code synthesis. |
| Outcome: | The proposed framework assesses code generation and visual game generation using a sandbox environment. |
Knowledge as A Bridge: Improving Cross-domain Answer Selection with External Knowledge (C18-1)
Copied to clipboard
| Challenge: | Existing approaches to answer selection are limited in domains with limited labeled data. |
| Approach: | They propose a Knowledge-aware Attentive Network framework for cross-domain answer selection that uses the knowledge base as a bridge to enable knowledge transfer from the source domain to the target domain. |
| Outcome: | The proposed model outperforms strong competitors by a noticeable margin in cross-domain answer selection. |
From Behavioral Performance to Internal Competence: Interpreting Vision-Language Models with VLM-Lens (2025.emnlp-demos)
Copied to clipboard
Hala Sheta, Eric Haoran Huang, Shuyu Wu, Ilia Alenabi, Jiajun Hong, Ryker Lin, Ruoxi Ning, Daniel Wei, Jialin Yang, Jiawei Zhou, Ziqiao Ma, Freda Shi
| Challenge: | Existing vision-language models are based on exactmatch based accuracy and its derivations to evaluate performance. |
| Approach: | They propose a toolkit that supports systematic benchmarking, analysis, and interpretation of vision-language models by extracting intermediate outputs from any layer during the forward pass of open-source VLMs. |
| Outcome: | The proposed toolkit supports 16 state-of-the-art base VLMs and their over 30 variants and is extensible to accommodate new models without changing the core logic. |
What Matters in Training a GPT4-Style Language Model with Multimodal Inputs? (2024.naacl-long)
Copied to clipboard
Yan Zeng, Hanbo Zhang, Jiani Zheng, Jiangnan Xia, Guoqiang Wei, Yang Wei, Yuchen Zhang, Tao Kong, Ruihua Song
| Challenge: | Recent advances in GPT-4V have demonstrated remarkable multi-modal capabilities in processing image inputs and following open-ended instructions. |
| Approach: | They propose a plug-and-play technique to enhance multi-modal LLMs . they propose 'lynx' to train multi-modal LLM models . |
| Outcome: | The proposed training strategy improves understanding accuracy and instruction-following proficiency of multi-modal models. |
Adversarial Preference Learning for Robust LLM Alignment (2025.findings-acl)
Copied to clipboard
Yuanfu Wang, Pengyu Wang, Chenyang Xi, Bo Tang, Junyi Zhu, Wenqiang Wei, Chen Chen, Chao Yang, Jingfeng Zhang, Chaochao Lu, Yijun Niu, Keming Mao, Zhiyu Li, Feiyu Xiong, Jie Hu, Mingchuan Yang
| Challenge: | Modern language models rely on Reinforcement Learning from Human Feedback (RLHF) to encourage safe behaviors, but they remain vulnerable to adversarial attacks due to three key limitations: (1) the inefficiency and high cost of human annotation; (2) the vast diversity of potential adversarials; and (3) the risk of feedback bias and reward hacking. |
| Approach: | They propose an iterative adversarial training method that incorporates three key innovations to address these challenges. |
| Outcome: | Experiments on Mistral-7B-Instruct-v0.3 show that the proposed method significantly enhances robustness and reduces harmful outputs from 5.88% to 0.43%. |
ThinkPilot: Steering Reasoning Models via Automated Think-prefixes Optimization (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Reasoning Models (LRMs) are powerful but still suffer from inefficient and off-target reasoning. |
| Approach: | They propose a training-free framework that automatically optimizes Large Reasoning Models' reasoning by generating think-prefixes that evolve driven by a taxonomy of reasoning behaviors. |
| Outcome: | The proposed framework significantly improves accuracy-length trade-off for efficient reasoning, drastically improves safety and improves instruction following. |
TrustAgent: Towards Safe and Trustworthy LLM-based Agents (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing LLMs are primarily used for simple text-related tasks, but LLM-based agents can undertake more complex tasks that require planning and interaction with the physical world and humans. |
| Approach: | They propose an Agent-Constitution-based agent framework with a particular focus on improving the LLM-based agents' safety. |
| Outcome: | The proposed framework can enhance an LLM agent’s safety across multiple domains by identifying and mitigating potential dangers during the planning process. |
Minimal Distillation Schedule for Extreme Language Model Compression (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for teacher assistant-based distillation require multiple trials to find the optimal teacher assistant. |
| Approach: | They propose a method that allows scheduling of an optimal teacher assistant in just one trial . they show that student performance is positively correlated with the scale-performance tradeoff . |
| Outcome: | The proposed method can select the optimal teacher assistant in just one trial . it can be used to compare performance of student and teacher assistants on GLUE benchmarks. |
DataSciBench: An LLM Agent Benchmark for Data Science (2026.findings-acl)
Copied to clipboard
Dan Zhang, Sining Zhoubian, Min Cai, Fengzu Li, Lekang Yang, Wei Wang, Tianjiao Dong, Ziniu Hu, Jie Tang, Yisong Yue
| Challenge: | Existing benchmarks focus on single task, simple evaluation metrics, and readily available ground truth (GT) DataSciBench is built on curated, natural, and challenging prompts with complex evaluation criteria and uncertain GT. |
| Approach: | They propose a benchmark for evaluating Large Language Models in data science that integrates LLM-based self-consistency and human verification to ensure accuracy. |
| Outcome: | The proposed framework outperforms open-source models in all metrics and offers rigorous insights into LLM strengths and weaknesses. |
DeMPT: Decoding-enhanced Multi-phase Prompt Tuning for Making LLMs Be Better Context-aware Translators (2024.emnlp-main)
Copied to clipboard
| Challenge: | Concatenating large language models are adapted to context-aware neural machine translation in a concatenated way . a recent paradigm shift has been witnessed in discourse-related challenges such as zero pronoun translation . |
| Approach: | They propose an alternative adaptation approach to make large language models discriminately model and utilize inter- and intra-sentence contexts. |
| Outcome: | The proposed approach outperforms concatenation mode and improves performance in discourse modeling. |
JTAV: Jointly Learning Social Media Content Representation by Fusing Textual, Acoustic, and Visual Features (C18-1)
Copied to clipboard
| Challenge: | Existing studies on learning social media content focus on single modal or bi-modal learning, but this approach is non-trivial and challenging because content is multi-modal and involves several types of data, including text, audio, and image. |
| Approach: | They propose to combine textual, acoustic, and visual information to learn social media content by fusing them jointly. |
| Outcome: | The proposed model outperforms the state-of-the-art approaches on real-world datasets by a large margin. |
Position Really Matters: Towards a Holistic Approach for Prompt Tuning (2025.findings-naacl)
Copied to clipboard
| Challenge: | Prompt tuning is effective in extracting knowledge from foundation models, but its effectiveness is uncertain. |
| Approach: | They propose a parametric prompt tuning strategy that dynamically determines different factors of prompts based on specific tasks or instances. |
| Outcome: | The proposed approach improves performance across a wide range of tasks including NLP, vision recognition, and vision-language tasks. |
Audio-centric Video Understanding Benchmark without Text Shortcut (2025.emnlp-main)
Copied to clipboard
Yudong Yang, Jimin Zhuang, Guangzhi Sun, Changli Tang, Yixuan Li, Peihan Li, Yifan Jiang, Wei Li, Zejun Ma, Chao Zhang
| Challenge: | Recent advances in multimodal large language models (MLLMs) focus on visual abilities, but audio is essential for video understanding. |
| Approach: | They propose an audio-centric video understanding benchmark to evaluate video comprehension capabilities of multimodal LLMs with a particular focus on auditory information. |
| Outcome: | The proposed video understanding benchmarks evaluate video comprehension capabilities of multimodal models with a particular focus on auditory information. |
Aspect and Sentiment Aware Abstractive Review Summarization (C18-1)
Copied to clipboard
| Challenge: | Abstractive summarization is a task that generates short and concise summaries of user generated reviews. |
| Approach: | They propose an interactive attention mechanism to learn the representations of context and aspect words within reviews, acted as an encoder. |
| Outcome: | The proposed model achieves impressive results compared to other strong competitors on a real-life dataset. |
HAD: HAllucination Detection Language Models Based on a Comprehensive Hallucination Taxonomy (2026.acl-industry)
Copied to clipboard
| Challenge: | relying on large language models for information has raised concerns about reliability and accuracy of outputs. |
| Approach: | They propose a hallucination taxonomy with 11 categories for various NLG tasks and propose HAllucination Detection models which integrate hallucinism detection, span-level identification, and correction into a single inference process. |
| Outcome: | The proposed models outperform baselines on HaluEval, FactCHD, and FaithBench, confirming their robustness and versatility. |
FrontCoder: Scaling Visual Fidelity in Front-End Code Generation (2026.findings-acl)
Copied to clipboard
Jun Feng, Jian Yang, Wei Zhang, Jing Wang, Keyi Chen, Xiaokun Yang, Weicheng Gu, Yihang Lou, Yan Bai, Xianglong Liu
| Challenge: | Existing work on front-end code generation fails to provide visual fidelity and rendering quality for front- end developers. |
| Approach: | They propose a three-stage pipeline to enhance front-end code generation capabilities in LLMs . they use synthetic data, quality-controlled supervised fine-tuning, and reinforcement learning . |
| Outcome: | The proposed model achieves competitive performance with frontier models while maintaining generation efficiency. |
Low-Resource Response Generation with Template Prior (D19-1)
Copied to clipboard
| Challenge: | Existing open domain response generation models are limited to paired data, but are less explored in real-world applications. |
| Approach: | They propose to train a neural response generation model with unpaired data and paired data as prior. |
| Outcome: | The proposed model outperforms state-of-the-art models in both automatic and human evaluation when only a few pairs are available. |
Training Verifier to Assessing Complex Real-World Tool-Use Trajectories (2026.findings-acl)
Copied to clipboard
Linzhuang Sun, Mingyang Chen, Hao Liang, Tianpeng Li, Zhou Yijie, Chenzheng Zhu, Tianyu Guo, Huanyao Zhang, Jingxuan Wei, Bihui Yu, Fan Yang, Wentao Zhang
| Challenge: | Existing methods for training effective AI agents often resort to synthetic data generation. |
| Approach: | They propose a plug-and-play framework for data quality control in tool-use scenarios . they construct a tool-verify dataset and release a benchmark to assess its performance . |
| Outcome: | The proposed framework surpasses Qwen2.5-72B-Instruct on Tool-V-Bench and the previous APIGen-MT dataset. |
MGR: Multi-generator Based Rationalization (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to explain NLP models have two key challenges: spurious correlation and degeneration. |
| Approach: | They propose a rationalization framework using a generator and a predictor to construct a self-explaining NLP model with spurious correlation and degeneration as key challenges. |
| Outcome: | The proposed method improves the F1 score by 20.9% compared to state-of-the-art methods. |
Bridging the Domain Gaps in Context Representations for k-Nearest Neighbor Neural Machine Translation (2023.acl-long)
Copied to clipboard
Zhiwei Cao, Baosong Yang, Huan Lin, Suhang Wu, Xiangpeng Wei, Dayiheng Liu, Jun Xie, Min Zhang, Jinsong Su
| Challenge: | Existing methods to improve k-Nearest neighbor machine translation (kNN-MT) are based on the ability to non-parametrically adapt to new domains. |
| Approach: | They propose a method to boost the datastore retrieval of k-Nearest neighbor machine translation by reconstructing the original datastore. |
| Outcome: | The proposed method boosts the retrieval and translation quality of k-Nearest neighbor machine translation by reconstructing the original datastore. |
LegalAgentBench: Evaluating LLM Agents in Legal Domain (2025.acl-long)
Copied to clipboard
Haitao Li, Junjie Chen, Jingli Yang, Qingyao Ai, Wei Jia, Youfeng Liu, Kai Lin, Yueyue Wu, Guozhi Yuan, Yiran Hu, Wuyue Wang, Yiqun Liu, Minlie Huang
| Challenge: | Existing general-domain benchmarks do not capture complexity of real-world judicial cognition and decision-making. |
| Approach: | They propose a benchmark specifically designed to evaluate LLM Agents in the legal domain. |
| Outcome: | The proposed benchmark includes 17 corpora from real-world legal scenarios and provides 37 tools for interacting with external knowledge. |
HAHE: Hierarchical Attention for Hyper-Relational Knowledge Graphs in Global and Local Level (2023.acl-long)
Copied to clipboard
Haoran Luo, Haihong E, Yuhao Yang, Yikai Guo, Mingzhi Sun, Tianyu Yao, Zichen Tang, Kaiyang Wan, Meina Song, Wei Lin
| Challenge: | Existing research on HKGs rarely models the graphical and sequential structure of HKG, limiting their representation. |
| Approach: | They propose a Hierarchical Attention model for HKG Embedding that includes global-level and local-level attention to model the graphical structure of HKGs. |
| Outcome: | The proposed model achieves state-of-the-art performance on HKG standard datasets and addresses the issue of HKG multi-position prediction for the first time. |
AceMath: Advancing Frontier Math Reasoning with Post-Training and Reward Modeling (2025.findings-acl)
Copied to clipboard
| Challenge: | In this paper, we introduce a suite of math models that excel in solving complex math problems. |
| Approach: | They propose a supervised fine-tuning process that achieves competitive performance across general domains, followed by targeted fine- tuning for the math domain using a carefully curated set of prompts and synthetically generated responses. |
| Outcome: | The proposed model outperforms Qwen2.5-Math-72B-Instruct, GPT-4o and Claude-3.5 Sonnet in the math domain. |
Who Can Withstand Chat-Audio Attacks? An Evaluation Benchmark for Large Audio-Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing research focused on model-specific adversarial methods, but real-world applications demand a more generalizable approach to audio adversarials. |
| Approach: | They propose a Chat-Audio Attacks benchmark to evaluate LALMs' robustness . they propose standard evaluation, GPT-4o-based evaluation and human evaluation . |
| Outcome: | The proposed benchmark aims to explore the robustness of six state-of-the-art LALMs with voice interaction capabilities. |
AwarenessBench: Assessing Cognitive Capabilities of Language Models (2026.acl-long)
Copied to clipboard
Xiaojian Li, Rongwu Xu, Tianyun Zhang, Yue Wang, Shuo Chen, Qiner Lyu, Briana Zhang, Peiran Yang, Kyle Xue Chen, Haoyuan Shi, Yu Wang, Wei Xu
| Challenge: | Language models exhibit increasingly consciousness-like behaviors, requiring a baseline to evaluate their cognitive abilities. |
| Approach: | They propose a benchmark to assess the cognitive abilities of language models (LMs) they compare 18 state-of-the-art LMs to human models in metacognition, self-awareness, social awareness and situational awareness . |
| Outcome: | Evaluating 18 state-of-the-art LMs, they find they consistently surpass baselines . but most models fall short in metacognition and self-awareness, the study finds . |
Multi-Hop Transformer for Document-Level Machine Translation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to document-level neural machine translation (NMT) simply introduce the representations of context sentences without explicitly characterizing the inter-sentence reasoning process. |
| Approach: | They propose a novel multi-hop Transformer which explicitly models the human-like draft-editing and reasoning process by attending to multiple antecedent sentences iteratively. |
| Outcome: | Experiments on four widely used document translation tasks show that the proposed model significantly improves document-level translation performance and tackles discourse phenomena such as coreference error and the problem of polysemy. |
Cooperative Denoising for Distantly Supervised Relation Extraction (C18-1)
Copied to clipboard
| Challenge: | Existing methods for distantly supervised relation extraction suffer from noisy labeling problem, which can severely degrade its performance. |
| Approach: | They propose a framework for distantly supervised relation extraction that leverages text corpus and knowledge graph and a cooperative module involving their mutual learning. |
| Outcome: | The proposed method reduces the noisy labels and achieves substantial improvement over the state-of-the-art methods. |
RiskLab: A Controlled Toolkit for Probing Emergent Risks in LLM-Based Multi-Agent Systems (2026.acl-demo)
Copied to clipboard
Yu Jiang, Wenjie Wang, Yue Huang, Yanbo Wang, Zhenhong Zhou, Xiuying Chen, Yang Liu, Pin-Yu Chen, Wei Wang, Xiangliang Zhang
| Challenge: | Recent advances in large language model (LLM) agents have accelerated deployment of multi-agent systems for complex tasks. |
| Approach: | They propose an open-source toolkit for instantiating, probing, and measuring emergent risks in LLM-based multi-agent systems under controlled conditions. |
| Outcome: | The proposed toolkit is based on a structured topology–environment–protocol–agent–task quintuple enabling reproducible studies of how communication structure, coordination mechanisms, and incentives shape system-level risks. |
Text Style Transfer Back-Translation (2023.acl-long)
Copied to clipboard
Daimeng Wei, Zhanglin Wu, Hengchao Shang, Zongyao Li, Minghan Wang, Jiaxin Guo, Xiaoyu Chen, Zhengzhe Yu, Hao Yang
| Challenge: | Current methods require large amount of bilingual training data, which is challenging and sometimes impossible task. |
| Approach: | They propose a method to modify the style of inputs by modifying the source side of BT data. |
| Outcome: | The proposed method significantly improves translation quality against popular BT benchmarks on high-resource and low-resourced language pairs. |
M3TQA: Massively Multilingual Multitask Table Question Answering (2026.findings-acl)
Copied to clipboard
Daixin Shu, Jian Yang, Zhenhe Wu, Xianjie Wu, Xianfu Cheng, Guan Xiangyuan, Yanghai Wang, Pengfei Wu, Tingyang Yang, Hualei Zhu, Wei Zhang, Ge Zhang, Jiaheng Liu, Zhoujun Li
| Challenge: | Existing multilingual table benchmarks suffer from geolinguistic imbalance - overrepresenting certain languages and lacking sufficient scale for rigorous cross-lingual analysis. |
| Approach: | They propose a framework for massively multilingual table question answering that includes tables expanded to 97 languages from Chinese and English sources. |
| Outcome: | Experiments on state-of-the-art LLMs show that synthetically generated training data significantly boosts performance, especially for low-resource languages. |
GroupRank: A Groupwise Paradigm for Effective and Efficient Passage Reranking with LLMs (2026.findings-acl)
Copied to clipboard
Meixiu Long, Duolin Sun, Dan Yang, Yihan Jiao, Lei Liu, Jiahai Wang, Binbin Hu, Yue Shen, Jie Feng, Zhehao Tan, Junjie Wang, Lianzhen Zhong, Jian Wang, Peng Wei, Jinjie Gu
| Challenge: | Existing rankers excel in lexical-matching scenarios, while they struggle with complex queries requiring deep reasoning. |
| Approach: | They propose a new paradigm that balances flexibility and context awareness to unlock the full potential of groupwise reranking. |
| Outcome: | The proposed approach achieves a state-of-the-art 65.2 NDCG@10 on BRIGHT and surpasses baselines by 2.1 points on R2MED while delivering a 6.4 inference speedup. |
Experiential Co-Learning of Software-Developing Agents (2024.acl-long)
Copied to clipboard
Chen Qian, Yufan Dang, Jiahao Li, Wei Liu, Zihao Xie, YiFei Wang, Weize Chen, Cheng Yang, Xin Cong, Xiaoyin Che, Zhiyuan Liu, Maosong Sun
| Challenge: | Recent advances in large language models (LLMs) have brought significant changes to various domains, especially through autonomous agents. |
| Approach: | They propose a framework that lets agents learn shortcuts from their past tasks and use them for future task execution. |
| Outcome: | The proposed framework enables agents to tackle unseen software-developing tasks more effectively. |
A Novel Paradigm Boosting Translation Capabilities of Large Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies on LLMs focused on supervised fine-tuning but their effectiveness has been limited. |
| Approach: | They propose a paradigm consisting of three stages: Secondary Pre-training using extensive monolingual data, Continual Pre- training with interlinear text format documents, and Leveraging source-language consistent instruction for supervised fine-tuning. |
| Outcome: | The proposed approach surpasses previous work and achieves superior performance compared to models such as NLLB-54B(CITATION) and GPT3.5-text-davinci-003. |
Unsupervised Rewriter for Multi-Sentence Compression (P19-1)
Copied to clipboard
| Challenge: | Multi-sentence compression aims to generate a grammatical but reduced compression from multiple input sentences while retaining key information. |
| Approach: | They propose a neural rewriter for multi-sentence compression that does not need any parallel corpus. |
| Outcome: | Empirical studies show that the proposed approach achieves comparable results upon automatic evaluation and improves the grammaticality of compression based on human evaluation. |
An Empirical Study of Pre-trained Transformers for Arabic Information Extraction (2020.emnlp-main)
Copied to clipboard
| Challenge: | Multilingual pre-trained Transformers have been shown to enable effective cross-lingual zero-shot transfer, but their performance on Arabic information extraction tasks is not well studied. |
| Approach: | They pre-train a bilingual BERT that is designed specifically for Arabic NLP and English-to-Arabic zero-shot transfer learning. |
| Outcome: | The pre-trained model significantly outperforms mBERT, XLM-RoBERTa, and AraBERT in both the supervised and zero-shot transfer settings. |
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation (2020.emnlp-main)
Copied to clipboard
Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong, Linjun Shou, Daxin Jiang, Guihong Cao, Xiaodong Fan, Ruofei Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Ying Qiao, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Daniel Campos, Rangan Majumder, Ming Zhou
| Challenge: | XGLUE provides a benchmark dataset to train large-scale cross-lingual pre-trained models . XCLUE provides 11 diversified tasks that cover both understanding and generation scenarios . |
| Approach: | They introduce a new benchmark dataset to train large-scale cross-lingual pre-trained models using multilingual and bilingual corpora. |
| Outcome: | The proposed dataset is labeled in English and includes only natural language understanding tasks. |
Improving Neural Machine Translation with Conditional Sequence Generative Adversarial Nets (N18-1)
Copied to clipboard
| Challenge: | Experimental results show that the proposed model consistently outperforms the traditional RNNSearch and the newly emerged state-of-the-art Transformer on English-German and Chinese-English translation tasks. |
| Approach: | They propose an approach for applying GANs to NMT by building a conditional sequence generative adversarial net with two adversarials. |
| Outcome: | The proposed model outperforms the existing RNNSearch and Transformer on English-German and Chinese-English translation tasks. |
Tell2Design: A Dataset for Language-Guided Floor Plan Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Recent studies have demonstrated impressive results in generating high-fidelity artistic images. |
| Approach: | They propose a Sequence-to-Sequence model that can serve as a strong baseline for future research. |
| Outcome: | The proposed model can be used as a baseline for future research and human evaluations are conducted on the generated samples and provided an analysis of human performance. |
Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data (2024.findings-acl)
Copied to clipboard
Yanda Li, Chi Zhang, Gang Yu, Wanqi Yang, Zhibin Wang, Bin Fu, Guosheng Lin, Chunhua Shen, Ling Chen, Yunchao Wei
| Challenge: | OpenAI's GPT-4 has demonstrated remarkable multimodal capabilities, but specific mechanics of GPT4 remain unknown. |
| Approach: | They propose a data collection methodology that synchronously synthesizes images and dialogues for visual instruction tuning. |
| Outcome: | The proposed method improves on ten commonly assessed models and provides greater flexibility compared to existing methods. |
Plug-and-Play Data Module for Code RL: Adaptive Ambiguity Replay (2026.findings-acl)
Copied to clipboard
Jianqing Zhang, Wei Xia, Zhezheng Hao, Hong Wang, Hande Dong, Qiang Lin, Yang Liu, Jian Cao, Qiang Yang
| Challenge: | Existing approaches to reinforcement learning (RL) rely on static, in-epoch metrics that overlook training dynamics, often introducing low-utility or outdated data. |
| Approach: | They propose a plug-and-play module that prioritizes cross-epoch ambiguous samples to neutralize the noise from stale experiences. |
| Outcome: | Extensive experiments on nine LLMs show that Adaptive Ambiguity Replay outperforms state-of-the-art baselines on real-world code editing tasks. |
Enhancing Semantic Consistency of Large Language Models through Model Editing: An Interpretability-Oriented Approach (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models generate inconsistent and sometimes contradictory outputs when presented with a prompt that has equivalent semantics but is expressed differently from the original prompt. |
| Approach: | They propose to refine a Large Language Model (LLM) with prompt-output pairs with equivalent semantics to achieve semantic consistency. |
| Outcome: | The proposed method improves the semantic consistency and task performance of LLMs. |
MMNMT: Modularizing Multilingual Neural Machine Translation with Flexibly Assembled MoE and Dense Blocks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Mixture-of-Experts (MoE) based sparse architectures are prone to overfitting on low-resource language translation. |
| Approach: | They propose a modularized MNMT framework that flexibly assembles dense and MoE-based sparse modules to achieve the best of both worlds. |
| Outcome: | The proposed framework outperforms existing models on low-resource language translation and zero-shot translation on benchmark datasets. |
Contextual Modeling for Document-level ASR Error Correction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing work on document-level ASR error correction ignores contextual information . however, there are limited studies on incorporating contextual information into AEC . |
| Approach: | They propose a context-aware method that retrieves contextual information from a datastore . they use two English and two Chinese datasets to model document-level AEC . |
| Outcome: | The proposed model can utilize contextual information to improve document-level AEC . the data store containing contextual information provides even better results . |
A Survey on Detection of LLMs-Generated Content (2024.findings-emnlp)
Copied to clipboard
Xianjun Yang, Liangming Pan, Xuandong Zhao, Haifeng Chen, Linda Petzold, William Yang Wang, Wei Cheng
| Challenge: | Recent advances in large language models have led to an increase in synthetic content generation . the ability to detect LLMs-generated content has become of paramount importance . |
| Approach: | They propose to provide a detailed overview of existing detection strategies and benchmarks, scrutinizing their differences and advocating for more adaptable and robust models to enhance detection accuracy. |
| Outcome: | The proposed model will be able to detect human-written content in real time. |
Little Giants: Synthesizing High-Quality Embedding Data at Scale (2025.naacl-long)
Copied to clipboard
| Challenge: | Synthetic data generation is an increasingly popular way of training models without the need for large, manually labeled datasets. |
| Approach: | They propose a framework that aligns open-source small models to efficiently generate large-scale embedding data. |
| Outcome: | The proposed framework outperforms state-of-the-art embedding models by using only 1/10 of the GPT API calls. |
STORYTELLER: An Enhanced Plot-Planning Framework for Coherent and Cohesive Story Generation (2025.findings-acl)
Copied to clipboard
Jiaming Li, Yukun Chen, Ziqiang Liu, Minghuan Tan, Lei Zhang, Yunshui Li, Run Luo, Longze Chen, Jing Luo, Ahmadreza Argha, Hamid Alinejad-Rokny, Wei Zhou, Min Yang
| Challenge: | Existing methods for storytelling lack coherence and consistency, compromising the overall storytelling experience. |
| Approach: | They propose a novel approach that improves the coherence and consistency of automatically generated stories by managing plot nodes and enabling dynamic interactions between different parts of the story. |
| Outcome: | The proposed approach outperforms existing methods in 84.33% of the trials. |
SoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training (2024.acl-long)
Copied to clipboard
| Challenge: | Current methods focus on detecting and removing duplicates, which risks the loss of valuable information and neglects the varying degrees of duplication. |
| Approach: | They propose a method that maintains dataset integrity while selectively reducing the sampling weight of data with high commonness. |
| Outcome: | The proposed method significantly improves training efficiency on deduplicated datasets and improves downstream accuracy by 1.77%. |
Qwen2.5-xCoder: Multi-Agent Collaboration for Multilingual Code Instruction Tuning (2025.acl-long)
Copied to clipboard
Jian Yang, Wei Zhang, Yibo Miao, Shanghaoran Quan, Zhenhe Wu, Qiyao Peng, Liqun Yang, Tianyu Liu, Zeyu Cui, Binyuan Hui, Junyang Lin
| Challenge: | Existing methods to train code LLMs view each programming language in isolation . experimental results show that Qwen2.5-xCoder can bridge the gap between different programming languages . |
| Approach: | They propose a framework that allows agents to collaborate to enhance multilingual instruction tuning for code LLMs. |
| Outcome: | Experimental results show that Qwen2.5-xCoder can transfer knowledge efficiently and effectively between languages. |
Rotation Control Unlearning: Quantifying and Controlling Continuous Unlearning for LLM with The Cognitive Rotation Space (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to remove undesirable data from Large Language Models suffer from cumulative catastrophic utility loss under continuous unlearning requests. |
| Approach: | They propose a method that leverages the rotational salience weight of RCU to quantify and control the unlearning degree in the continuous unlearning process. |
| Outcome: | The proposed method achieves SOTA performance without a retained dataset. |
On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation (2020.acl-main)
Copied to clipboard
| Challenge: | a standard evaluation setup for supervised machine learning tasks does not hold for natural language generation tasks. |
| Approach: | They propose to use reference-free machine translation evaluation to compare source texts to system translations to find key limitations. |
| Outcome: | The proposed metrics perform poorly as semantic encoders for reference-free machine translation evaluation. |
Improving Text Embeddings with Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for obtaining text embeddings require complex training pipelines . authors leverage proprietary LLMs to generate diverse synthetic data for text embeds based on 93 languages . |
| Approach: | They propose a method for obtaining high-quality text embeddings using only synthetic data and less than 1k training steps. |
| Outcome: | The proposed method achieves strong performance on competitive text embedding benchmarks without using any labeled data. |
MUSIED: A Benchmark for Event Detection from Multi-Source Heterogeneous Informal Texts (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent efforts to classify unstructured texts into specific types have been limited in practical scenarios. |
| Approach: | They propose to use Chinese text conversations and phone conversations to expand event detection to the scenarios involving informal and heterogeneous texts. |
| Outcome: | The proposed dataset is based on user reviews, text conversations, and phone conversations in a leading e-commerce platform for food service. |
Modeling LLM Unlearning as an Asymmetric Two-Task Learning Problem (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are inherently dual-use and can be leveraged for both beneficial and harmful purposes. |
| Approach: | They propose a retention-prioritized gradient synthesis framework that decouples task-specific gradient extraction from conflict-aware combination. |
| Outcome: | The proposed method achieves tighter alignment on WMDP Bio and RWKU benchmarks. |
A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions (2026.acl-long)
Copied to clipboard
Zhiyin Yu, Yuchen Mou, Juncheng Yan, Junyu Luo, Chunchun Chen, Xing Wei, Yunhui Liu, Hongru Sun, Yuxing Zhang, Jun Xu, Yatao Bian, Ming Zhang, Wei Ye, Tieke He, Jie Yang, Guanjie Zheng, Zhonghai Wu, Bo Zhang, Lei Bai, Xiao Luo
| Challenge: | Existing research on reinforcement learning for LLMs under data scarcity has not been unified. |
| Approach: | They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric. |
| Outcome: | The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area. |
Two Intermediate Translations Are Better Than One: Fine-tuning LLMs for Document-level Translation Refinement (2025.acl-long)
Copied to clipboard
| Challenge: | Recent research has shown that large language models (LLMs) can enhance translation quality through self-refinement. |
| Approach: | They propose to extend translation refinement from sentence-level to document-level by using document-to-document (Doc2Doc) translations. |
| Outcome: | The proposed method improves translation quality across ten translation tasks with LLaMA-3-8B-Instruct and Mistral-Nemo-Instru. |
Decoding Susceptibility: Modeling Misbelief to Misinformation Through a Computational Approach (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on susceptibility to misinformation rely on self-reported beliefs, which can be subject to bias, expensive to collect, and challenging to scale for downstream applications. |
| Approach: | They propose a computational approach to efficiently model users’ latent susceptibility levels by using demographic factors and political ideology as inputs. |
| Outcome: | The proposed model shows that political leanings and other psychological factors exhibit varying degrees of association with susceptibility to COVID-19 misinformation. |
Can Large Language Models Identify Implicit Suicidal Ideation? An Empirical Evaluation (2025.findings-emnlp)
Copied to clipboard
Tong Li, Shu Yang, Junchao Wu, Jiyao Wei, Lijie Hu, Mengdi Li, Derek F. Wong, Joshua R. Oltmanns, Di Wang
| Challenge: | Existing data on suicidal ideation in private conversations are limited . a new dataset of 1,200 test cases is presented to address this gap . |
| Approach: | They propose a dataset of 1,200 test cases simulating implicit suicidal ideation in private contexts. |
| Outcome: | The proposed dataset includes 1,200 test cases simulating implicit suicidal ideation in dialogue scenarios. |
PersonaAgent: Bridging Memory and Action for Personalized LLM Agents (2026.findings-acl)
Copied to clipboard
Weizhi Zhang, Xinyang Zhang, Chenwei Zhang, Liangwei Yang, Jingbo Shang, Zhepei Wei, Henry Peng Zou, Zijie Huang, Zhengyang Wang, Yifan Gao, Xiaoman Pan, Lian Xiong, Jingguo Liu, Philip S. Yu, Xian Li
| Challenge: | Existing Large Language Model (LLM) enabled agents lack flexibility to respond to users’ varying needs and preferences. |
| Approach: | They propose a test-time user-preference alignment strategy that optimizes the persona prompt, ensuring real-time preference alignment through textual loss feedback between simulated and ground-truth responses. |
| Outcome: | The proposed framework outperforms baseline methods in real-time and in real applications. |
Lightweight LLM Agent Memory with Small Language Models (2026.acl-long)
Copied to clipboard
Jiaquan Zhang, Chaoning Zhang, Shuxu Chen, Zhenzhen Huang, Pengcheng Zheng, Zhicheng Wang, Ping Guo, Fan Mo, Sung-Ho Bae, Jie Zou, Jiwei Wei, Yang Yang
| Challenge: | Existing external memory systems for LLMs have low online overhead but are unstable in accumulating latency over long interactions. |
| Approach: | They propose a lightweight memory system for better agent memory driven by Small Language Models . lightmem modularizes memory retrieval, writing, and long-term consolidation . they show consistent gains across model scales and high efficiency . |
| Outcome: | The proposed system improves agent memory but has low latency and low online overhead . it separates online processing from offline consolidation to enable efficient memory invocation . the proposed system achieves an average F1 improvement of 2.5 over A-MEM on LoCoMo . |
Soft-Prompting with Graph-of-Thought for Multi-modal Representation Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to learn multi-modal tasks are based on chain-of-thought . however, human thought processes are non-linear and employ dynamic adjustment and updating mechanisms. |
| Approach: | They propose a chain-of-thought technique that adjusts the length of the chain to improve the performance of generated prompts. |
| Outcome: | The proposed model improves multi-modal representation learning in visual, visual, and audio-visual tasks and also has good domain generalization performance due to better reasoning. |
MAGE: Machine-generated Text Detection in the Wild (2024.acl-long)
Copied to clipboard
Yafu Li, Qintong Li, Leyang Cui, Wei Bi, Zhilin Wang, Longyue Wang, Linyi Yang, Shuming Shi, Yue Zhang
| Challenge: | Existing research has focused on evaluating detection methods for specific domains or language models. |
| Approach: | They build a testbed to detect texts from diverse human writings and LLMs using different detection methods. |
| Outcome: | Empirical results show that the top performing detector can identify 84.12% out-of-domain texts generated by a new LLM, indicating the feasibility for application scenarios. |
A Span-based Linearization for Constituent Trees (2020.acl-main)
Copied to clipboard
| Challenge: | Existing local models have been used to parse constituent trees, but local models can be faster and more efficient. |
| Approach: | They propose a linearization of a constituent tree and a locally normalized model which computes the normalizer on all spans ending with that split point. |
| Outcome: | The proposed model outperforms existing local models and achieves competitive results with global models. |
E-ViC: Reasoning Beyond Text via Embodied Visual Chain for Spatial Intelligence (2026.acl-long)
Copied to clipboard
Junbo Qi, Yi Zhang, Hanchu Ni, Che Liu, Zhimin Yao, Ruilin Yang, Xiancong Ren, Liangjian Wen, Wei Ge, Yuya Ieiri, Osamu Yoshie, Yong Dai, Xiaozhu Ju
| Challenge: | Existing Vision-Language Models (VLMs) lack spatial reasoning, despite text-based CoTs . e-ViC reframes spatial intelligence as a verifiable, tool-using capability, argues a new study. |
| Approach: | They propose a framework that moves reasoning beyond text into the visual domain . they ground reasoning in pixel-level interactions to enable human-like "look-and-confirm" strategies . |
| Outcome: | The proposed framework outperforms existing Vision-Language Models with an average gain of 10.1%. |
Incorporating Argument-Level Interactions for Persuasion Comments Evaluation using Co-attention Model (C18-1)
Copied to clipboard
| Challenge: | Existing research explores different text features of reply comments on word level and ignores interactions between participants. |
| Approach: | They propose a co-attention mechanism based neural network to capture interactions between participants on argument level to better model dialogical argumentation. |
| Outcome: | The proposed model outperforms state-of-the-art methods on a publicly available dataset showing that it extracts interactive argument pairs from the original post and the reply. |
Our Neural Machine Translation Systems for WAT 2019 (D19-52)
Copied to clipboard
| Challenge: | In the last five years, statistical machine translation is gradually fading out in favor of neural machine translation. |
| Approach: | They describe a novel Neural Machine Translation (NMT) system for the WAT 2019 translation tasks they focus on. |
| Outcome: | The proposed system improves translation accuracy while replacing absolute position representations with relative positions. |
Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality? (2022.emnlp-main)
Copied to clipboard
| Challenge: | Neural machine translation models are often criticized for failures that happen without competency awareness. |
| Approach: | They propose a method that extends conventional NMT with a self-estimator to translate a source sentence and estimate its competency. |
| Outcome: | The proposed method performs on translation tasks intact and on quality estimation tasks better than existing methods. |
DenseSSM: State Space Models with Dense Hidden Connection for Efficient Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) face excessive computational and memory requirements due to the commonly used Transformer architecture. |
| Approach: | They propose a method to enhance the flow of hidden information between layers in large language models by selectively integrating shallow-layer hidden states into deeper layers. |
| Outcome: | The proposed method maintains parallelizability and inference efficiency of SSMs while significantly boosting performance on public benchmarks. |
Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Models (2024.findings-acl)
Copied to clipboard
Ran Xu, Hejie Cui, Yue Yu, Xuan Kan, Wenqi Shi, Yuchen Zhuang, May Dongmei Wang, Wei Jin, Joyce Ho, Carl Yang
| Challenge: | Clinical natural language processing (NLP) is a subfield that requires the extraction, analysis, and interpretation of unstructured clinical text. |
| Approach: | They propose a model which infuses knowledge into clinical text generation with LLMs for clinical NLP tasks. |
| Outcome: | The proposed model improves performance across 8 clinical NLP tasks and 18 datasets by 7.7%-8.7% on average. |
Render-of-Thought: Rendering Textual Chain-of-Thought as Images for Visual Latent Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Recent work on Chain-of-Thought prompting imposes substantial computational overhead . lack of supervision obscures the analyzability of the latent reasoning chain. |
| Approach: | They propose a framework to render latent reasoning chain into images, making latent rationale explicit and traceable. |
| Outcome: | The proposed framework achieves 3-4 token compression and substantial inference acceleration compared to explicit CoT prompting. |
TRANS-ZERO: Self-Play Incentivizes Large Language Models for Multilingual Translation Without Parallel Data (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have reshaped machine translation, but multilingual MT still relies heavily on parallel data for supervised fine-tuning. |
| Approach: | They propose a framework that leverages only monolingual data and the intrinsic multilingual knowledge of Large Language Models (LLMs). |
| Outcome: | The proposed framework matches models trained on large-scale parallel data and excels in non-English translation directions. |
Enhancing Large Language Models for Document-Level Translation Post-Editing Using Monolingual Data (2025.coling-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have excellent performance in many tasks, but they still face challenges in document translation. |
| Approach: | They propose a method that leverages the capabilities of Large Language Models to optimize document translation using only monolingual data. |
| Outcome: | The proposed method improves translation quality and improves contextual consistency in document translation using only monolingual data. |
Evaluating the Expressive Appropriateness of Speech in Rich Contexts (2026.acl-long)
Copied to clipboard
Tianrui Wang, Ziyang Ma, Yizhou Peng, Haoyu Wang, Zhikang Niu, Zikang Huang, Yihao Wu, Yi-Wen Chao, Yu Jiang, Yuheng Lu, Guanrou Yang, Xuanchen Li, Hexin Liu, Chunyu Qiang, Cheng Gong, Yifan Yang, Tianchi Liu, Junyu Wang, Nana Hou, Meng Ge, Fuming You, Yang Wei, Zhongqian Sun, Hu Haifeng, Xiaobao Wang, Eng Siong Chng, Xie Chen, Longbiao Wang, Jianwu Dang
| Challenge: | Existing methods for evaluating expressive speech focus on word accuracy, naturalness, signal quality, or emotional intensity at the utterance level. |
| Approach: | They propose a framework for Evaluating Expressive Appropriateness in speech that assesses whether a speech sample aligns with the underlying communicative intent implied by its discourse-level narrative context. |
| Outcome: | The proposed framework outperforms existing speech evaluation and analysis systems on a human-annotated test set. |
Transferable End-to-End Aspect-based Sentiment Analysis with Selective Adversarial Learning (D19-1)
Copied to clipboard
| Challenge: | Existing methods to extract aspects and sentiments are limited due to lack of annotated sequence data. |
| Approach: | They propose a Selective Adversarial Learning method to align latent correlation vectors . they propose tagging a set of aspect boundary tags and sentiment tags to create a joint label space . |
| Outcome: | The proposed method can learn weights for words to achieve fine-grained adaptation. |
Orthogonal Representation Editing: Decoupling Semantic Entanglement in Batch Knowledge Editing of LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge editing methods suffer from performance degradation in batch knowledge editing. |
| Approach: | They propose an orthogonal representation editing method which decouples semantic entanglement from edit vectors and enforcing orthogonals on edit vector. |
| Outcome: | The proposed method outperforms existing methods and achieves superior performance in cross-lingual knowledge editing scenarios. |
SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval (2023.acl-long)
Copied to clipboard
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang, Rangan Majumder, Furu Wei
| Challenge: | SimLM uses a simple bottleneck architecture that learns to compress the passage information into a dense vector through self-supervised pre-training. |
| Approach: | They propose a simple yet effective pre-training method for dense passage retrieval that learns to compress the passage information into a dense vector through self-supervised pre-tuning. |
| Outcome: | The proposed method outperforms multi-vector approaches on large-scale passage retrieval datasets and shows significant improvements over baselines. |
End-to-End Open-Domain Question Answering with BERTserini (N19-4)
Copied to clipboard
| Challenge: | a new open-domain question answering system integrates best practices from IR with a BERT-based reader to identify answers from a large corpus of Wikipedia articles. |
| Approach: | They propose an end-to-end question answering system that integrates BERT with an IR reader. |
| Outcome: | The proposed system improves on a standard benchmark test collection. |
Semi-Supervised Disfluency Detection (C18-1)
Copied to clipboard
| Challenge: | Detecting disfluency can be difficult because of the flexible nature of reparandum structure and the lack of a nested structure. |
| Approach: | They propose a semi-supervised approach which extracts hidden features from self-attention without any Recurrent Neural Network (RNN) or Convolutional Neural Net (CNN). |
| Outcome: | The proposed approach improves over baselines by using unlabelled data . identifying and removing non-fluent factors would help to improve spontaneous speech quality . |
H-LegalKI: A Hierarchical Legal Knowledge Integration Framework for Legal Community Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Legal question answering (LQA) aims to bridge the gap between limited availability of legal professionals and the extensive volume of legal issues. |
| Approach: | They propose a legal knowledge retriever and a hierarchical legal knowledge integration framework to address multiple user-specific circumstances. |
| Outcome: | The proposed framework outperforms baselines on the legal community question-answering dataset. |
OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models (2025.acl-long)
Copied to clipboard
Siming Huang, Tianhao Cheng, Jason Klein Liu, Weidi Xu, Jiaran Hao, Liuyihan Song, Yang Xu, Jian Yang, Jiaheng Liu, Chenchen Zhang, Linzheng Chai, Ruifeng Yuan, Xianzhen Luo, Qiufeng Wang, YuanTao Fan, Qingfu Zhu, Zhaoxiang Zhang, Yang Gao, Jie Fu, Qian Liu, Houyi Li, Ge Zhang, Yuan Qi, Xu Yinghui, Wei Chu, Zili Wang
| Challenge: | Code LLMs lack reproducible data pipelines and training protocols for reproducible advancements in code intelligence. |
| Approach: | They propose a top-tier code LLM that releases model weights and inference code . reproducible data pipelines, rigorous experimental ablation results and training protocols are included . |
| Outcome: | The proposed model achieves comparable performance to leading models and serves as an "open cookbook" reproducible training data, rigorous experimental ablation results, and detailed training protocols are also included in the model. |
Chinese MentalBERT: Domain-Adaptive Pre-training on Social Media for Chinese Mental Health Text Analysis (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing models for language analysis are inadequate for specialized domains like psychology. |
| Approach: | They have enriched a Chinese social media database with psychological lexicons to enhance its applicability to psychological text analysis. |
| Outcome: | The proposed model performed better on six public datasets and provided relevant predictions given the masked sentences. |
LoRASC: Expressive and Generalizable Low-rank Adaptation for Large Models via Slow Cascaded Learning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing low-rank adaptations have limited expressiveness, a tendency to overfit, and sensitivity to hyperparameter settings. |
| Approach: | They propose a technique to enhance LoRA’s expressiveness and generalization capabilities while preserving its training efficiency. |
| Outcome: | The proposed method outperforms baselines, mitigates overfitting, enhances model stability, and improves OOD robustness. |
Revisiting Weak-to-Strong Generalization in Theory and Practice: Reverse KL vs. Forward KL (2025.findings-acl)
Copied to clipboard
| Challenge: | Weak-to-strong generalization is a promising approach to guide stronger systems, but its effectiveness is constrained by the inherent imperfections of weak model supervision. |
| Approach: | They propose a theoretically grounded approach that replaces forward KL divergence with reverse KL, which prioritizes high-confidence predictions. |
| Outcome: | The proposed approach replaces forward KL divergence with reverse KL, reducing the influence of unreliable weak supervision. |
GA-S3: Comprehensive Social Network Simulation with Group Agents (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing social network simulations focus on discrete events or system dynamics instead of elucidating underlying mechanisms or causal relationships. |
| Approach: | They propose a Social network simulation system that leverages newly designed Group Agents to make intelligent decisions regarding various online events. |
| Outcome: | The proposed system can make intelligent decisions regarding online events at a manageable cost. |
Enhancing LLM Language Adaption through Cross-lingual In-Context Pre-training (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for enhancing cross-lingual transfer are limited by parallel resources and lack linguistic and domain coverage. |
| Approach: | They propose a cross-lingual in-context pre-training approach that leverages semantically related bilingual Wikipedia documents to enhance cross-linguistic transfer. |
| Outcome: | The proposed approach improves multilingual performance on three models across six target languages. |
Large Language Models Can Be Contextual Privacy Protection Learners (2024.emnlp-main)
Copied to clipboard
Yijia Xiao, Yiqiao Jin, Yushi Bai, Yue Wu, Xianjun Yang, Xiao Luo, Wenchao Yu, Xujiang Zhao, Yanchi Liu, Quanquan Gu, Haifeng Chen, Wei Wang, Wei Cheng
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable linguistic comprehension and generation capability, but when applied to specialized industries, they face challenges such as hallucination, insufficient domain knowledge, and failing to incorporate the latest domain knowledge. |
| Approach: | They propose a paradigm for fine-tuning LLMs that effectively injects domain-specific knowledge while safeguarding inference-time data privacy. |
| Outcome: | The proposed model protects private data while enhancing the model's knowledge. |
Multiplex Graph Neural Network for Extractive Text Summarization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for extractive text summarization do not consider multiple types of inter-sentential relationships, nor model intra-sententential relationships. |
| Approach: | They propose a novel method to combine different types of relationships among sentences and words to model sentence embedding. |
| Outcome: | The proposed model is compared with existing methods on CNN/DailyMail benchmark dataset to demonstrate its effectiveness. |
Evaluating Token-Level and Passage-Level Dense Retrieval Models for Math Information Retrieval (2022.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study has shown that dense retrieval methods are suboptimal for capturing contextual similarities in complex data. |
| Approach: | They propose to combine a structure search method and efficient bi-encoder dense retrieval models to capture contextual similarities. |
| Outcome: | The proposed model improves on token-level and passage-level dense retrieval tasks. |
CIRAG: Construction–Integration Retrieval and Adaptive Generation for Multi-hop Question Answering (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for iterative retrieval-augmented generation (iRAG) suffer from greedy single-path expansion and granularity–demand mismatch . |
| Approach: | They propose a model that constructs candidate triples and history-conditionally integrates them to distill core triples to generate the next-hop query. |
| Outcome: | The proposed model mitigates the greedy single-path expansion and granularity–demand mismatch by preserving multiple plausible evidence chains. |
Bridging the Gap between Pre-Training and Fine-Tuning for Commonsense Generation (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods focusing on this task usually concatenate the concatened concepts words as the inputs of a pre-trained language model (PLM) however, in pre-training, the input is often corrupted sentences with correct word order. |
| Approach: | They propose a two-stage framework to improve the ability of pre-trained language models to deal with masked sentences with incorrect word order and a special token to make the input distribution more similar to the one used in pre-training. |
| Outcome: | The proposed method is able to generate a sentence containing all given concepts and correctly describe the relations between concepts. |
Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented Dialog (2023.acl-long)
Copied to clipboard
| Challenge: | Existing systems blend knowledge retrieval with response generation and optimize them with direct supervision from reference responses. |
| Approach: | They propose a multi-grained knowledge retrieval system that decouples knowledge retrievals from response generation and introduces an entity selector and an attribute selector to acquire multigrained information from the knowledge base. |
| Outcome: | The proposed system performs better on small and large knowledge bases. |
T2R-BENCH: A Benchmark for Real World Table-to-Report Task (2025.emnlp-main)
Copied to clipboard
Jie Zhang, Changzai Pan, Sishi Xiong, Kaiwen Wei, Yu Zhao, Xiangyu Li, Jiaxin Peng, Xiaoyan Gu, Jian Yang, Wenhan Chang, Zhenhe Wu, Jiang Zhong, Shuangyong Song, Xuelong Li
| Challenge: | Existing table benchmarks lack the capacity to adequately assess the practical application of table reasoning in industrial applications. |
| Approach: | They propose a bilingual table-to-report task and a table-based benchmark to assess the quality of table reasoning. |
| Outcome: | The proposed task is based on a bilingual benchmark with 457 industrial tables and evaluation criteria to measure the quality of report generation. |
Language-agnostic BERT Sentence Embedding (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for learning bilingual sentence embeddings are not well explored. |
| Approach: | They propose to combine best methods for learning multilingual sentence embeddings with pre-trained models to achieve 83.7% bi-text retrieval accuracy over 112 languages on Tatoeba. |
| Outcome: | The proposed model achieves 83.7% bi-text retrieval accuracy over 112 languages on Tatoeba, above the 65.5% achieved by LASER. |
Multiview Identifiers Enhanced Generative Retrieval (2023.acl-long)
Copied to clipboard
| Challenge: | Current approaches use a numeric ID or text piece as the identifier, but these identifieres cannot cover a passage’s content well. |
| Approach: | They propose a new type of identifier that is generated based on the content of a passage and could integrate contextualized information that text pieces lack. |
| Outcome: | The proposed approach performs the best in generative retrieval on three public datasets. |
Beyond Static Personas: Situational Personality Steering for Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing personalization methods rely on static personality modeling to achieve optimal performance. |
| Approach: | They propose a training-free framework for advanced situational personality steering that incorporates situation-dependent behavior patterns within LLM personalities through analysis of persona neurons. |
| Outcome: | The proposed framework surpasses baselines on PersonalityBench and SPBench, demonstrating generalization and robustness to complex, unseen situations and different models architecture. |
Combining the Best of Both Worlds: A Method for Hybrid NMT and LLM Translation (2025.findings-acl)
Copied to clipboard
Zhanglin Wu, Daimeng Wei, Xiaoyu Chen, Hengchao Shang, Jiaxin Guo, Zongyao Li, Yuanchang Luo, Jinlong Yang, Zhiqiang Rao, Hao Yang
| Challenge: | Large language models have advantages over neural machine translation systems, but they suffer from high computational costs and significant latency. |
| Approach: | They propose a scheduling policy that optimizes translation result while ensuring fast speed and as little LLM usage as possible. |
| Outcome: | The proposed model achieves optimal translation performance with less LLM usage on multilingual test sets. |
Following the Autoregressive Nature of LLM Embeddings via Compression and Alignment (2025.emnlp-main)
Copied to clipboard
Jingcheng Deng, Zhongtao Jiang, Liang Pang, Zihao Wei, Liwei Chen, Kun Xu, Yang Song, Huawei Shen, Xueqi Cheng
| Challenge: | Experimental results demonstrate that our method significantly outperforms traditional contrastive learning approaches when using the same amount of data. |
| Approach: | They propose a new contrastive learning method built on embedding conditional probability distributions that integrates two tasks: information compression and conditional distribution alignment. |
| Outcome: | The proposed method outperforms traditional contrastive learning approaches and achieves comparable performance to state-of-the-art models when using the same amount of data. |
GROVE: A Retrieval-augmented Complex Story Generation Framework with A Forest of Evidence (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for generating stories with complex plots rely on detailed prompts, which inadvertently limit the creative potential of the generated stories. |
| Approach: | They propose a retrieval-auGmented stoRy generation framework with a fOrest of eVidEnce to enhance stories’ complexity. |
| Outcome: | The proposed framework enables generating more diverse plotlines from human-written stories. |
PreQuant: A Task-agnostic Quantization Approach for Pre-trained Language Models (2023.findings-acl)
Copied to clipboard
Zhuocheng Gong, Jiahao Liu, Qifan Wang, Yang Yang, Jingang Wang, Wei Wu, Yunsen Xian, Dongyan Zhao, Rui Yan
| Challenge: | Quantization is a viable solution for pre-trained language models, but most existing methods are task-specific and require customized training and quantization with a large number of trainable parameters. |
| Approach: | They propose a "quantize before fine-tuning" framework that allows for quantization with a large number of trainable parameters on each individual task. |
| Outcome: | The proposed framework is compatible with quantization-aware training and post-training quantization and corrects quantization errors. |
mABC: Multi-Agent Blockchain-inspired Collaboration for Root Cause Analysis in Micro-Services Architecture (2024.findings-emnlp)
Copied to clipboard
Wei Zhang, Hongcheng Guo, Jian Yang, Zhoujin Tian, Yi Zhang, Yan Chaoran, Zhoujun Li, Tongliang Li, Xu Shi, Liangfan Zheng, Bo Zhang
| Challenge: | Root cause analysis (RCA) in Micro-services architectures with escalating complexity is challenging due to fault propagation and circular dependencies among nodes. |
| Approach: | They propose a framework where multiple agents follow Agent Workflow and collaborate in blockchain-inspired voting to ensure the reliability of root cause analysis. |
| Outcome: | The proposed framework reduces the number of steps and standardizes task processing through Agent Workflow. |
Chain-of-Dictionary Prompting Elicits Translation in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown surprisingly good performance in multilingual neural machine translation . yet, they struggle with translating low-resource languages. |
| Approach: | They propose a framework that chained multilingual dictionaries to elicit translation abilities for LLMs . they show that CoD can significantly improve LLM translation by evoking more information . |
| Outcome: | The proposed framework improves on ChatGPT and InstructGPT's translation abilities. |
VecInfer: Efficient LLM Inference with Low-Bit KV Cache via Outlier-Suppressed Vector Quantization (2026.acl-long)
Copied to clipboard
| Challenge: | Existing quantization methods for large language models suffer performance degradation at ultra-low bit-widths due to key cache outliers. |
| Approach: | They propose a vector quantization method that suppresses outliers in the key cache and reduces memory access overhead. |
| Outcome: | The proposed method outperforms baseline quantization methods across long-context understanding and mathematical reasoning tasks while minimizing memory access overhead. |
WebCoderBench: Benchmarking Web Application Generation with Comprehensive and Interpretable Evaluation Metrics (2026.acl-long)
Copied to clipboard
| Challenge: | Web applications (web apps) are a key arena for large language models to demonstrate their code generation capabilities and commercial potential. |
| Approach: | a new benchmark for large language models (LLMs) is designed to provide real-world user requirements and generalizable evaluation metrics. |
| Outcome: | a new benchmark for large language models (LLMs) provides a real-world, generalizable, and interpretable evaluation score . the benchmark measures user requirements, expression styles and human-preference-aligned weights . a web application can be used to demonstrate its commercial potential, authors say . |
mmE5: Improving Multimodal Multilingual Embeddings via High-quality Synthetic Data (2025.findings-acl)
Copied to clipboard
| Challenge: | Multimodal embedding models encode multimedia inputs into latent vector representations. |
| Approach: | They propose to synthesize multimodal multilingual data using a multimodal large language model . they identify three criteria for high-quality synthetic multimodal data . |
| Outcome: | The proposed model outperforms existing models on the MMEB Benchmark and the XTD benchmark. |
Aligning Cross-Lingual Entities with Multi-Aspect Information (D19-1)
Copied to clipboard
| Challenge: | Existing knowledge graphs that represent entities in different languages are not covered by existing systems. |
| Approach: | They propose two ways to embed entities from multilingual knowledge graphs into the same vector space, where equivalent entities are close to each other. |
| Outcome: | The proposed method significantly outperforms existing systems on two benchmark datasets. |
Neural Document Summarization by Jointly Learning to Score and Select Sentences (P18-1)
Copied to clipboard
| Challenge: | Sentence scoring and sentence selection are two main steps in extractive document summarization systems. |
| Approach: | They propose an end-to-end neural network framework for extractive document summarization by jointly learning to score and select sentences. |
| Outcome: | The proposed framework outperforms the state-of-the-art summarization models on the CNN/Daily Mail dataset. |
Incorporating Latent Meanings of Morphological Compositions to Enhance Word Embeddings (P18-1)
Copied to clipboard
| Challenge: | Existing word embedding methods learn semantic information at word level while neglecting meaningful inner structures of words like morphemes. |
| Approach: | They propose to use latent meanings of morphological compositions of words to train word embeddings. |
| Outcome: | The proposed models outperform baseline models on word similarity, syntactic analogy and text classification tasks. |
MM-Verify: Enhancing Multimodal Reasoning with Chain-of-Thought Verification (2025.acl-long)
Copied to clipboard
| Challenge: | MM-Verifier and MM Reasoner are a powerful multimodal reasoning model . large language models (LLMs) have demonstrated exceptional performance across tasks spanning myriad domains. |
| Approach: | They propose a method which combines tree search and verification to generate high-quality chain-of-thought data. |
| Outcome: | The proposed method outperforms all larger models on the MathCheck, MathVista, and MathVerse benchmarks. |
SemRegex: A Semantics-Based Approach for Generating Regular Expressions from Natural Language Specifications (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to generate programs from natural language do not address program aliasing . semantically equivalent programs may have many syntactically different forms . |
| Approach: | They propose a semantics-based approach to generate regular expressions from natural language. |
| Outcome: | The proposed approach improves on three public datasets. |
Calibrating LLM-Based Evaluator (2024.lrec-main)
Copied to clipboard
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
| Challenge: | Existing models for large language models lack the ability to calibrate their outputs towards human preference. |
| Approach: | They propose a multi-stage, gradient-free approach to calibrate an LLM-based evaluator toward human preference. |
| Outcome: | The proposed approach improves correlation with expert evaluation on multiple text quality evaluation datasets. |
DiffER: Diffusion Entity-Relation Modeling for Reversal Curse in Diffusion Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing large language models exhibit unidirectional behavior when processing bidirectional relationships . authors propose a solution to alleviate the reversal curse in Diffusion LLMs . |
| Approach: | They propose a model that addresses the "reversal curse" of bidirectional behavior in large language models . they propose 'entity-aware training' and balanced data construction to alleviate asymmetry and missing relations . |
| Outcome: | The proposed model alleviates the "reversal curse" in Diffusion LLMs . the proposed model employs whole-entity masking to mitigate entity fragmentation . |
Coarse-to-Fine Grounded Memory for LLM Agent Planning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to enhance LLM with offline experiences or online trajectory analysis focus on single-granularity memory derived from dynamic environmental interactions. |
| Approach: | They propose a framework that grounds coarse-to-fine memories with LLM to enable flexible adaptation to diverse scenarios. |
| Outcome: | Extensive experiments on AlfWorld, Webshop and ScienceWorld show that the proposed framework outperforms baselines and comprehensively optimizes memory-enhanced LLM Agent system. |
OpenUE: An Open Toolkit of Universal Extraction from Text (2020.emnlp-demos)
Copied to clipboard
Ningyu Zhang, Shumin Deng, Zhen Bi, Haiyang Yu, Jiacheng Yang, Mosha Chen, Fei Huang, Wei Zhang, Huajun Chen
| Challenge: | a large number of natural language processing tasks focus on token-level or sentence-level understandings. |
| Approach: | They propose an open-source and extensible toolkit for various extraction tasks . they deploy an online demo with restful APIs to support real-time extraction . |
| Outcome: | The proposed model can be used to extract information from text without training and deployment. |
Event Detection from Social Media for Epidemic Prediction (2024.naacl-long)
Copied to clipboard
Tanmay Parekh, Anh Mac, Jiarui Yu, Yuxuan Dong, Syed Shahriar, Bonnie Liu, Eric Yang, Kuan-Hao Huang, Wei Wang, Nanyun Peng, Kai-Wei Chang
| Challenge: | Social media is an easy-to-access platform providing timely updates about societal trends and events. |
| Approach: | They propose a framework to extract epidemic-related events from social media posts to provide early warnings. |
| Outcome: | The proposed framework can detect epidemic events for three unseen epidemics of Monkeypox, Zika, and Dengue while existing models fail miserably. |
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)
Copied to clipboard
Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu
| Challenge: | a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide. |
| Approach: | They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions . |
| Outcome: | The proposed agents are based on operating systems (OS) and operating systems frameworks. |
Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm Perspective (2025.acl-long)
Copied to clipboard
Yiyao Yu, Yuxiang Zhang, Dongdong Zhang, Xiao Liang, Hengyuan Zhang, Xingxing Zhang, Mahmoud Khademi, Hany Hassan Awadalla, Junjie Wang, Yujiu Yang, Furu Wei
| Challenge: | Existing work shows that LLMs rely on single-paradigm reasoning that limits their effectiveness across diverse tasks. |
| Approach: | They propose a new framework that integrates multiple reasoning paradigms to enable synergistic collaboration. |
| Outcome: | The proposed model outperforms current SOTA models in theorem proving tasks and the MATH benchmark in arithmetic tasks. |
From English to Second Language Mastery: Enhancing LLMs with Cross-Lingual Continued Instruction Tuning (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) acquire strong language skills through extensive pre-training and supervised fine-tuning (SFT) on instructionresponse pairs. |
| Approach: | They propose a method which leverages translation-based parallel instruction data to enhance cross-lingual adaptability. |
| Outcome: | The proposed model improves on Llama-2-7B across five languages against three objective benchmarks and an LLM-as-a-judge benchmark. |
LongEmbed: Extending Embedding Models for Long Context Retrieval (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing embedding models support only 512 input tokens, hindering their application in scenarios requiring long inputs. |
| Approach: | They evaluate the performance of existing embedding models by using a new benchmark and a training-free context window extension strategy. |
| Outcome: | The proposed model extends the input window of existing models by several folds. |
ToolRerank: Adaptive and Hierarchy-Aware Reranking for Tool Retrieval (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent studies have proposed tool learning, which augments LLMs with external tools. |
| Approach: | They propose an adaptive and hierarchy-aware reranking method to refine retrieval results by truncating the retrieval result related to seen and unseen tools at different positions. |
| Outcome: | The proposed method improves retrieval results, leading to better execution results generated by the LLM. |
CompTab: A Comprehensive Benchmark for Real-World TableQA with Complex Reasoning and Irregular Tables (2026.acl-long)
Copied to clipboard
Zhen Yang, Wei Du, Jie Wang, Wenze Zhou, Xiangfeng Meng, Zhengyang Wang, Suping Sun, Ziwei Du, Haodong Zou, Jie Chen, Yongbin Liu, Shicheng Tan, Jiahao Ying, Shu Zhao
| Challenge: | Existing benchmarks focus on well-structured tables and fail to reflect irregular structures and complex reasoning commonly encountered in real-world scenarios. |
| Approach: | They propose a benchmark to evaluate TableQA under complex reasoning and irregular table conditions. |
| Outcome: | The proposed framework improves generalization and realism of large language models under complex and irregular table conditions. |
Query2doc: Query Expansion with Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for sparse and dense retrieval have limited success on popular datasets. |
| Approach: | They propose a query expansion approach that generates pseudo-documents by few-shot prompting large language models and then expands the query with generated pseudo-docs. |
| Outcome: | The proposed method boosts the performance of BM25 on ad-hoc IR datasets by 3% to 15% without any model fine-tuning. |
StyleDGPT: Stylized Response Generation with Pre-trained Language Models (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for generating responses following a desired style are lacking of parallel data for training. |
| Approach: | They propose a KL loss and a style classifier to fine-tune response generation . they show that their model can significantly outperform state-of-the-art methods . |
| Outcome: | The proposed model outperforms state-of-the-art models in style consistency and contextual coherence with two public datasets. |
Dual-Cluster Memory Agent: Resolving Multi-Paradigm Ambiguity in Optimization Problem Solving (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) struggle with structural ambiguity in optimization problems, where a single problem admits multiple related but conflicting modeling paradigms, hindering effective solution generation. |
| Approach: | They propose to use memory to leverage historical solutions in a training-free manner to enhance performance by leveraging generalizable guidance knowledge. |
| Outcome: | The proposed agent achieves an average performance improvement of 11%-21% over previous agents. |
FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Models (2025.naacl-long)
Copied to clipboard
Xin Guo, Haotian Xia, Zhaowei Liu, Hanyang Cao, Zhi Yang, Zhiqiang Liu, Sizhe Wang, Jinyi Niu, Chuqi Wang, Yanhui Wang, Xiaolong Liang, Xiaoming Huang, Bing Zhu, Zhongyu Wei, Yun Chen, Weining Shen, Liwen Zhang
| Challenge: | Large language models have demonstrated outstanding performance in various natural language processing tasks, but their security capabilities in the financial domain have not been explored. |
| Approach: | They propose to use a benchmark to evaluate large language models' financial domain knowledge and practical abilities. |
| Outcome: | The proposed benchmark evaluates large language models' financial domain knowledge and practical abilities. |
MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance (D19-1)
Copied to clipboard
| Challenge: | Existing evaluation metrics are not capable of evaluating text quality. |
| Approach: | They propose a metric that compares system output against reference texts based on semantics rather than surface forms. |
| Outcome: | The proposed metric shows a high correlation with human judgment of text quality on a number of text generation tasks. |
Detecting Customer Complaint Escalation with Recurrent Neural Networks and Manually-Engineered Features (N19-2)
Copied to clipboard
Wei Yang, Luchen Tan, Chunwei Lu, Anqi Cui, Han Li, Xi Chen, Kun Xiong, Muzi Wang, Ming Li, Jian Pei, Jimmy Lin
| Challenge: | e-commerce companies often have the option of escalating complaints by filing grievances with a government authority . this is detrimental to an ecommerce company, but this problem is challenging to solve by integrating recurrent neural networks with manually-engineered features. |
| Approach: | They propose a model that integrates recurrent neural networks with manually-engineered features to identify cases where the customer expresses such an intent. |
| Outcome: | The proposed model outperforms baseline models and provides better recall and triage for specialized agents. |
Frustratingly Easy Label Projection for Cross-lingual Transfer (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to improve cross-lingual transfer performance are based on word alignment, but no empirical studies have evaluated their effectiveness or limitations. |
| Approach: | They propose a mark-then-translate method that integrates translation and projection by inserting special markers around the labeled spans in the original sentence. |
| Outcome: | The proposed method outperforms word alignment-based methods in 57 languages and three tasks. |
UCoder: Unsupervised Code Generation by Internal Probing of Large Language Models (2026.findings-acl)
Copied to clipboard
Jiajun Wu, Jian Yang, Wei Zhang, Linzheng Chai, Yuchi Ma, Ensheng Shi, Yuqing Ma, Zhoujun Li, Xianglong Liu
| Challenge: | Large language models (LLMs) have demonstrated remarkable capabilities in code generation tasks, but their effectiveness relies on supervised training with extensive labeled data and computational resources. |
| Approach: | They propose an unsupervised method that leverages Internal Probing of Large language models for Code generation without any external corpus, even unlabeled code snippets. |
| Outcome: | The proposed method can achieve competitive performance compared to supervised approaches while reducing the dependency on labeled data and computational resources. |
Learning to Retrieve In-Context Examples for Large Language Models (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing approaches to improve in-context learning performance are highly sensitive to the quality of the incontext examples provided. |
| Approach: | They propose a framework to iteratively train dense retrievers that can identify high-quality in-context examples for large language models. |
| Outcome: | The proposed model improves performance by retrieving examples with similar patterns, and the gains are consistent across LLMs of varying sizes. |
Intent Discovery with Frame-guided Semantic Regularization and Augmentation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing intent discovery methods focus on transferring prior knowledge of known intents to unknown ones. |
| Approach: | They propose to use frame knowledge as conceptual semantic guidance to bridge the gap between known intents representation learning and unknown intents clustering. |
| Outcome: | The proposed method outperforms solid baselines on two benchmark datasets. |
SRAP-Agent: Simulating and Optimizing Scarce Resource Allocation Policy with LLM-based Agent (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research on the allocation of public scarce resources has limitations due to data scarcity and data scariness. |
| Approach: | They propose a framework that integrates Large Language Models into economic simulations . they conduct extensive policy simulation experiments to verify the framework's effectiveness . |
| Outcome: | The proposed framework bridges the gap between theoretical models and real-world dynamics by integrating large language models into economic simulations. |
MoCa: Modality-aware Continual Pre-training Makes Better Bidirectional Multimodal Embeddings (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to embed multimodal models face limitations such as suboptimal causal attention in VLMs and limited diversity in training objectives and data. |
| Approach: | They propose a framework for transforming pre-trained VLMs into bidirectional multimodal embedding models. |
| Outcome: | The proposed model improves performance across MMEB and ViDoRe-v2 benchmarks and exhibits strong scalability with both model size and training data on MMEF. |
To be Closer: Learning to Link up Aspects with Opinions (2021.emnlp-main)
Copied to clipboard
| Challenge: | Dependency parsers are not designed for capturing interaction between opinion words and aspect words. |
| Approach: | They propose to learn an aspect-centric tree structure to shorten distance between aspects and opinion words. |
| Outcome: | The proposed model outperforms baselines on five aspect-based sentiment datasets. |
SessionIntentBench: A Multi-task Inter-session Intention-shift Modeling Benchmark for E-commerce Customer Behavior Understanding (2026.findings-acl)
Copied to clipboard
Yuqi Yang, Weiqi Wang, Baixuan Xu, Wei Fan, Qing Zong, Chunkit Chan, Zheye Deng, Xin Liu, Yifan Gao, Changlong Yu, Chen Luo, Yang Li, Zheng Li, Qingyu Yin, Bing Yin, Yangqiu Song
| Challenge: | Existing models fail to capture and model customer intention effectively because of insufficient information exploitation and only apparent information like descriptions and titles are used. |
| Approach: | They propose to exploit existing session data to capture and model intention in E-commerce product purchase sessions using a multimodal benchmark. |
| Outcome: | The proposed framework can bridge the gap between intention understanding in simplified research cases like co-buy intention and more complex yet practical scenarios like session history. |
Automatic Academic Paper Rating Based on Modularized Hierarchical Convolutional Neural Network (P18-2)
Copied to clipboard
| Challenge: | Existing methods to rate academic papers require a lot of feature engineering and can cause inequality. |
| Approach: | They propose to use a novel convolutional neural network to automatically rate academic papers . they propose to build a dataset to automatically determine whether to accept academic papers. |
| Outcome: | The proposed model outperforms baselines by a large margin. |
AgentMark: Utility-Preserving Behavioral Watermarking for Agents (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have improved text generation and reasoning. |
| Approach: | They propose a behavioral watermarking framework that embeds multi-bit identifiers into planning decisions while preserving utility. |
| Outcome: | The proposed framework embeds multi-bit provenance into planning decisions while preserving utility. |
Investigating Human and LLMs’ Decisions in Unverifiable Environments: A Case Study with GitHub Activity Overview (2026.findings-acl)
Copied to clipboard
| Challenge: | examining the behaviors of Large Language Models as artificial social actors is underexplored, especially in unverifiable scenarios where conventional benchmarking has little to help improve their abilities. |
| Approach: | They propose a method to collect, compare, and reason about human and LLMs' decisions in an unverifiable scenario and use it to examine their behaviors. |
| Outcome: | The proposed method compared human and LLM decisions in an unverifiable scenario on GitHub and found that proprietary LLMs behave more like humans than open-source LLM systems. |
SampleMix: A Sample-wise Pre-training Data Mixing Strategy by Coordinating Data Quality and Diversity (2025.findings-emnlp)
Copied to clipboard
Xiangyu Xi, Deyang Kong, Jian Yang, Jiawei Yang, Zhengyu Chen, Wei Wang, Jingang Wang, Xunliang Cai, Shikun Zhang, Wei Ye
| Challenge: | Existing methods for pretraining data mixing for large language models neglect significant inter-domain overlaps and commonalities, failing to control the global diversity of the constructed training dataset. |
| Approach: | They propose a sample-wise data mixture approach that performs global cross-domain sampling by systematically evaluating the quality and diversity of each sample. |
| Outcome: | The proposed method exceeds existing domain-based methods in multiple downstream tasks and perplexity assessments. |
cAST: Enhancing Code Retrieval-Augmented Generation with Structural Chunking via Abstract Syntax Tree (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing line-based chunking heuristics often break semantic structures, splitting functions or merging unrelated code. |
| Approach: | They propose a structure-aware method that breaks large AST nodes into smaller chunks . this method generates self-contained, semantically coherent units across programming languages . |
| Outcome: | The proposed method boosts Recall@5 by 4.3 points on RepoEval retrieval and Pass@1 by 2.67 points on SWE-bench generation. |
EvoWiki: Evaluating LLMs on Evolving Knowledge (2025.acl-long)
Copied to clipboard
Wei Tang, Yixin Cao, Yang Deng, Jiahao Ying, Bo Wang, Yizhe Yang, Yuyue Zhao, Qi Zhang, Xuanjing Huang, Yu-Gang Jiang, Yong Liao
| Challenge: | Existing knowledge evolution benchmarks are static and fail to capture the evolving nature of LLMs and knowledge. |
| Approach: | They propose an evolving dataset that categorizes information into stable, evolved, and uncharted states. |
| Outcome: | The proposed dataset is auto-updatable and enables evaluation of continuously changing knowledge and newly released LLMs. |
EquiBench: Benchmarking Large Language Models’ Reasoning about Program Semantics via Equivalence Checking (2025.emnlp-main)
Copied to clipboard
Anjiang Wei, Jiannan Cao, Ran Li, Hongyu Chen, Yuhui Zhang, Ziheng Wang, Yuan Liu, Thiago S. F. X. Teixeira, Diyi Yang, Ke Wang, Alex Aiken
| Challenge: | EquiBench is a new benchmark to evaluate large language models' ability to reason about program semantics . Unlike natural language, code is executable. |
| Approach: | They propose a benchmark to evaluate large language models through equivalence checking . EquiBench consists of 2400 program pairs across four languages and six categories . |
| Outcome: | The proposed benchmark consists of 2400 program pairs across four languages and six categories. |
A Progressive Framework for Role-Aware Rumor Resolution (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for rumor resolution ignore intrinsic propagation mechanisms of rumors and present poor adaptive ability when unprecedented news emerges. |
| Approach: | They propose to identify triggering posts and exploit their characteristics to facilitate rumor verification. |
| Outcome: | The proposed model and scheme exploits rumor diffusion patterns and linguistic features to facilitate verification. |
A Triple-View Framework for Fine-Grained Emotion Classification with Clustering-Guided Contrastive Learning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on dealing with only one of the two difficulties of coarse-grained emotion classification. |
| Approach: | They propose a triple-view framework that treats FEC as an instance-label joint embedding learning problem to tackle both difficulties concurrently by considering three complementary views. |
| Outcome: | The proposed framework achieves significant and consistent improvements on two widely-used benchmark datasets. |
A Multi-Attention based Neural Network with External Knowledge for Story Ending Predicting Task (C18-1)
Copied to clipboard
| Challenge: | Existing studies on the topic of common sense story understanding focus on generating guesses for a missing event or concentrating on unsupervised learning. |
| Approach: | They propose to extend attention-based neural network with external knowledge resources to understand temporal stories and predict their endings. |
| Outcome: | The proposed model outperforms state-of-the-art models and external knowledge resources. |
Joint Entity and Relation Extraction with Span Pruning and Hypergraph Neural Networks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Entity and Relation Extraction (ERE) is an important task in information extraction. |
| Approach: | They propose a hypergraph neural network for ERE built upon the PL-marker . they use a pruner mechanism to transfer the burden of entity identification to the joint module . |
| Outcome: | The proposed model improves on three widely used benchmarks on ERE task . it uses a pruner mechanism to transfer the burden of entity identification to the joint module . |
Learn to Cross-lingual Transfer with Meta Graph Learning Across Heterogeneous Languages (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing mPLM-based methods focus on designing costly model pre-training while ignoring equally crucial downstream adaptation. |
| Approach: | They propose a meta graph learning method that extracts meta-knowledge from historical CLT experiences to learn to cross-lingual transfer. |
| Outcome: | The proposed method can learn to cross-lingual transfer by extracting meta-knowledge from historical CLT experiences (tasks) it can also capture intrinsic language relationships to explicitly guide cross-linguistic transfer. |
Unleashing Low-Bit Inference on Ascend NPUs: A Comprehensive Evaluation of HiFloat Formats (2026.acl-industry)
Copied to clipboard
Pengxiang Zhao, Hui-Ling Zhen, Xing Li, Han Bao, Weizhe Lin, Zhiyuan Yang, Yu Zi Wei, Xin Wang, Mingxuan Yuan, Xianzhi Yu, Zhenhua Dong
| Challenge: | Low-bit floating-point formats like MXFP and NVFP4 offer new opportunities for precision and efficiency. |
| Approach: | They evaluate HiFloat (HiF8 and HiF4), a family of floating-point formats tailored for Ascend NPUs. |
| Outcome: | The proposed formats excel with high-variance data and are compatible with state-of-the-art quantization frameworks. |
Multi-grained Named Entity Recognition (P19-1)
Copied to clipboard
| Challenge: | Existing approaches treat Named Entity Recognition (NER) as a sequence labeling task. |
| Approach: | They propose a framework for Multi-Grained Named Entity Recognition where multiple entities or entity mentions in a sentence could be non-overlapping or totally nested. |
| Outcome: | The proposed framework outperforms current state-of-the-art frameworks by 4.4% in terms of the F1 score among nested/non-overlapping NER tasks. |
OntoGuard: Enforcing Action Admissibility for LLM Agents in Complex Interactive Environments (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to large language models (LLMs) are limited by their ability to enforce environmental and behavioral admissibility. |
| Approach: | They propose an ontological framework to guard LLM agents by enforcing environmental and behavioral admissibility. |
| Outcome: | Experiments on ScienceWorld and VirtualHome show that OntoGuard can enforce environmental and behavioral admissibility while preventing invalid actions. |
UniCreative: Unifying Long-form Logic and Short-form Sparkle via Reference-Free Reinforcement Learning (2026.findings-acl)
Copied to clipboard
Xiaolong Wei, Zerun Zhu, Simin Niu, Xingyu Zhang, Peiying Yu, Changxuan Xiao, Yuchen Li, Jicheng Yang, Zhejun Zhao, Chong Meng, Long Xia, Daiting Shi
| Challenge: | Existing alignment paradigms for creative writing use static reward signals and supervised data. |
| Approach: | They propose a constraint-aware reward model that synthesizes query-specific criteria to provide fine-grained preference judgments. |
| Outcome: | The proposed framework aligns models with human preferences across content quality and structural paradigms without supervised fine-tuning and ground-truth references. |
Browsing Like Human: A Multimodal Web Agent with Experiential Fast-and-Slow Thinking (2025.acl-long)
Copied to clipboard
| Challenge: | Existing web agents lack visual perception, planning, and memory abilities, but their reasoning process is deviate from human cognition. |
| Approach: | They propose a multimodal web agent framework that emulates human planning process to decompose complex user instructions. |
| Outcome: | The proposed framework emulates human planning process to decompose complex user instructions. |
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training (2021.naacl-main)
Copied to clipboard
Zewen Chi, Li Dong, Furu Wei, Nan Yang, Saksham Singhal, Wenhui Wang, Xia Song, Xian-Ling Mao, Heyan Huang, Ming Zhou
| Challenge: | Existing methods for learning cross-lingual representations are lacking in the field of NLP. |
| Approach: | They propose a framework that formulates cross-lingual language model pre-training as maximizing mutual information between multilingual-multi-granularity texts. |
| Outcome: | The proposed approach improves cross-lingual transferability on benchmarks. |
Memory-augmented Query Reconstruction for LLM-based Knowledge Graph Reasoning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods that confuse tool utilization with knowledge reasoning harm readability and give rise to tool invocation hallucinations. |
| Approach: | They propose to decouple LLM from tool invocation tasks by establishing a memory module with explicit descriptions of query statements and a query memory module to facilitate the KGQA process. |
| Outcome: | The proposed method achieves state-of-the-art on WebQSP and CWQ benchmarks. |
MobileBench-OL: A Comprehensive Chinese Benchmark for Evaluating Mobile GUI Agents in Real-World Environment (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in mobile Graphical User Interface (GUI) agents highlight the growing need for comprehensive evaluation benchmarks. |
| Approach: | They propose an online benchmark with 1080 tasks from 80 Chinese apps that measures task execution, complex reasoning, noise robustness and auto-eval framework with a reset mechanism. |
| Outcome: | The proposed benchmark measures task execution, complex reasoning, and noise robustness of agents by including 5 subsets, which set multiple evaluation dimensions. |
Exploring the Compositional Generalization in Context Dependent Text-to-SQL Parsing (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models struggle on the text-to-SQL benchmarks, but we propose a method to improve their generalization ability. |
| Approach: | They propose a method to improve the combinatorial generalization of Text-to-SQL models by aligning previous SQL statements with the input utterance. |
| Outcome: | The proposed method improves the generalization ability of Text-to-SQL models. |
OMGM: Orchestrate Multiple Granularities and Modalities for Efficient Multimodal Retrieval (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for Knowledge-Based Visual Question Answering lack multimodal retrieval . large language models (LLMs) have demonstrated remarkable generalization and reasoning capabilities in text-based systems. |
| Approach: | They propose a multimodal vision-language retrieval-augmented generation system that harmonizes multiple modalities and modality to enhance retrieval. |
| Outcome: | The proposed system achieves state-of-the-art retrieval performance and competitive answers on InfoSeek and Encyclopedic-VQA benchmarks. |
Crabs: Consuming Resource via Auto-generation for LLM-DoS Attack under Black-box Settings (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on white-box attacks focus on black-box LLMs, leaving black- box scenarios underexplored. |
| Approach: | They propose an automated algorithm designed for black-box LLMs that constructs the DoS Attack Tree and expands the node coverage to achieve effectiveness under black- box conditions. |
| Outcome: | The proposed algorithm can be used to build a DoS Attack Tree and expand the node coverage to achieve effectiveness under black-box conditions. |
TANet: Thread-Aware Pretraining for Abstractive Conversational Summarization (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing pre-trained language models are difficult to apply to abstractive conversational summarization tasks. |
| Approach: | They propose a thread-aware Transformer-based network that incorporates contextual dependency into the conversational summarization model. |
| Outcome: | The proposed model can be applied to real conversations using a large-scale pretraining dataset. |