Papers by Jia Wang
RealTalk-CN: A Realistic Chinese Speech Task-Oriented Dialogue Benchmark with Cross-Modal Analysis (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in speech large language models have enabled end-to-end spoken interactions, but their robustness in real-world applications remains unclear. |
| Approach: | They propose a multi-turn, multi-domain speech–text TOD dataset for Chinese users . it contains 5.4k dialogues with annotations for dialogue states, disfluency types, speaker characteristics . |
| Outcome: | The proposed model can be used to evaluate speech large language models in real-world scenarios . the proposed model is based on 5.4k real human-to-human dialogues with annotations . |
Think Visually: Question Answering through Virtual Imagery (P18-1)
Copied to clipboard
| Challenge: | Existing models of geometric reasoning are based on visual representations of objects and objects, but they are not based in symbols or words. |
| Approach: | They propose a new deep network architecture that specializes in answering questions that admit latent visual representations and learns to generate and reason over such representations. |
| Outcome: | The proposed model can generate and reason over latent visual representations and is validated by two synthetic benchmarks. |
MTA:A Merge-then-Adapt Framework for Personalized Large Language Models (2026.acl-long)
Copied to clipboard
Xiaopeng Li, Yuanjin Zheng, Wanyu Wang, Wenlin Zhang, Pengyue Jia, Yingyi Zhang, Haiying He, Mengyang Ma, Yiqi Wang, Maolin Wang, Xuetao Wei, Xiangyu Zhao
| Challenge: | Personalized Large Language Models (PLLMs) aim to align outputs with individual user preferences . current methods of fine-tuning a separate module for each user are unscalable . |
| Approach: | They propose a Merge-then-Adapt framework for Personalized Large Language Models . they construct a shared Meta-LoRA bank and propose an Adaptive LoRA Fusion stage . |
| Outcome: | The proposed framework outperforms existing SOTA methods on the LaMP benchmark. |
PAI-Diffusion: Constructing and Serving a Family of Open Chinese Diffusion Models for Text-to-image Synthesis on the Cloud (2024.acl-demos)
Copied to clipboard
| Challenge: | Existing diffusion models fail to address the challenges of generating high-quality images from textual descriptions due to its large vocabulary size and complex character relationships. |
| Approach: | They propose a framework that integrates Chinese diffusion models with Alibaba Cloud's Platform for AI and enables the generation of contextually relevant images. |
| Outcome: | The proposed framework integrates with Alibaba Cloud’s Platform for AI, providing accessible and scalable solutions. |
Reference Matters: Benchmarking Factual Error Correction for Dialogue Summarization with Fine-grained Evaluation Framework (2023.acl-long)
Copied to clipboard
| Challenge: | Current evaluations of FEC models that depend on factuality metrics are not reliable and detailed enough. |
| Approach: | They propose a fine-grained evaluation framework that automatically evaluates FEC models on different error categories. |
| Outcome: | The proposed evaluation framework compares models on different error categories and finds the best training modes and significant differences in the performance of existing models. |
CamoQuery: Language-Guided Reasoning Camouflaged Object Segmentation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for camouflaged object segmentation are limited to vision-only mask prediction under fixed task assumptions. |
| Approach: | They propose a language-guided reasoning camouflaged object segmentation task that generates an intent-consistent segmentation mask from an image and an implicit query text instruction. |
| Outcome: | The proposed task can generate an intent-consistent segmentation mask from a camouflaged image and an implicit query text instruction. |
Zero-Shot Cross-Lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on improving cross-lingual transferability of NMT model is under-explored. |
| Approach: | They propose a model that leverages a multilingual pretrained encoder to improve cross-lingual transferability. |
| Outcome: | The proposed model outperforms mBART and m2m-100 on a zero-shot cross-lingual transfer task. |
ACR: Adaptive Context Refactoring via Context Refactoring Operators for Multi-Turn Dialogue (2026.findings-acl)
Copied to clipboard
Jiawei Shen, Jia Zhu, Hanghui Guo, Weijie Shi, Yue Cui, Qingyu Niu, Guoqing Ma, Jingjiang Liu, Yidan Liang, Yilin Wang, Shimin Di, Jiajie Xu
| Challenge: | Existing approaches to multi-turn dialogues lack contextual consistency and dependencies, and models struggle to maintain factual faithfulness as interaction turns increase. |
| Approach: | They propose an adaptive context refactoring framework that monitors and reshapes the interaction history to mitigate contextual inertia and state drift. |
| Outcome: | The proposed model outperforms baselines while reducing token consumption. |
Enhancing LLM Knowledge Learning through Generalization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Continued pre-training on paraphrased data has shown empirical promise for enhancing knowledge acquisition, but this approach is costly and unreliable as it relies on external models or manual effort for rewriting. |
| Approach: | They propose formatting-based data augmentation which diversifies documents conveying the same knowledge by altering document formats rather than their content. |
| Outcome: | The proposed methods improve generalization to diverse paraphrased contexts and enhance pre-training and instruction tuning. |
mCLIP: Multilingual CLIP via Cross-lingual Transfer (2023.acl-long)
Copied to clipboard
Guanhua Chen, Lu Hou, Yun Chen, Wenliang Dai, Lifeng Shang, Xin Jiang, Qun Liu, Jia Pan, Wenping Wang
| Challenge: | Existing multilingual vision-language pretrained models are biased towards English due to the lack of sufficient non-English image-text pairs. |
| Approach: | They propose to train a retrieval-efficient dual-stream multilingual VLP model by aligning CLIP model and a multilingual text encoder through a novel Triangle Cross-modal Knowledge Distillation method. |
| Outcome: | Empirical results show that mCLIP achieves new state-of-the-art performance for both zero-shot and finetuned multilingual image-text retrieval tasks. |
MicroC-KT: Modeling Community Effect via Learning Micro-Environment for Evidence-Grounded Explainable Knowledge Tracing (2026.acl-long)
Copied to clipboard
| Challenge: | Existing graph-based methods focus on exercise-concept relations, but lack the broader context of group references and contrastive evidence. |
| Approach: | They propose a framework that incorporates learning micro-environments to provide social-cognitive anchors for KT by extracting contrastive group evidence. |
| Outcome: | The proposed framework outperforms state-of-the-art models on four public datasets while providing more reliable and evidence-based explanations. |
DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories (2024.findings-acl)
Copied to clipboard
Jia Li, Ge Li, Yunfei Zhao, Yongmin Li, Huanyu Liu, Hao Zhu, Lecheng Wang, Kaibo Liu, Zheng Fang, Lanshen Wang, Jiazheng Ding, Xuanming Zhang, Yuqi Zhu, Yihong Dong, Zhi Jin, Binhua Li, Fei Huang, Yongbin Li, Bin Gu, Mengfei Yang
| Challenge: | Existing benchmarks are poorly aligned with real-world code repositories and are insufficient to evaluate the coding abilities of Large Language Models (LLMs). |
| Approach: | They propose a repository-level benchmark named DevEval to evaluate LLMs' coding abilities in real-world code repositories. |
| Outcome: | The proposed benchmarks show that the LLMs perform better in real-world code repositories than existing benchmarks. |
SelfRACG: Enabling LLMs to Self-Express and Retrieve for Code Generation (2025.emnlp-main)
Copied to clipboard
Qian Dong, Jia Chen, Qingyao Ai, Hongning Wang, Haitao Li, null Yiwu, Yao Hu, Yiqun Liu, Shaoping Ma
| Challenge: | Existing retrieval-augmented code generation methods fail to accurately fetch the knowledge required for code generation for consecutive code fragments. |
| Approach: | They propose a paradigm that enables large language models to Self-express their information needs to enhance retrieval-augmented code generation methods. |
| Outcome: | Experiments show that SelfRACG can retrieve external knowledge that better aligns with the LLM’s own information needs, resulting in superior generation performance compared to vanilla RACG. |
TableDreamer: Progressive and Weakness-guided Data Synthesis from Scratch for Table Instruction Tuning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for table instruction tuning are limited due to limited data diversity and lack of data quality. |
| Approach: | They propose a weakness-guided data synthesis framework for table instruction tuning that explores the vast input space of table understanding tasks and then iterates through the input space. |
| Outcome: | The proposed framework boosts the average accuracy of Llama3.1-8B-instruct by 11.62% with 27K GPT-4o synthetic data and outperforms state-of-the-art data synthesis baselines which use more training data. |
I2E: From Image Pixels to Actionable Interactive Environments for Text-Guided Image Editing (2026.acl-long)
Copied to clipboard
Jinghan Yu, Junhao Xiao, Chenyu Zhu, Jiaming Li, Jia Li, HanMing Deng, Xirui Wang, Guoli Jia, Jianjun Li, Xiang Bai, Bowen Zhou, Zhiyuan Ma
| Challenge: | Existing text-guided image editing methods rely on end-to-end pixel-level inpainting paradigm . existing models lack such intermediate representations and Reasoning-then-action process . |
| Approach: | They propose a "Decompose-then-Action" paradigm that revisits image editing as an actionable interaction process within a structured environment. |
| Outcome: | The proposed paradigm outperforms existing methods in compositional editing tasks. |
One Battle After Another: Probing LLMs’ Limits on Multi-Turn Instruction Following with a Benchmark Evolving Framework (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for instruction-following in multi-topic dialogues are limited to a fixed number of turns, susceptible to saturation and failing to account for users’ interactive experience. |
| Approach: | They propose a framework featuring a three-layer tracking mechanism and a query synthesis agent to mimic sequential user behaviors. |
| Outcome: | The proposed framework outperforms existing benchmarks in the evaluation of instruction following in multi-topic dialogues and demonstrates deficiencies in failure recovery and fine-grained instruction following. |
Bridging Relevance and Reasoning: Rationale Distillation in Retrieval-Augmented Generation (2025.findings-acl)
Copied to clipboard
Pengyue Jia, Derong Xu, Xiaopeng Li, Zhaocheng Du, Xiangyang Li, Yichao Wang, Yuhao Wang, Qidong Liu, Maolin Wang, Huifeng Guo, Ruiming Tang, Xiangyu Zhao
| Challenge: | Existing approaches to rerank and align documents based on reasoning capabilities of large language models (LLMs) . prior work shows that LLMs have exceptional reasoning and text generation capabilities . |
| Approach: | They propose a rationale extraction method that leverages reasoning capabilities of large language models to extract the rationales necessary for answering a query. |
| Outcome: | The proposed method is compared with baseline methods on two tasks across three datasets. |
RealChart2Code: Bridging the Gap in Real-World Chart-to-Code Generation via Multi-Task Evaluation (2026.acl-long)
Copied to clipboard
Jiajun Zhang, Yuying Li, Zhixun Li, Xingyu Guo, Jingzhuo Wu, Leqi Zheng, Yiran Yang, Jianke Zhang, Qingbin Li, Shannan Yan, Changguo Jia, Junfei Wu, Zilei Wang, Qiang Liu, Liang Wang
| Challenge: | Vision-Language Models (VLMs) have demonstrated impressive capabilities in code generation across various domains, but their ability to replicate complex, multi-panel visualizations remains largely unassessed. |
| Approach: | They propose a large-scale benchmark to evaluate chart generation from large- scale raw data and assess iterative code refinement in a multi-turn conversational setting. |
| Outcome: | The new benchmark evaluates 14 leading VLMs on real-world data and shows they struggle with complex plot structures and authentic data. |
Adaptive Preference Optimization with Uncertainty-aware Utility Anchor (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Offline preference optimization methods are efficient for large language models (LLMs) alignment. |
| Approach: | They propose an offline preference optimization framework that estimates uncertainties from preference data . the method enables training even in scenarios where the data is unpaired . |
| Outcome: | The proposed method enables training even in scenarios where the data is unpaired . |
Generalization Differences between End-to-End and Neuro-Symbolic Vision-Language Reasoning Systems (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Widely used multi-modal pretrained models generalize poorly to out-of-distribution data, suggesting shortcomings in the VLE2E pipeline. |
| Approach: | They develop a segment-combine test for multi-image queries and contrast set for cross-benchmark transfer. |
| Outcome: | The proposed method shows that it is possible to train both neural and neuro-symbolic models in the same way. |
E-ConvRec: A Large-Scale Conversational Recommendation Dataset for E-Commerce Customer Service (2022.lrec-1)
Copied to clipboard
Meihuizi Jia, Ruixue Liu, Peiying Wang, Yang Song, Zexi Xi, Haobin Li, Xin Shen, Meng Chen, Jinhui Pang, Xiaodong He
| Challenge: | Recent research has focused on developing conversational recommendation system (CRS), which provides valuable recommendations to users through conversations. |
| Approach: | They construct an authentic Chinese dialogue dataset consisting of over 25k dialogues and 770k utterances, which contains user profile, product knowledge base, and multiple sequential real conversations between users and recommenders. |
| Outcome: | The proposed dataset contains user profile, product knowledge base, and multiple sequential real conversations between users and recommenders. |
DeepSynth-Eval: Objectively Evaluating Information Consolidation in Deep Survey Writing (2026.findings-acl)
Copied to clipboard
Hongzhi Zhang, Yuanze Hu, Tinghai Zhang, Jia Fu, Tao Wang, Junwei Jing, Zhaoxin Fan, Wei Bi, Ruiming Tang, Han Li, Guorui Zhou, Kun Gai
| Challenge: | Large Language Models (LLMs) are evolving towards autonomous agents . retrieval capabilities are well-benchmarked, but post-retrieval synthesis is under-evaluated due to open-ended writing. |
| Approach: | They propose a benchmark to evaluate information consolidation capabilities using survey papers as gold standards. |
| Outcome: | The proposed benchmark analyzes the post-retrieval synthesis stage of large language models . it leverages high-quality survey papers as gold standards and reverse-engineers research requests . the proposed benchmark outperforms single-turn generation and reduces hallucinations . |
Chain-of-Questions Training with Latent Answers for Robust Multistep Question Answering (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for multistep question answering have shown promise in generating multistep solutions, but they lack robustness. |
| Approach: | They propose a framework that trains a model to robustly answer multistep questions by generating and answering sub-questions. |
| Outcome: | The proposed framework outperforms neuro-symbolic methods on a DROP contrast set and GPT-3.5 on QA adversarial sets. |
Rethinking Depression Prediction from a Fine-Grained Subscore Modeling Perspective via Multi-Task Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for depression assessment rely on standardized ratings, but they are time-consuming and subject to inter-rater variability. |
| Approach: | They propose a fine-grained model for subscore prediction via multi-task learning that can be used to predict depression severity using multiple tasks. |
| Outcome: | The proposed model outperforms baselines and Qwen3-14B direct scoring on the public E-DAIC dataset and to a large-scale private clinical dataset. |
Beyond Fully Random Masking: Attention-Guided Denoising and Optimization for Diffusion Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for full-attention dLLMs rely on random masking strategies that overlook intrinsic token dependencies. |
| Approach: | They propose an attention-guided denoising and optimization framework that aligns training and optimization with attention-derived dependencies. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on mathematical and coding benchmarks. |
QSpell 250K: A Large-Scale, Practical Dataset for Chinese Search Query Spell Correction (2025.naacl-industry)
Copied to clipboard
| Challenge: | Chinese Search Query Spell Correction is a task designed to identify and correct typographical errors within queries. |
| Approach: | They propose a large-scale benchmark specifically developed for Chinese Query Spell Correction. |
| Outcome: | The proposed benchmark covers a broad range of topics, including formal entities, everyday colloquialisms and idiomatic expressions. |
LangSuit·E: Planning, Controlling and Interacting with Large Language Models in Embodied Text Environments (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have shown inspiring achievements in constructing autonomous agents that rely on language descriptions as inputs. |
| Approach: | They propose a flexible and simulation-free testbed that simulates 6 representative embodied tasks in textual embodies. |
| Outcome: | The proposed testbed offers adaptability to diverse environments without multiple simulation engines and allows easy customization of communication and action strategies. |
Table-as-Search: Agentic Information Seeking is Table Completion (2026.findings-acl)
Copied to clipboard
Tian Lan, Felix Henry, Bin Zhu, Qianghuai Jia, Junyang Ren, Qihang PU, Haijun Li, Longyue Wang, Zhao Xu, Weihua Luo
| Challenge: | Current Information Seeking (InfoSeeking) agents struggle to maintain focus and coherence during long-horizon exploration, as tracking search states within one plain-text context is inherently fragile. |
| Approach: | They propose a structured planning framework that reformulates the InfoSeeking task as a Table Completion task. |
| Outcome: | The proposed framework outperforms state-of-the-art frameworks across three kinds of benchmarks, including multi-agent framework and commercial systems. |
Neural Extractive Summarization with Hierarchical Attentive Heterogeneous Graph Network (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing extractive summarization methods focus on balancing salience and redundancy between sentences. |
| Approach: | They propose a hierarchical attentive heterogeneous graph for text summarization that models sentences . they propose to iteratively refine the sentence representations and deliver the labels by message passing . |
| Outcome: | The proposed method outperforms existing extractive summarization methods on large corpus. |
ChatHLS: Towards Systematic Design Automation and Optimization for High-Level Synthesis (2026.acl-long)
Copied to clipboard
| Challenge: | High-Level Synthesis (HLS) is a hardware design tool that can be used to design hardware from C-like languages, but its widespread adoption is limited by strict coding constraints and design-specific optimizations. |
| Approach: | They propose a multi-agent HLS design framework that leverages specialized LLMs for automated debugging and directive tuning. |
| Outcome: | The proposed framework outperforms Gemini-3-pro in debugging and speedups across various HLS kernels and neural network accelerators. |
Multi-Programming Language Sandbox for LLMs (2025.acl-demo)
Copied to clipboard
Shihan Dou, Jiazheng Zhang, Jianxiang Zang, Yunbo Tao, Weikang Zhou, Haoxiang Jia, Shichun Liu, Yuming Yang, Shenxi Wu, Zhiheng Xi, Muling Wu, Rui Zheng, Changze Lv, Limao Xiong, Shaoqing Zhang, Lin Zhang, Wenyu Zhan, Rongxiang Weng, Jingang Wang, Xunliang Cai, Yueming Wu, Ming Wen, Yixin Cao, Tao Gui, Xipeng Qiu, Qi Zhang, Xuanjing Huang
| Challenge: | MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler and analysis tools for Large Language Models (LLMs). |
| Approach: | They propose a multi-programming language sandbox that provides unified feedback from compilers and analysis tools for Large Language Models. |
| Outcome: | The proposed multi-language sandbox can provide comprehensive feedback from compilers and analysis tools for large language models (LLMs). |
MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for query expansion lack corpus-specific knowledge and cost. |
| Approach: | They propose a query-query-document generation method that leverages large language models for mutual verification to produce diverse sub-queries and corresponding documents. |
| Outcome: | The proposed method is fully zero-shot and extensive experiments on three public benchmark datasets demonstrate its effectiveness over existing methods. |
Planning-Guided Tutoring with Assessment-Driven Memory for Pedagogical LLM Tutors (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to simulate tutor behaviors or preferences fail to sustain high-quality pedagogical conversations that provide explicit stepwise scaffolding and adapt to learners’ evolving cognitive states. |
| Approach: | They propose a planning-guided tutoring framework with an assessment-driven memory for multi-turn math dialogue tutoring. |
| Outcome: | Experiments on multi-turn math tutoring benchmarks show that ScaffoldLM significantly improves pedagogical tutoring quality over strong baselines. |
RepoGenesis: Benchmarking End-to-End Microservice Generation from Readme to Repository (2026.acl-long)
Copied to clipboard
Zhiyuan Peng, Xin Yin, Pu Zhao, Fangkai Yang, Lu Wang, Ran Jia, Xu Chen, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang
| Challenge: | Existing benchmarks focus on isolated function/class-level generation, neglecting complete microservice repository generation. |
| Approach: | They propose a multilingual benchmark for repository-level end-to-end web microservice generation that reflects real-world development workflows. |
| Outcome: | The benchmark compared 106 repositories across 18 domains and 11 frameworks and 1,258 API endpoints and 2,335 test cases. |
Recontextualizing Revitalization: A Mixed Media Approach to Reviving the Nüshu Language (2025.emnlp-main)
Copied to clipboard
| Challenge: | Nüshu is an endangered language from Jiangyong County, Hunan, China, and the world’s only known writing system created and used exclusively by women. |
| Approach: | They propose to use NüshuStrokes to record all 397 Unicode Nü Shu characters in sequential handwriting by an expert calligrapher. |
| Outcome: | Evaluating five state-of-the-art Chinese Optical Character Recognition systems on NüshuVision lowers CER to 0.67, a modest but meaningful improvement over previous datasets. |
Modularized Interaction Network for Named Entity Recognition (2021.acl-long)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) models focus on word-level information, while segment-based models focus only on word level information. |
| Approach: | They propose a Modularized Interaction Network (MIN) model which utilizes both word-level information and segment-level dependencies. |
| Outcome: | The proposed model outperforms the current state-of-the-art models on three NER benchmark datasets. |
AlgBench: To What Extent Do Large Reasoning Models Understand Algorithms? (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for algorithmic reasoning fail to answer a critical question: do LRMs master algorithmic thinking? Empirical evaluations on leading LRM models reveal substantial performance heterogeneity, while models perform well on non-optimized tasks, accuracy drops sharply to around 49% on globally optimized algorithms. |
| Approach: | They propose an algorithm-centric benchmark that evaluates large reasoning models under an algorithmic paradigm. |
| Outcome: | Empirical evaluations on leading LRMs reveal substantial performance heterogeneity . models perform well on non-optimized tasks, accuracy drops sharply to around 49% . |
ReflectEvo: Improving Meta Introspection of Small LLMs by Learning Self-Reflection (2025.findings-acl)
Copied to clipboard
Jiaqi Li, Xinyi Dong, Yang Liu, Zhizhuo Yang, Quansen Wang, Xiaobo Wang, Song-Chun Zhu, Zixia Jia, Zilong Zheng
| Challenge: | ReflectEvo-460k is a large-scale, comprehensive, self-generated reflection dataset with broadened instructions and diverse multi-domain tasks. |
| Approach: | They propose a pipeline that iteratively generates self-reflection for self-training and a large-scale reflection dataset with broadened instructions and diverse multi-domain tasks. |
| Outcome: | The proposed pipeline improves Llama-3 reasoning ability by up to 71.2% and Mistral by upto 44.4%. |
Natural Response Generation for Chinese Reading Comprehension (2023.findings-emnlp)
Copied to clipboard
| Challenge: | MRC models trained on labeled answers are limited in generating human-like responses in real QA scenarios. |
| Approach: | They construct a dataset called Penguin to promote machine reading comprehension . they use 200k training data with fluent, well-informed responses to train models . |
| Outcome: | The proposed dataset is the first benchmark towards natural response generation in Chinese MRC on a relatively large scale. |
Neural Gibbs Sampling for Joint Event Argument Extraction (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing methods for event argument extraction cannot adequately model the correlation between event arguments and their roles. |
| Approach: | They propose a Bayesian model to jointly extract event arguments using Gibbs sampling . they train two neural networks to model prior distribution and conditional distribution over event arguments . |
| Outcome: | The proposed model can achieve comparable results to existing methods on two widely-used datasets. |
Instance-Guided Prompt Learning for Few-Shot Text Matching (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Few-shot text matching is a more practical technique to determine whether two texts are semantically identical. |
| Approach: | They propose a pluggable prompt learning method for few-shot text matching . they use the semantics of instances to regulate the effects of the gate on the prompt tokens . |
| Outcome: | The proposed method outperforms baselines on MRPC and QQP. |
DDO: Dual-Decision Optimization for LLM-Based Medical Consultation via Multi-Agent Collaboration (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing LLMs fail to capture the dual nature of medical consultation (MC) this mismatch often results in ineffective symptom inquiry and unreliable disease diagnosis. |
| Approach: | They propose a novel LLM-based framework that performs Dual-Decision Optimization by decoupling the two sub-tasks and optimizing them with distinct objectives through a collaborative multi-agent workflow. |
| Outcome: | The proposed framework outperforms existing LLM-based approaches on three real-world MC datasets and achieves competitive performance with state-of-the-art generation-based methods. |
PACE: Prefix-Protected and Difficulty-Aware Compression for Efficient Reasoning (2026.findings-acl)
Copied to clipboard
Ruixiang Feng, Yuntao Wen, Silin Zhou, Ke Shi, Yifan Wang, Ran Le, Zhenwei An, Zongchao Chen, Chen Yang, Guangyue Peng, Yiming Jia, Dongsheng Wang, Tao Zhang, Lisi Chen, Yang Song, Shen Gao, Shuo Shang
| Challenge: | Existing LRMs often suffer from "overthinking" and excessively long reasoning traces . a dual-level framework for length compression of LRM is proposed . |
| Approach: | They propose a framework for prefix-protected and difficulty-aware compression under hierarchical supervision. |
| Outcome: | The proposed framework reduces token usage while improving accuracy on math benchmarks. |
medIKAL: Integrating Knowledge Graphs as Assistants of LLMs for Enhanced Clinical Diagnosis on EMRs (2025.coling-main)
Copied to clipboard
| Challenge: | Electronic Medical Records (EMRs) are the digitized record of a patient's medical and health information and are integral to modern healthcare. |
| Approach: | They propose a framework that combines Large Language Models (LLMs) with knowledge graphs (KGs) to enhance diagnostic capabilities. |
| Outcome: | The proposed framework assigns weighted importance to entities in medical records based on their type, enabling precise localization of candidate diseases within KGs. |
Not All Contexts Are Equal: Teaching LLMs Credibility-aware Generation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing RAG paradigms suffer from the impact of flawed information introduced during the retrieval phrase, thereby diminishing the reliability and correctness of the generated output. |
| Approach: | They propose a framework that empowers models to discern and process information based on its credibility. |
| Outcome: | The proposed framework outperforms existing models with retrieval augmentation and exhibits robustness despite increasing noise in the context. |
Tears or Cheers? Benchmarking LLMs via Culturally Elicited Distinct Affective Responses (2026.acl-long)
Copied to clipboard
Chongyuan Dai, Yaling Shen, Zihan Gao, Jia Li, Yishun Jiang, Yaxiong Wang, Liu Liu, Zongyuan Ge, Jinpeng Hu
| Challenge: | Culture is a fundamental determinant of human affective processing and affective perceptions are often limited by declarative knowledge or established societal customs. |
| Approach: | They propose a multimodal benchmark that leverages LLM-generated provisional labels to isolate cross-cultural emotional distinctions. |
| Outcome: | The proposed benchmark captures cross-cultural emotional distinctions and derives reliable ground-truth annotations through human evaluation. |
Separation and Fusion: A Novel Multiple Token Linking Model for Event Argument Extraction (2024.naacl-long)
Copied to clipboard
Jing Xu, Dandan Song, Siu Hui, Zhijing Wu, Meihuizi Jia, Hao Wang, Yanru Zhou, Changzhi Zhou, Ziyi Yang
| Challenge: | Existing methods for event argument extraction (EAE) lack cross-event information and require longer role sequences . et al. (2017): outperforms state-of-the-art methods for EE. |
| Approach: | They propose a separation-and-fusion paradigm to separate the acquisition of cross-event information and fuse it into the argument extraction of a target event. |
| Outcome: | The proposed model outperforms the state-of-the-art models on four widely used datasets. |
CVSS Corpus and Massively Multilingual Speech-to-Speech Translation (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing work on speech-to-speech translation (S2ST) systems rely on text representation, but they are text-centric. |
| Approach: | They introduce a massively multilingual-to-English speech-tospeech translation corpus . they synthesize the translation text from the Common Voice speech corpus and CoVoST 2 into English . |
| Outcome: | The proposed corpus outperforms existing models on CoVoST 2 by 5.8 BLEU . the proposed model outperformed the previous state-of-the-art model without extra data . |
Speaker Naming in Movies (N18-1)
Copied to clipboard
| Challenge: | Identifying speakers and their names in movies is a primary task for many video analysis problems, such as automatic subtitle labeling. |
| Approach: | They propose a model that leverages visual, textual, and acoustic modalities in an unified optimization framework for speaker naming in movies. |
| Outcome: | The proposed model outperforms baseline models on the MovieQA 2017 challenge for speaker naming in movies and TV shows on visual, textual, and acoustic modalities. |
Proving membership in LLM pretraining data via data watermarks (2024.findings-acl)
Copied to clipboard
| Challenge: | Detecting whether copyright holders’ works were used in large language model (LLM) training is poised to be an important problem. |
| Approach: | They propose to use data watermarks to enable principled detection with only black-box model access, provided the rightholder contributed multiple training documents and watermarked them before public release. |
| Outcome: | The proposed method can be used to test hypothesis testing on a black-box model . it shows that the watermarks are strong under model and dataset scaling . |
Multi-Agent Simulator Drives Language Models for Legal Intensive Interaction (2025.findings-naacl)
Copied to clipboard
ShengbinYue ShengbinYue, Ting Huang, Zheng Jia, Siyuan Wang, Shujun Liu, Yun Song, Xuanjing Huang, Zhongyu Wei
| Challenge: | Large Language Models (LLMs) have advanced legal intelligence, but the scarcity of scenario data impedes the progress toward interactive legal scenarios. |
| Approach: | They propose a Multi-agent Legal Simulation Driver to generate synthetic data by simulating interactive legal scenarios. |
| Outcome: | The proposed framework ensures consistency of legal attributes between participants and introduces a supervisory mechanism to align participants’ characters and behaviors as well as addressing distractions. |
S2R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to incentivize LLMs’ deep thinking abilities require large-scale data or significant training efforts. |
| Approach: | They introduce an efficient framework that enhances LLM reasoning by teaching models to self-verify and self-correct during inference. |
| Outcome: | The proposed framework outperforms models trained on long-CoT distilled data with 3.1k initialization samples and achieves an accuracy improvement of 51.0% to 81.6%. |
Exploring Response Uncertainty in MLLMs: An Empirical Evaluation under Misleading Scenarios (2025.emnlp-main)
Copied to clipboard
Yunkai Dang, Mengxi Gao, Yibo Yan, Xin Zou, Yanggan Gu, Jungang Li, Jingyu Wang, Peijie Jiang, Aiwei Liu, Jia Liu, Xuming Hu
| Challenge: | Existing studies have focused mainly on visual–textual misalignment, leaving largely unexplored the MLLMs’ ability to preserve an original correct answer when confronted with misleading information. |
| Approach: | They propose a two-stage evaluation pipeline to quantify the response uncertainty phenomenon by eliciting each model’s original response on unperturbed inputs and injecting explicit (false-answer hints) and implicit (contextual contradictions) misleading instructions. |
| Outcome: | The proposed model overturns a correct answer in 65% of cases after receiving a single deceptive cue. |
Sentence Ordering with a Coherence Verifier (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent sentence ordering studies can be classified into 2 categories: pair-wise ranking-based and sequence generation-based methods. |
| Approach: | They propose a sentence ordering method by plugging a coherence verifier into ranking-based and sequence generation-based methods. |
| Outcome: | The proposed method improves on topological sorting-based and pointer network-based methods with topological and point-based models. |
From Coarse to Fine: A Multi-Granularity Multimodal Framework for Teacher Sentiment Analysis (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to teacher sentiment analysis treat it as a static label . current approaches fail to capture structured heterogeneity of classroom expressions . |
| Approach: | They propose a coarse-to-fine multimodal framework that decomposes teacher sentiment into three granularities and employ CLS-guided cross-modal attention to recover effective signals from regulated displays. |
| Outcome: | The proposed framework outperforms state-of-the-art models on T-MED and CMU-MOSEI. |
MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Search (2026.acl-long)
Copied to clipboard
Sheng Zhang, Junyi Li, Yingyi Zhang, Pengyue Jia, Yichao Wang, Xiaowei Qian, Wenlin Zhang, Maolin Wang, Yong Liu, Xiangyu Zhao
| Challenge: | Existing methods for memory management struggle to capture fine-grained semantic relations between queries and documents. |
| Approach: | They propose a framework for reasoning and agentic search that grows fine-grained memory fragments from seed tokens from queries, then retraces and deep refines the memory via a contribution function. |
| Outcome: | Experiments on eight benchmark datasets show that MemSearch-o1 significantly mitigates memory dilution and more effectively activates reasoning potential of diverse LLMs. |
PBI-Attack: Prior-Guided Bimodal Interactive Black-Box Jailbreak Attack for Toxicity Maximization (2025.emnlp-main)
Copied to clipboard
Ruoxi Cheng, Yizhong Ding, Shuirong Cao, Ranjie Duan, Xiaoshuang Jia, Shaowei Yuan, Simeng Qin, Zhiqiang Wang, Xiaojun Jia
| Challenge: | Existing methods to jailbreak Large Vision Language Models do not consider interaction between images and text. |
| Approach: | They propose a prior-guided bimodal interactive black-box jailbreak attack for toxicity maximization that exploits the interaction of images and text. |
| Outcome: | The proposed method outperforms state-of-the-art jailbreak methods in black box scenarios and in closed-source LVLMs. |
Ready Jurist One: Benchmarking Language Agents for Legal Intelligence in Dynamic Environments (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for legal intelligence are limited to static evaluation paradigms or simplified scenarios. |
| Approach: | They introduce J1-ENVS, the first interactive and dynamic legal environment tailored for LLM-based agents. |
| Outcome: | The proposed framework assesses task performance and procedural compliance across legal proficiency levels. |
CuMA: Aligning LLMs with Sparse Cultural Values via Demographic-Aware Mixture of Adapters (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have a global audience, so alignment must extend to cultural resonance. |
| Approach: | They propose a framework that frames alignment as a conditional capacity separation problem. |
| Outcome: | The proposed framework outperforms both dense baselines and semantic-only MoEs on three large language models. |
OpenS2S: Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model (2025.emnlp-demos)
Copied to clipboard
Chen Wang, Tianyu Peng, Wen Yang, YiNan Bai, Guangfu Wang, Jun Lin, Lanpeng Jia, Lingxiang Wu, Jinqiao Wang, Chengqing Zong, Jiajun Zhang
| Challenge: | Empathetic speech models are increasingly closed off, leaving details about the architecture, data and development opaque to researchers. |
| Approach: | They propose an open-source empathetic speech-to-text model with a streaming interleaved decoding architecture and a data pipeline to enable end-to end training. |
| Outcome: | The proposed model is open-source and transparent, with no data or data required to build it. |
TheoremLlama: Transforming General-Purpose LLMs into Lean4 Experts (2024.emnlp-main)
Copied to clipboard
| Challenge: | a framework for formal proof writing using formal languages like Lean4 is needed to prove mathematical theorems using formal language. |
| Approach: | They propose a framework that trains a general-purpose LLM to be a Lean4 expert. |
| Outcome: | The proposed framework achieves cumulative accuracies of 36.48% and 33.61% on MiniF2F-Valid and Test datasets. |
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor (2021.acl-long)
Copied to clipboard
Xinyu Wang, Yong Jiang, Zhaohui Yan, Zixia Jia, Nguyen Bach, Tao Wang, Zhongqiang Huang, Fei Huang, Kewei Tu
| Challenge: | Knowledge distillation is a technique to transfer knowledge between models, typically from a large model (the teacher) to a more fine-grained one (the student). |
| Approach: | They propose a factorized form of the knowledge distillation objective for structured prediction which is tractable for many typical choices of the teacher and student models. |
| Outcome: | The proposed model is able to transfer knowledge between teacher and student models without loss of accuracy under four different scenarios. |
Varying Sentence Representations via Condition-Specified Routers (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing sentences cannot account for different aspects of semantic similarity between two sentences. |
| Approach: | They propose a transformer-style framework that generates conditioned sentences . they propose 'conditional' STS, which measures similarity between two sentences based on condition sentences - a task that requires a sentence embedding model capable of generating distinct representations for the same sentence under different conditions. |
| Outcome: | The proposed framework is superior to existing models on two condition sentences . it can generate conditioned sentences while maintaining model parameters and computational efficiency . |
Neural Label Search for Zero-Shot Multi-Lingual Extractive Summarization (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods to translate sentences to other languages using heuristics are challenging. |
| Approach: | They propose a model that learns hierarchical weights for different sets of labels and applies them to other languages to translate them. |
| Outcome: | The proposed model can translate English datasets to other languages and obtain different sets of labels again using heuristics. |
The Linguistic Connectivities Within Large Language Models (2025.findings-acl)
Copied to clipboard
Dan Wang, Boxi Cao, Ning Bian, Xuanang Chen, Yaojie Lu, Hongyu Lin, Jia Zheng, Le Sun, Shanshan Jiang, Bin Dong, Xianpei Han
| Challenge: | Recent studies have discovered notable disparities in their performance across different languages. |
| Approach: | They conduct a systematic investigation into the behaviors of large language models across 27 different languages on 3 different scenarios and reveals a Linguistic Map correlates with the richness of available resources and linguistic family relations. |
| Outcome: | The proposed model demonstrates that there are significant disparities in performance across languages across 27 different languages on 3 different scenarios. |
YuLan-Mini: Pushing the Limits of Open Data-efficient Language Model (2025.acl-long)
Copied to clipboard
Hu Yiwen, Huatong Song, Jie Chen, Jia Deng, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Zican Dong, Yang Lu, Xu Miao, Xin Zhao, Ji-Rong Wen
| Challenge: | prevailing pre-training approaches for large language models involve several complexities. |
| Approach: | They propose a low-cost training recipe and a robust optimization approach to mitigate training instability . they also propose synthesis, curriculum, and data selection pipelines to integrate data . |
| Outcome: | The proposed model achieves top-tier performance among models with similar parameter scale . it is comparable to industry-leading models that require significantly more data . |
Automatic Slide Updating with User-Defined Dynamic Templates and Natural Language Instructions (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing automation methods follow fixed template filling and cannot support dynamic updates for diverse, user-authored decks. |
| Approach: | They propose a framework that combines multimodal slide parsing, natural language instruction grounding, and tool-augmented reasoning for tables, charts, and textual conclusions. |
| Outcome: | The proposed framework updates content while preserving layout and style while maintaining a strong reference baseline on DynaSlide. |
DeMAC: Enhancing Multi-Agent Coordination with Dynamic DAG and Manager-Player Feedback (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multi-agent systems (MAS) powered by large language models struggle to adapt to evolving task dependencies and to handle uncertainties. |
| Approach: | They propose a Dynamic Environment-Aware Manager-Player Agents Coordination framework that enhances multi-agent coordination through long-term strategic planning. |
| Outcome: | The proposed framework outperforms traditional reinforcement learning and human-agent collaboration in the Overcooked simulation. |
CoRec: An Easy Approach for Coordination Recognition (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing syntactic parsers are slow and suffer from errors, especially for long and complicated sentences. |
| Approach: | They propose a pipeline model COordination RECognizer with coordinator identifier and conjunct boundary detector. |
| Outcome: | The proposed model improves the yield of state-of-the-art Open IE models by reducing errors and slow processing time. |
MAViS: A Multi-Agent Framework for Long-Sequence Video Storytelling (2026.eacl-long)
Copied to clipboard
| Challenge: | Experimental results show that MAViS achieves state-of-the-art performance in assistive capability, visual quality, and video expressiveness. |
| Approach: | They propose an end-to-end multi-agent collaborative framework for long-sequence video storytelling that orchestrates specialized agents across multiple stages. |
| Outcome: | The proposed framework achieves state-of-the-art performance in assistive capability, visual quality, and video expressiveness. |
Internal Value Alignment in Large Language Models through Controlled Value Vector Activation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing LLMs do not possess consistent values, but many have been developed to align them at the behavioral level, including supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF). |
| Approach: | They propose a Controlled Value Vector Activation method that directly aligns the internal values of Large Language Models by interpreting how a value is encoded in their latent representations. |
| Outcome: | The proposed method achieves highest success rate across 10 basic values without hurting model performance and fluency, and ensures target values even with opposite and potentially malicious input prompts. |
AutoRAG-HP: Automatic Online Hyper-Parameter Tuning for Retrieval-Augmented Generation (2024.findings-emnlp)
Copied to clipboard
Jia Fu, Xiaoting Qin, Fangkai Yang, Lu Wang, Jue Zhang, Qingwei Lin, Yubo Chen, Dongmei Zhang, Saravan Rajmohan, Qi Zhang
| Challenge: | Recent advances in Large Language Models have transformed ML/AI development . a reevaluation of AutoML principles for Retrieval-Augmented Generation (RAG) systems is needed. |
| Approach: | They propose a framework for hyper-parameter tuning and a hierarchical MAB method for efficient exploration of large search spaces. |
| Outcome: | The proposed framework outperforms baseline methods in more challenging optimization scenarios. |
Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Data (N19-1)
Copied to clipboard
| Challenge: | Neural machine translation systems have become state-of-the-art approaches for Grammatical Error Correction (GEC) task. |
| Approach: | They propose a copy-augmented architecture for the Grammatical Error Correction task by copying unchanged words from the source sentence to the target sentence. |
| Outcome: | The proposed architecture outperforms all recently published state-of-the-art results by a large margin. |
Deep Differential Amplifier for Extractive Summarization (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to extract summary from document with a disproportionate ratio of selected and unselected sentences are far from human performance. |
| Approach: | They propose a model that rebalances sentence-level extractive summarization by amplifying the semantic difference between each sentence and all other sentences and applying the residual unit as the second item of the differential amplifier to deepen the architecture. |
| Outcome: | The proposed model performs competitively against state-of-the-art methods on two benchmark datasets. |
UCL-Bench: A Chinese User-Centric Legal Benchmark for Large Language Models (2025.findings-naacl)
Copied to clipboard
Ruoli Gan, Duanyu Feng, Chen Zhang, Zhihang Lin, Haochen Jia, Hao Wang, Zhenyang Cai, Lei Cui, Qianqian Xie, Jimin Huang, Benyou Wang
| Challenge: | Existing legal benchmarks focusing on knowledge and logic evaluate LLMs on various tasks in legal domain, but few have explored the practical application of LLM by actual users. |
| Approach: | They propose a Chinese user-centric legal benchmark that aims to assess the practical application of LLMs by real users. |
| Outcome: | The proposed model outperforms existing models on various tasks in legal domain but does not outperfect ChatGPT. |
Hierarchical-Task-Aware Multi-modal Mixture of Incremental LoRA Experts for Embodied Continual Learning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing continual learning setups for embodied intelligence focus on executing low-level actions, neglecting the ability to learn high-level planning and multi-level knowledge. |
| Approach: | They propose a Hierarchical Embodied Continual Learning Setups (HEC) that divides the agent’s continual learning process into two layers: high-level instructions and low-level actions. |
| Outcome: | The proposed method reduces the forgetting of old tasks compared to other methods, while orthogonally training the remaining parts. |
Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs (2026.findings-acl)
Copied to clipboard
Linhao Zhang, Yuhan Song, Aiwei Liu, Chuhan Wu, Sijun Zhang, Wei Jia, Yuan Liu, Houfeng Wang, Zhou Xiao
| Challenge: | Recent Audio Large Language Models (AudioLLMs) excel at reasoning tasks, but struggle at elementary auditory perception. |
| Approach: | They propose a framework that organizes audio information into three explicit components in a unified JSON format. |
| Outcome: | The proposed framework boosts fine-grained perception by 10.9% on MMSU over state-of-the-art models while preserving robust reasoning capabilities. |
Enhancing Learning-Based Binary Code Similarity Detection Model through Adversarial Training with Multiple Function Variants (2024.findings-emnlp)
Copied to clipboard
Lichen Jia, Chenggang Wu, Bowen Tang, Peihua Zhang, Zihan Jiang, Yang Yang, Ning Liu, Jingfeng Zhang, Zhe Wang
| Challenge: | Existing Learning-Based Binary Code Similarity Detection (LB-BCSD) methods exhibit lower accuracy in recognizing functions with the same functionality but different implementations. |
| Approach: | They propose a gradient-guided adversarial attack method based on critical code called FuncFooler which perturbs critical code to generate multiple variants of the same function. |
| Outcome: | The proposed method increases the accuracy of the current Learning-Based Binary Code Similarity Detection (LB-BCSD) model by 5%-7%. |
OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis (2025.acl-long)
Copied to clipboard
Qiushi Sun, Kanzhi Cheng, Zichen Ding, Chuanyang Jin, Yian Wang, Fangzhi Xu, Zhenyu Wu, Chengyou Jia, Liheng Chen, Zhoumianze Liu, Ben Kao, Guohao Li, Junxian He, Yu Qiao, Zhiyong Wu
| Challenge: | Graphical User Interface (GUI) agents powered by Vision-Language Models (VLMs) have demonstrated human-like computer control capability. |
| Approach: | They propose a GUI data synthesis pipeline that reverse engineers GUI trajectory construction process by executing pre-defined tasks. |
| Outcome: | The proposed GUI data synthesis pipeline overcomes the bottlenecks of previous methods that rely on pre-defined tasks and limited data diversity. |
EvoCoT: Overcoming the Exploration Bottleneck in Reinforcement Learning for LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to reinforcement learning with verifiable reward (RLVR) are limited by difficulty or lack of exploration. |
| Approach: | They propose a self-evolving curriculum learning framework based on chain-of-thought reasoning optimization that constrains exploration space by self-generating and verifying CoT trajectories. |
| Outcome: | The proposed framework enables LLMs to solve previously unsolved problems without external supervision and is compatible with various RL fine-tuning methods. |
HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generation (2022.acl-long)
Copied to clipboard
Zhoujun Cheng, Haoyu Dong, Zhiruo Wang, Ran Jia, Jiaqi Guo, Yan Gao, Shi Han, Jian-Guang Lou, Dongmei Zhang
| Challenge: | Existing studies on table reasoning focus on flat tables and hierarchical tables . a new dataset, HiTab, aims to examine numerical reasoning over hierarchic tables based on hierarchically structured tables - a strong challenge for existing baselines and a valuable benchmark for future research. |
| Approach: | They propose a hierarchical question answering and natural language generation dataset to study hierarchic tables. |
| Outcome: | The proposed model shows that it is effective in QA and natural language generation over hierarchical tables. |
JX4MEI: Multimodal Semantically-Enhanced LLM for Joint Multimodal Emotion-Intent Explanation and Classification (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing multimodal emotion and intent recognition tasks focus on classification, not rationale and intrinsic connections between these states. |
| Approach: | They propose a task that requires models to jointly predict emotion and intent while generating natural language explanations for why they co-occur. |
| Outcome: | The proposed model outperforms baseline models in prediction and explanation generation. |
Rapid Diffusion: Building Domain-Specific Text-to-Image Synthesizers with Fast Inference Speed (2023.acl-industry)
Copied to clipboard
Bingyan Liu, Weifeng Lin, Zhongjie Duan, Chengyu Wang, Wu Ziheng, Zhang Zipeng, Kui Jia, Lianwen Jin, Cen Chen, Jun Huang
| Challenge: | Text-to-Image Synthesis (TIS) aims to generate images based on textual inputs . but, current diffusion-based models lack entity knowledge and low inference speed . |
| Approach: | They propose a framework for training and deploying latent diffusion models with rich entity knowledge injected and optimized networks. |
| Outcome: | The proposed framework improves image quality and inference speed and can be used in industrial applications. |
Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skills (2025.emnlp-main)
Copied to clipboard
Changsheng Wang, Chongyu Fan, Yihua Zhang, Jinghan Jia, Dennis Wei, Parikshit Ram, Nathalie Baracaldo, Sijia Liu
| Challenge: | Existing methods for LRM unlearning overlook critical information leakage in reasoning traces, even when final answers are successfully removed. |
| Approach: | They propose a method that suppresses reasoning traces while preserving the model's general reasoning ability. |
| Outcome: | The proposed method significantly reduces reasoning trace leakage and achieves strong performance across reasoning and safety benchmarks, including WMDP, StrongReject, JBB-Behaviors and WildJailbreak. |
Towards Making the Most of Cross-Lingual Transfer for Zero-Shot Neural Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing unsupervised neural machine translation systems can degrade when labeled data is limited. |
| Approach: | They propose a multilingual pretraining and multilingual fine-tuning for facilitating cross-lingual transfer in zero-shot translation using a parallel dataset. |
| Outcome: | The proposed model outperforms state-of-the-art models on many-to-English translation by over 7.2 and 5.0 BLEU. |
Document Set Expansion with Positive-Unlabeled Learning Using Intractable Density Estimation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to Document Set Expansion (DSE) rely on the unrealistic assumption of knowing the class prior for positive samples in the collection. |
| Approach: | They propose a novel method that utilizes intractable density estimation models to learn the class prior for positive samples in the collection. |
| Outcome: | The proposed method is based on a set of examples from PubMed and Covid datasets in a transductive setting. |
EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphs (2025.coling-main)
Copied to clipboard
Zixuan Dong, Baoyun Peng, Yufei Wang, Jia Fu, Xiaodong Wang, Xin Zhou, Yongxue Shan, Kangchen Zhu, Weiguo Chen
| Challenge: | Existing approaches that integrate LLMs and KGs either underutilize the reasoning abilities of LLM or suffer from prohibitive computational costs due to tight coupling. |
| Approach: | They propose a framework that can strike a balance between performance and efficiency via an iterative paradigm. |
| Outcome: | The proposed framework can strike a balance between performance and efficiency via an iterative paradigm. |
Orca: A Few-shot Benchmark for Chinese Conversational Machine Reading Comprehension (2023.findings-emnlp)
Copied to clipboard
Nuo Chen, Hongguang Li, Junqing He, Yinan Bao, Xinshi Lin, Qi Yang, Jianfeng Liu, Ruyi Gan, Jiaxing Zhang, Baoyuan Wang, Jia Li
| Challenge: | Existing benchmarks for conversational machine reading comprehension are inconsistent with real scenarios. |
| Approach: | They propose to use a Chinese CMRC benchmark to evaluate model's generalization ability towards diverse domains by using zero-shot/few-shot settings. |
| Outcome: | The proposed benchmarks are based on 831 hot-topic driven conversations with 4,742 turns and cover 33 domains. |
Compress to Impress: Unleashing the Potential of Compressive Memory in Real-World Long-Term Conversations (2025.coling-main)
Copied to clipboard
| Challenge: | Existing retrieval-based methods for long-term conversations face challenges in memory database management and accurate memory retrieval, hindering their efficacy in dynamic, real-world interactions. |
| Approach: | They propose a framework that eschews traditional retrieval modules and memory databases and adopts a “One-for-All” approach to manage memory generation, compression, and response generation. |
| Outcome: | The proposed framework produces more nuanced and human-like experiences than retrieval-based methods. |
LegalAgentBench: Evaluating LLM Agents in Legal Domain (2025.acl-long)
Copied to clipboard
Haitao Li, Junjie Chen, Jingli Yang, Qingyao Ai, Wei Jia, Youfeng Liu, Kai Lin, Yueyue Wu, Guozhi Yuan, Yiran Hu, Wuyue Wang, Yiqun Liu, Minlie Huang
| Challenge: | Existing general-domain benchmarks do not capture complexity of real-world judicial cognition and decision-making. |
| Approach: | They propose a benchmark specifically designed to evaluate LLM Agents in the legal domain. |
| Outcome: | The proposed benchmark includes 17 corpora from real-world legal scenarios and provides 37 tools for interacting with external knowledge. |
Linking Adaptive Structure Induction and Neuron Filtering: A Spectral Perspective for Aspect-based Sentiment Analysis (2024.lrec-main)
Copied to clipboard
| Challenge: | incorporating structure information can improve the performance of aspect-based sentiment analysis. |
| Approach: | They propose a method to conduct neuron-level manipulations on word representations in the frequency domain. |
| Outcome: | The proposed method can achieve or come close to state-of-the-art in ABSA. |
FinMRAGBench: A Realistic and Complex Benchmark for Multi-Modal RAG in Financial Document Analysis (2026.findings-acl)
Copied to clipboard
Shouqing Yang, Qi Zhang, Yuhang Yang, Ruikang Xu, Yuwei Hou, Zhulin Jia, Lirong Gao, Haobo Wang, Jinglei Chen, Jiexiang Wang, Sheng Guo, Bo Zheng, Gang Chen
| Challenge: | Existing benchmarks for realistic financial analysis fail to capture realistic financial situations involving cross-document retrieval, multi-page evidence integration, and diverse analytical tasks. |
| Approach: | They propose a multi-modal financial RAG benchmark that evaluates large language models in realistic financial analysis settings. |
| Outcome: | The proposed framework achieves the strongest overall performance across all models. |
ITA: Image-Text Alignments for Multi-Modal Named Entity Recognition (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent work on Multi-modal Named Entity Recognition (MNER) relies on image information to model interactions between image and text representations. |
| Approach: | They propose to align image features into the textual space to better utilize attention mechanisms . they use regional object tags, captions and optical characters as visual contexts . |
| Outcome: | The proposed model can achieve state-of-the-art accuracy on multi-modal Named Entity Recognition datasets even without image information. |
The Agent’s First Day: Benchmarking Learning, Exploration, and Scheduling in the Workplace Scenarios (2026.findings-acl)
Copied to clipboard
Daocheng Fu, Jianbiao Mei, Rong Wu, Xuemeng Yang, Jia Xu, Ding Wang, Pinlong Cai, Yong Liu, Licheng Wen, Botian Shi
| Challenge: | Existing research mainly focuses on performance upper bounds in static environments, overlooking stochastic real-world deployment. |
| Approach: | They propose a dynamic evaluation environment that simulates a "trainee" agent continuously exploring a novel setting. |
| Outcome: | The proposed model evaluates agents in a dynamic evaluation environment that simulates a "trainee" agent continuously exploring a novel setting. |
ODTQA-FoRe: An Open-Domain Tabular Question Answering Dataset for Future Data Forecasting and Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing tabular question answering systems cannot perform future-oriented numerical prediction . open-domain tabular questions are a popular approach for QA tasks . |
| Approach: | They propose a task that covers time-series forecasting and forecast-based reasoning scenarios using real estate data. |
| Outcome: | The proposed framework decomposes the problem into three collaborative roles that synthesize the results to construct a precise and consistent final answer. |
Decoding Knowledge Attribution in Mixture-of-Experts: A Framework of Basic-Refinement Collaboration and Efficiency Analysis (2025.acl-long)
Copied to clipboard
| Challenge: | Existing attribution methods for dense models fail to capture dynamic routing-expert interactions in sparse MoE architectures. |
| Approach: | They propose to analyze sparse MoE architectures against dense models to capture dynamic routing-expert interactions. |
| Outcome: | The proposed algorithm shows that sparse models achieve higher efficiency per layer . it also shows that deep Qwen-MoE mitigates expert failures while minimizing complexity . |
RSDA: Restoring Stale Data Affinity via Dynamic Renovation Strategy for Mitigating Data Scarcity (2026.acl-long)
Copied to clipboard
Yidan Liang, Jia Zhu, Weijie Shi, Hanghui Guo, Yue Cui, Jiawei Shen, Guoqing Ma, Jingjiang Liu, Qingyu Niu, Yilin Wang, Shimin Di, Jiajie Xu
| Challenge: | High-quality data is the cornerstone of advancing large language models, but the supply of premium data is nearing depletion, while vast stale corpora remain underutilized. |
| Approach: | They propose a framework to restore stale data affinity by quantifying the latent value of samples and employing a dynamic renovation strategy selection mechanism to determine the optimal component-level strategy. |
| Outcome: | The proposed framework achieves performance improvements using less than 10% of the data volume, underscoring that the latent potential of stale corpora remains largely untapped. |
Can LLMs Act as Historians? Evaluating Historical Research Capabilities of LLMs via the Chinese Imperial Examination (2026.acl-long)
Copied to clipboard
Lirong Gao, Zeqing Wang, Yuyan Cai, Jiayi Deng, Yanmei Gu, Yiming Zhang, Jia Zhou, Yanfei Zhang, Junbo Zhao
| Challenge: | Existing benchmarks assess basic knowledge breadth or lexical understanding, failing to capture higher-order skills that are central to historical research. |
| Approach: | They propose a benchmark anchored in the Chinese Imperial Examination system that assesses historical knowledge and lexical understanding. |
| Outcome: | The new benchmark aims to assess the ability of LLMs to process historical materials and documents. |
CTR-Guided Generative Query Suggestion in Conversational Search (2025.emnlp-industry)
Copied to clipboard
Erxue Min, Hsiu-Yuan Huang, Xihong Yang, Min Yang, Xin Jia, Yunfang Wu, Hengyi Cai, Junfeng Wang, Shuaiqiang Wang, Dawei Yin
| Challenge: | Generating effective query suggestions requires aligning model outputs with user click preferences. |
| Approach: | They propose a generative framework that leverages click modeling to denoise implicit feedback and enables reliable preference optimization for improving real-world user engagement. |
| Outcome: | The proposed framework outperforms strong baselines in CTR, relevance, diversity and diversity. |
One Shot Dominance: Knowledge Poisoning Attack on Retrieval-Augmented Generation Systems (2025.findings-emnlp)
Copied to clipboard
Zhiyuan Chang, Mingyang Li, Xiaojun Jia, Junjie Wang, Yuekai Huang, Ziyou Jiang, Yang Liu, Qing Wang
| Challenge: | Existing knowledge poisoning attacks against RAG systems require multiple poisoned documents or can only function effectively on simplistic queries. |
| Approach: | They propose a more realistic knowledge poisoning attack that poisons only a single document while remaining effective for complex multi-hop questions involving complex relationships between multiple elements. |
| Outcome: | The proposed attack achieves success by poisoning only a single document while remaining effective for complex multi-hop questions involving complex relationships between multiple elements. |
R-Search: Empowering LLM Reasoning with Search via Multi-Reward Reinforcement Learning (2026.findings-acl)
Copied to clipboard
Qingfei Zhao, Ruobing Wang, Dingling Xu, Daren Zha, Ma Bowen, Zhichun Wang, Shijie Jia, Limin Liu, Xin Wang
| Challenge: | Large language models (LLMs) have demonstrated impressive capabilities in multi-step and long-chain reasoning, but extending their reasoning capabilities to encompass deep interactions with search remains a non-trivial challenge. |
| Approach: | They propose a framework for Reasoning–Search integration that integrates multi-reward signals to optimize the reasoning–search interaction trajectories. |
| Outcome: | Experiments on seven datasets show that R-Search significantly outperforms mainstream RAG baselines. |
KCVR: Knowledge-Centric Video Reconstruction for Structured Pedagogical Summarization via Dynamic Graph Planning (2026.acl-long)
Copied to clipboard
Jingjiang Liu, Jia Zhu, Hanghui Guo, Weijie Shi, Yue Cui, Xiaokang Jin, Yilin Wang, Qingyu Niu, Jiawei Shen, Guoqing Ma, Yidan Liang, Shimin Di, Jiajie Xu
| Challenge: | Existing summarization methods compress content for gist browsing, but they break prerequisite logic in instructional videos. |
| Approach: | They propose a framework that decouples epistemic planning from content generation. |
| Outcome: | The proposed framework outperforms strong end-to-end baselines on Knowledge Progression Consistency and Learning Objective Coverage. |
MirrorQA: Benchmarking Multimodal LLMs on Mirror-Orientation Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Multimodal large language models (MLLMs) have achieved remarkable progress in recent years, yet their ability to perform left–right reasoning in mirror contexts remains underexplored. |
| Approach: | They propose a benchmark to evaluate MLLMs' ability to distinguish left from right from a subject-centered perspective. |
| Outcome: | The proposed benchmarks show that even the best performing models achieve only 65.40% accuracy, far below the 99.28% accuracy of humans. |
ODUTQA-MDC: A Task for Open-Domain Underspecified Tabular QA with Multi-turn Dialogue-based Clarification (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to tabular QA are limited to closed-domain scenarios . existing approaches do not solve the core challenge of generating correct answers without user clarification . |
| Approach: | They propose a benchmark to tackle underspecified or uncertain queries in tabular question answering . they propose ODUTQA-MDC task and a multi-agent framework to detect ambiguities . |
| Outcome: | The proposed framework excels at detecting ambiguities, clarifying them through dialogue, and refining answers. |
HSCodeComp: A Realistic and Expert-level Agent Benchmark for Hierarchical Rule Application (2026.acl-long)
Copied to clipboard
| Challenge: | Existing agent benchmarks neglect hierarchical rule application in real-world domains . a critical gap persists in numerous real-life professional domains where decision-making is governed by expert-written rules. |
| Approach: | They propose a benchmark requiring agents to assign a unique 10-digit Harmonized System (HS) Code to products by aligning their fuzzy attributes with strict tariff classification rules. |
| Outcome: | The proposed benchmarks lack hierarchical rule application capability in real-world domains . the proposed benchmark is based on e-commerce and is open-source . |
On Continual Model Refinement in Out-of-Distribution Data Streams (2022.acl-long)
Copied to clipboard
| Challenge: | Existing continual learning (CL) problems cannot cover real-world scenarios such as out-of-distribution errors. |
| Approach: | They propose a continual model refinement problem formulation to solve this problem . they extend several existing continual learning approaches to the CMR problem based on a general sampling algorithm . |
| Outcome: | The proposed model refinement solution improves on existing models and their performance metrics. |
MultiDx: A Multi-Source Knowledge Integration Framework towards Diagnostic Reasoning (2026.findings-acl)
Copied to clipboard
Yimin Deng, Zhenxi Lin, Yejing Wang, Guoshuai Zhao, Pengyue Jia, Zichuan Fu, Derong Xu, Yefeng Zheng, Xiangyu Zhao, Li Zhu, Xian Wu, Xueming Qian
| Challenge: | Existing approaches focus on diagnostic reasoning based on internal model knowledge or static knowledge bases. |
| Approach: | They propose a two-stage diagnostic reasoning framework that integrates multi-perspective evidence to generate a diagnostic prediction. |
| Outcome: | The proposed method generates suspected diagnoses and reasoning traces from web search, SOAP-formatted case, and clinical case database. |
H-MAS: Hierarchical Multi-Agent Scheduling for Multi-Tenant LLM Serving (2026.findings-acl)
Copied to clipboard
Yuhan Liu, Cong Xu, Qi Jia, Yihua Wang, Feiyu Chen, Liang Jin, Lu Liu, Yaqian Zhao, Yuting Ding, Xiang Li
| Challenge: | Multi-tenant Model-as-a-Service (MaaS) workloads exhibit non-stationarity across multiple time scales . existing request schedulers often rely on a fixed policy that remains unchanged at runtime . |
| Approach: | They propose a hierarchical multi-agent scheduler that operates in a layered closed loop . they propose to maintain 1.2–3.0 higher Goodput than SGLang and vLLM . |
| Outcome: | Experiments show that H-MAS achieves 1.2–3.0 higher Goodput than SGLang and vLLM . it maintains more stable QoS under diverse request lengths and heterogeneous SLO targets . |
Explicit and Implicit Data Augmentation for Social Event Detection (2025.acl-long)
Copied to clipboard
| Challenge: | Social event detection relies on labeled data, but annotation is costly and labor-intensive. |
| Approach: | They propose a plug-and-play dual augmentation framework that combines explicit text-based and implicit feature-space augmentation to enhance data diversity and model robustness. |
| Outcome: | The proposed framework outperforms the best baseline model by 17.67% on the Twitter2012 dataset and 15.57% on the twitter2018 dataset in terms of the average F1 score. |
Know Thy Enemy: Securing LLMs Against Prompt Injection via Diverse Data Synthesis and Instruction-Level Chain-of-Thought Learning (2026.findings-acl)
Copied to clipboard
Zhiyuan Chang, Mingyang Li, Yuekai Huang, Ziyou Jiang, Xiaojun Jia, Qian Xiong, Junjie Wang, Zhaoyang Li, Qing Wang
| Challenge: | Large language model (LLM)-integrated applications face security vulnerabilities from prompt injection (PI) attacks. |
| Approach: | They propose a model enhancement method that synthesizes diverse training data and employs instruction-level chain-of-thought fine-tuning to enable LLMs to effectively identify and reject malicious instructions regardless of their source or position in the context. |
| Outcome: | The proposed method outperforms baselines in three critical dimensions while maintaining utility performance without degradation. |
TokenSmith: Streamlining Data Editing, Search, and Inspection for Large-Scale Language Model Training and Interpretability (2025.emnlp-demos)
Copied to clipboard
Mohammad Aflah Khan, Ameya Godbole, Johnny Wei, Ryan Yixiang Wang, James Flemings, Krishna P. Gummadi, Willie Neiswanger, Robin Jia
| Challenge: | Existing workflows for pretraining large language models are cumbersome, fragmented and inaccessible. |
| Approach: | They propose an open-source library for editing, inspection, and analysis of large language model datasets. |
| Outcome: | TokenSmith is an open-source library for editing, inspection, and analysis of large language model datasets. |
KG-FLIP: Knowledge-guided Fashion-domain Language-Image Pre-training for E-commerce (2023.acl-industry)
Copied to clipboard
| Challenge: | Various visionlanguage pre-training (VLP) models learn cross-modal alignment from large-scale well-aligned image-text datasets without leveraging external knowledge. |
| Approach: | They propose a knowledge-guided fashion-domain language-image pre-training framework that learns fine-grained representations in e-commerce domain and utilizes external knowledge to improve the pre-train efficiency. |
| Outcome: | The proposed framework outperforms state-of-the-art models on Amazon and Fashion-Gen datasets by large margins. |
Data Boost: Text Data Augmentation Through Reinforcement Learning Guided Conditional Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for data augmentation produce low readability or semantic consistency. |
| Approach: | They propose a framework which augments data through reinforcement learning guided conditional generation. |
| Outcome: | The proposed framework improves F1 performance on three different classification tasks by 8.7% on average when given only 10% of the whole data for training. |
RCBSF: A Multi-Agent Framework for Automated Contract Revision via Stackelberg Game (2026.findings-acl)
Copied to clipboard
| Challenge: | despite the adoption of Large Language Models (LLMs), contract revision remains impeded because generic models treat strict legal constraints as mere suggestions. |
| Approach: | They propose a risk-constrained bilevel Stackelberg framework that models high-stakes revision as a strategic interaction rather than an open-ended conversation. |
| Outcome: | The proposed framework achieves state-of-the-art performance with an average RRR of 84.21% and enhanced token efficiency. |
KoCo-Bench: Can Large Language Models Leverage Domain Knowledge in Software Development? (2026.acl-long)
Copied to clipboard
Xue Jiang, Ge Li, Jiaru Qian, Xianjie Shi, Chenjie Li, Hao Zhu, Ziyu Wang, Jielun Zhang, Zeyu Zhao, Kechi Zhang, Jia Li, Wenpin Jiao, Zhi Jin, Yihong Dong
| Challenge: | Existing domain-specific code benchmarks focus on assessing what knowledge LLMs possess rather than how they acquire and apply new knowledge. |
| Approach: | They propose a benchmark to evaluate domain specialization methods in real-world software development. |
| Outcome: | KOCO-bench is a new benchmark for evaluating domain specialization methods in real-world software development. |
Beyond the Individual: Virtualizing Multi-Disciplinary Reasoning for Clinical Intake via Collaborative Agents (2026.findings-acl)
Copied to clipboard
Huangwei Chen, Wu Li, Junhao Jia, Yining Chen, Xiaotao Pang, Ya-Long Chen, Li Gonghui, Haishuai Wang, Jiajun Bu, Lei Wu
| Challenge: | Initial outpatient consultations are costly and difficult to scale to real-time intake. |
| Approach: | They propose a synchronous virtual MDT framework that formalizes the consultation state using a structured SOAP representation, separating evidence collection from diagnostic reasoning to improve traceability and bias control. |
| Outcome: | The proposed framework outperforms state-of-the-art models on ClinicalBench and a real-world RAPID-IPN dataset in documentation quality and consultation capability. |
LifeQA: A Real-life Dataset for Video Question Answering (2020.lrec-1)
Copied to clipboard
Santiago Castro, Mahmoud Azab, Jonathan Stroud, Cristina Noujaim, Ruoyao Wang, Jia Deng, Rada Mihalcea
| Challenge: | Existing video question answering datasets consist of movies and TV shows, but they are not representative of our day-to-day lives. |
| Approach: | They propose a benchmark dataset for video question answering that focuses on day-to-day situations. |
| Outcome: | The proposed dataset analyzes the challenging but realistic aspects of LifeQA . it consists of video clips and over 2.3k multiple-choice questions . |
Weights-Rotated Preference Optimization for Large Language Models (2025.emnlp-main)
Copied to clipboard
Chenxu Yang, Ruipeng Jia, Mingyu Zheng, Naibin Gu, Zheng Lin, Siyuan Chen, Weichong Yin, Hua Wu, Weiping Wang
| Challenge: | Existing methods to align large language models with high reward hacking are limited by the complexity of the parameter space and the complexity. |
| Approach: | They propose a weights-rotated preference optimization algorithm that constrains the output layer logits with the KL divergence inherited from DPO and fine-tunes the intermediate hidden states. |
| Outcome: | The proposed algorithm achieves a 3.27-point improvement on AlpacaEval 2 and surpasses the best baseline by 6.2 to 7.5 points on MT-Bench with merely 0.015% of the trainable parameters. |
Efficient End-to-End Visual Document Understanding with Rationale Distillation (2024.naacl-long)
Copied to clipboard
| Challenge: | Pre-processing tools such as optical character recognition (OCR) can map document image inputs to textual tokens, then large language models (LLMs) can reason over text. |
| Approach: | They propose a method that integrates outputs of OCR tools and larger multimodal models as intermediate "rationales" a student model is trained to predict rationales and answers based on visual documents . |
| Outcome: | The proposed model outperforms the base model on three visual document understanding benchmarks with only 1% higher computational cost. |
Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence (2025.acl-long)
Copied to clipboard
Jinghan He, Kuan Zhu, Haiyun Guo, Junfeng Fang, Zhenglin Hua, Yuheng Jia, Ming Tang, Tat-Seng Chua, Jinqiao Wang
| Challenge: | Existing methods focus on alignment training or decoding refinements but address symptoms at the generation stage without probing the underlying causes. |
| Approach: | They propose a training-free approach to mitigate hallucination by enhancing the role of vision-aware attention heads. |
| Outcome: | The proposed method achieves superior performance compared to state-of-the-art approaches in mitigating hallucinations while maintaining high efficiency with negligible additional time overhead. |
StepCoder: Improving Code Generation with Reinforcement Learning from Compiler Feedback (2024.acl-long)
Copied to clipboard
Shihan Dou, Yan Liu, Haoxiang Jia, Enyu Zhou, Limao Xiong, Junjie Shan, Caishuang Huang, Xiao Wang, Xiaoran Fan, Zhiheng Xi, Yuhao Zhou, Tao Ji, Rui Zheng, Qi Zhang, Tao Gui, Xuanjing Huang
| Challenge: | Existing work integrates reinforcement learning with compiler feedback to enhance code generation quality but the long code generated by LLMs makes RL exploration ineffective. |
| Approach: | They propose a framework that integrates reinforcement learning and compiler feedback to enhance code generation quality. |
| Outcome: | The proposed framework outperforms state-of-the-art approaches in corresponding benchmarks and integrates reinforcement learning with compiler feedback to improve code generation quality. |
Q-Tuning: Queue-based Prompt Tuning for Lifelong Few-shot Language Learning (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for continual prompt tuning are limited by the ever-growing parameter scale of modern language models (e.g., GPT-4 that may have 1.76 trillion parameters). |
| Approach: | They propose a method for continual prompt tuning that enables the lifelong learning of a pre-trained language model by adding a task-specific prompt to a queue of older tasks. |
| Outcome: | The proposed method outperforms the state-of-the-art methods substantially on continual prompt tuning benchmarks. |
Self-Correcting RAG: Enhancing Faithfulness via MMKP Context Selection and NLI-Guided MCTS (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to retrieval-augmented generation still face problems with low context utilization and frequent hallucinations. |
| Approach: | They propose a framework that reformulates retrieval and generation as constrained optimization and path planning. |
| Outcome: | The proposed framework significantly improves reasoning accuracy on complex queries while reducing hallucinations. |
VulAgent: Hypothesis-Validation Driven Multi-Agent Architecture for Vulnerability Detection (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent reports indicate that software vulnerabilities caused by insecure coding practices remain a major security threat. |
| Approach: | They propose a multi-agent vulnerability detection framework based on hypothesis validation . they use multi-view analyzers to localize and localize security-sensitive operations . |
| Outcome: | The proposed framework reduces false positives and increases accuracy by 6.6 percentage points on PrimeVul and SVEN. |
SocioBench: Modeling Human Behavior in Sociological Surveys with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) lack large-scale, systematically constructed benchmarks for evaluating their alignment with real-world social attitudes. |
| Approach: | They propose a benchmark to assess LLMs' alignment with real-world social attitudes . they find LLM models achieve only 30–40% accuracy when simulating individuals . |
| Outcome: | The proposed benchmark shows that LLMs achieve only 30% accuracy when simulating individuals in complex survey scenarios. |
Look Both Ways and No Sink: Converting LLMs into Text Encoders without Training (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for converting large language models into powerful text encoders require extensive training on large datasets. |
| Approach: | They propose a training-free approach that enables bidirectional attention and suppresses the attention sink phenomenon, resulting in superior performance. |
| Outcome: | The proposed approach enables bidirectional attention and suppresses the attention sink phenomenon, resulting in superior performance. |
GenProve: Learning to Generate Text with Fine-Grained Provenance (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for large language models (LLMs) are coarse-grained and fail to distinguish between direct quotes and complex reasoning. |
| Approach: | They propose a framework that combines supervised fine-tuning and group relative policy optimization to generate fluent answers while simultaneously producing sentence-level provenance triples. |
| Outcome: | The proposed framework outperforms 14 strong large language models in joint evaluation. |
Denoising based Sequence-to-Sequence Pre-training for Text Generation (D19-1)
Copied to clipboard
| Challenge: | PoDA pre-trains encoders and decoders by denoising noise-corrupted text . Unlike encoder-only or decode-only methods, it can be used for text generation tasks without using any task-specific techniques. |
| Approach: | They propose a sequence-to-sequence (seq2sequ) pre-training method PoDA which denoises autoencoders by denoising noise-corrupted text. |
| Outcome: | The proposed method improves model performance over strong baselines without using any task-specific techniques and significantly speed up convergence. |
Stepwise Reasoning Disruption Attack of LLMs (2025.acl-long)
Copied to clipboard
Jingyu Peng, Maolin Wang, Xiangyu Zhao, Kai Zhang, Wanyu Wang, Pengyue Jia, Qidong Liu, Ruocheng Guo, Qi Liu
| Challenge: | Existing attacks on LLM reasoning are constrained by specific settings or lack of imperceptibility, limiting their feasibility and generalizability. |
| Approach: | They propose a stepwise rEasoning error disruption attack that subtly injects errors into prior reasoning steps to mislead the model into producing incorrect subsequent reasoning and final answers. |
| Outcome: | The proposed attack is compatible with zero-shot and few-shot settings, maintains the natural reasoning flow, and ensures covert execution without modification of the instruction. |
Dialect-SQL: An Adaptive Framework for Bridging the Dialect Gap in Text-to-SQL (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing Text-to-SQL research focuses on specific database systems, limiting adaptability to different dialects. |
| Approach: | They propose a framework that employs Object Relational Mapping (ORM) code as an intermediate language to bridge this gap. |
| Outcome: | The proposed framework outperforms existing methods that generate SQL queries directly. |
SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis (2025.findings-emnlp)
Copied to clipboard
Shuang Sun, Huatong Song, Yuhao Wang, Ruiyang Ren, Jinhao Jiang, Junjie Zhang, Fei Bai, Jia Deng, Xin Zhao, Zheng Liu, Lei Fang, Zhongyuan Wang, Ji-Rong Wen
| Challenge: | Existing approaches to deep search training lack high-quality training trajectories, prohibitive computational costs and lack of high-fidelity training data. |
| Approach: | They propose a framework that synthesizes high-quality training data by simulating real user interactions in live web search environments. |
| Outcome: | The proposed framework synthesizes high-quality training data by simulating user interactions in live web search environments. |
Generative Input: Towards Next-Generation Input Methods Paradigm (2024.findings-acl)
Copied to clipboard
| Challenge: | generative models have been used for various NLP tasks but their application in the field of input methods remains under-explored. |
| Approach: | They propose a novel Generative Input paradigm that uses prompts to handle all input scenarios and other intelligent auxiliary input functions, optimizing the model with user feedback. |
| Outcome: | The proposed paradigm achieves state-of-the-art in the Full-mode Key-sequence to Characters task and surpasses GPT-4 in the other input methods. |
HMCL: Task-Optimal Text Representation Adaptation through Hierarchical Contrastive Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Hierarchical Multilevel Contrastive Learning (HMCL) improves text representation for general large language models. |
| Approach: | a new contrastive learning framework is developed to improve general large language models . HMCL integrates 3-level semantic differentiation and unifies contrastive and pair classification into a strategy . |
| Outcome: | HMCL outperforms unsupervised methods and supervised fine-tuning approaches in multi-domain and multilingual benchmarks. |
Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Models (2025.findings-emnlp)
Copied to clipboard
Xiaojun Wu, Junxi Liu, Huan-Yi Su, Zhouchi Lin, Yiyan Qi, Chengjin Xu, Jiajun Su, Jiajie Zhong, Fuwei Wang, Saizhuo Wang, Fengrui Hua, Jia Li, Jian Guo
| Challenge: | Existing financial benchmarks suffer from limited language and task coverage, low-quality datasets, and inadequate adaptability for LLM evaluation. |
| Approach: | They propose a bilingual benchmark for financial LLMs that assesses models’ language understanding and generation capabilities. |
| Outcome: | The proposed bilingual benchmark assesses models’ language understanding and generation capabilities. |
CPRM: A LLM-based Continual Pre-training Framework for Relevance Modeling in Commercial Search (2025.naacl-industry)
Copied to clipboard
Kaixin Wu, Yixin Ji, Zeyuan Chen, Qiang Wang, Cunxiang Wang, Hong Liu, Baijun Ji, Xu Jia, Zhongyi Liu, Jinjie Gu, Yuan Zhou, Linjian Mo
| Challenge: | Relevance modeling between queries and items is a key component of commercial search engines. |
| Approach: | They propose a framework for continual pre-training of LLMs to enhance domain knowledge . they employ queries and multi-field item to jointly pre-train for enhancing domain knowledge. |
| Outcome: | The proposed model achieves convincing performance compared to strong baselines. |
SADA: Bridging In-Context Learning and Fine-Tuning via State-Aligned Distillation Adapters (2026.acl-long)
Copied to clipboard
| Challenge: | Prompt-based in-context learning and parameter fine-tuning are dominant paradigms for incorporating external information into large language models, but they incur high inference costs or require expensive retraining. |
| Approach: | They propose to convert prompts into temporary adapter weights to bridge this gap by converting prompts to temporary adapters. |
| Outcome: | The proposed model outperforms baselines on long-context language modeling and downstream NLU and summarization benchmarks while significantly reducing memory footprint and latency. |
PIPER: Benchmarking and Prompting Event Reasoning Boundary of LLMs via Debiasing-Distillation Enhanced Tuning (2025.acl-long)
Copied to clipboard
Zhicong Lu, Changyuan Tian, PeiguangLi PeiguangLi, Li Jin, Sirui Wang, Wei Jia, Ying Shen, Guangluan Xu
| Challenge: | Existing studies on Large Language Models (LLMs) have failed to evaluate their performance in event reasoning with a single event relational type or reasoning format. |
| Approach: | They propose a benchmark to evaluate LLMs' event reasoning capability using a single event relational type or reasoning format. |
| Outcome: | The proposed model improves on 10K diverse instruction-tuning demonstrations to alleviate event reasoning-oriented data scarcity. |
LAiW: A Chinese Legal Large Language Models Benchmark (2025.coling-main)
Copied to clipboard
Yongfu Dai, Duanyu Feng, Jimin Huang, Haochen Jia, Qianqian Xie, Yifang Zhang, Weiguang Han, Wei Tian, Hao Wang
| Challenge: | Xie et al., 2023) show that large language models (LLMs) can generate legal text, but lack the legal syllogism . legal experts are cautious about their practical application due to the opaque nature of the LLMs. |
| Approach: | They propose a Chinese legal LLM benchmark structured around the legal syllogism . they evaluate LLMs across three levels of capability, each reflecting a more complex stage of legal . |
| Outcome: | The proposed benchmark identifies that LLMs lack the legal syllogism, which hinders trust and understanding from legal experts. |
Logic Jailbreak: Efficiently Unlocking LLM Safety Restrictions Through Formal Logical Expression (2026.findings-acl)
Copied to clipboard
Jingyu Peng, Maolin Wang, Nan Wang, Jiatong Li, Yuchen Li, Yuyang Ye, Wanyu Wang, Pengyue Jia, Kai Zhang, Xiangyu Zhao
| Challenge: | Despite advances in aligning LLMs with human values, current safety mechanisms remain vulnerable to jailbreak attacks. |
| Approach: | They propose a black-box jailbreak method that uses logical expression translation to bypass LLM safety mechanisms. |
| Outcome: | The proposed method exploits the distributional gap between alignment data and logic-expressed inputs while preserving the underlying semantic intent and readability while evading safety constraints. |
Seek-and-Solve: Benchmarking MLLMs for Visual Clue-Driven Reasoning in Daily Scenarios (2026.findings-acl)
Copied to clipboard
Xiaomin Li, Tala Wang, Zichen Zhong, Ying Zhang, Zirui Zheng, Takashi Isobe, Dezhuang Li, Huchuan Lu, You He, Xu Jia
| Challenge: | Existing benchmarks focus on evaluating MLLMs’ pre-existing knowledge or perceptual understanding, often neglecting the critical capability of reasoning. |
| Approach: | They propose a benchmark designed for visual clue-driven reasoning in daily scenarios that combines rigorous grounding in authentic daily activities and challenging query design that necessitates more than surface-level perception. |
| Outcome: | The proposed benchmark identifies visual clues and their ability to provide robust reasoning in daily scenarios. |
Gen-SQL: Efficient Text-to-SQL By Bridging Natural Language Question And Database Schema With Pseudo-Schema (2025.coling-main)
Copied to clipboard
| Challenge: | Recent studies have shifted paradigms and leveraged Large Language Models (LLMs) to tackle the challenging task of Text-to-SQL. |
| Approach: | They propose a framework that leverages large language models to generate SQL queries . they exploit prior knowledge from the LLM to enhance embedding-based retriever . |
| Outcome: | The proposed method improves embedding-based retriever and reduces cost. |
SCOUT: Selective Coupling via Optimal Unbalanced Transport for Interpretable Text Classification (2026.acl-long)
Copied to clipboard
| Challenge: | Standard interpretable models often rely on scalar similarities that obscure the true evidentiary basis of a prediction. |
| Approach: | They propose a new paradigm that grounds prototype reasoning in the selective correspondence of discriminative fragments. |
| Outcome: | The proposed model outperforms rationale extraction and post-hoc attribution methods on seven benchmarks. |
Large Language Models Meet Harry Potter: A Dataset for Aligning Dialogue Agents with Characters (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models that can create open-domain dialogue agents lack character representation and annotations. |
| Approach: | They propose a dataset to study character alignment and character representation . it includes all dialogue sessions from the Harry Potter series and includes annotations . |
| Outcome: | The proposed dataset can be used as a universal benchmark for character-driven LLMs. |
PIArena: A Platform for Prompt Injection Evaluation (2026.acl-long)
Copied to clipboard
| Challenge: | OWASP identifies prompt injection as the top-1 security risk for large language models (LLMs). |
| Approach: | They propose a unified platform for prompt injection evaluation that integrates state-of-the-art attacks and defenses into a platform. |
| Outcome: | The proposed attack exploits state-of-the-art defenses and generalizes them on diverse datasets and attacks. |
Multi-Perspective Context Aggregation for Semi-supervised Cloze-style Reading Comprehension (C18-1)
Copied to clipboard
| Challenge: | Recent studies have shown that cloze-style reading comprehension is a popular task for measuring the progress of natural language understanding. |
| Approach: | They propose a multi-perspective framework which can be seen as joint training of heterogeneous experts and aggregate context information from different perspectives. |
| Outcome: | The proposed framework achieves new state-of-the-art over previous strong baselines on a recently released cloze-test dataset. |
Efficient Universal Goal Hijacking with Semantics-guided Prompt Organization (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for prompt injection have focused on optimizing the suffix, overlooking the role of the prompt. |
| Approach: | They propose a method that incorporates an efficient optimization algorithm and two semantics-guided prompt organization strategies to optimize the suffix sequence for universal goal hijacking. |
| Outcome: | The proposed method can generate a fixed suffix that can concatenate to arbitrary user prompts for universal goal hijacking. |
Crabs: Consuming Resource via Auto-generation for LLM-DoS Attack under Black-box Settings (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on white-box attacks focus on black-box LLMs, leaving black- box scenarios underexplored. |
| Approach: | They propose an automated algorithm designed for black-box LLMs that constructs the DoS Attack Tree and expands the node coverage to achieve effectiveness under black- box conditions. |
| Outcome: | The proposed algorithm can be used to build a DoS Attack Tree and expand the node coverage to achieve effectiveness under black-box conditions. |