Papers by Hui Liu
SiLP: Enhancing Non-Dominant Language Capabilities with a Selective Bidirectional Language Projection Framework (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods to improve performance of large language models rely on additional training objectives or language-specific parameters. |
| Approach: | They propose a bidirectional language projection framework that enables efficient multilingual alignment and language shift using the intrinsic parameters. |
| Outcome: | The proposed framework improves performance of non-dominant languages and improves internal representations. |
Retrieval, Analogy, and Composition: A framework for Compositional Generalization in Image Captioning (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches fail to generalize well to concepts that are not observed during training. |
| Approach: | They propose a framework that revolves around probing several similar image caption training instances and performing analogical reasoning over relevant entities in retrieved prototypes. |
| Outcome: | The proposed framework improves on the widely used image captioning benchmarks and on composition-related evaluation metrics. |
From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework (2023.findings-acl)
Copied to clipboard
Yangyi Chen, Hongcheng Gao, Ganqu Cui, Lifan Yuan, Dehan Kong, Hanlu Wu, Ning Shi, Bo Yuan, Longtao Huang, Hui Xue, Zhiyuan Liu, Maosong Sun, Heng Ji
| Challenge: | Existing models of robustness evaluation are incomprehensive, impractical, and invalid . |
| Approach: | They propose a framework for automatic robustness evaluation that shifts towards model-centric evaluation to further exploit the advantages of adversarial attacks. |
| Outcome: | The proposed framework is based on a model-centric evaluation protocol and a robustness evaluation protocol. |
Red-Teaming LLM Multi-Agent Systems via Communication Attacks (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Model-based Multi-Agent Systems (LLM-MAS) have revolutionized complex problem-solving capability by enabling agent collaboration through message-based communications. |
| Approach: | They propose an attack that exploits communication mechanisms in Large Language Model-based Multi-Agent Systems (LLM-MAS) by intercepting and manipulating inter-agent messages. |
| Outcome: | The proposed attack exploits communication mechanisms in large language model-based multi-agent systems by intercepting and manipulating inter-agencies. |
RFS-Guard: Detecting Reasoning Hallucinations via Cross-Phase Routing Focus in Large Reasoning Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large reasoning models (LRMs) generate intermediate reasoning traces before the final answer, yet they remain vulnerable to reasoning hallucinations such as subtle arithmetic errors. |
| Approach: | They propose a Routing Focus Score (RFS) that measures how strongly cross-step attention routing aligns with semantic proximity derived from hidden-state cosine similarity. |
| Outcome: | The proposed framework detects and localizes hallucinations without external tools or repeated sampling. |
Towards Knowledge Checking in Retrieval-augmented Generation: A Representation Perspective (2025.naacl-long)
Copied to clipboard
Shenglai Zeng, Jiankun Zhang, Bingheng Li, Yuping Lin, Tianqi Zheng, Dante Everaert, Hanqing Lu, Hui Liu, Hui Liu, Yue Xing, Monica Xiao Cheng, Jiliang Tang
| Challenge: | Existing studies have shown that LLMs struggle to identify the boundaries of their own knowledge and tend to prioritize external information over internal knowledge learned during pre-training. |
| Approach: | They conduct a comprehensive analysis of LLM representation behaviors and demonstrate the significance of using representations in knowledge checking. |
| Outcome: | The proposed classifiers improve performance even when dealing with noisy knowledge databases. |
IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Web (2025.findings-acl)
Copied to clipboard
Hongcheng Guo, Wei Zhang, Junhao Chen, Yaonan Gu, Jian Yang, Junjia Du, Shaosheng Cao, Binyuan Hui, Tianyu Liu, Jianxin Ma, Chang Zhou, Zhoujun Li
| Challenge: | Existing models have been introduced to improve image comprehension, but there is no robust benchmark for imagetoweb conversion. |
| Approach: | They propose a benchmark to assess imagetoweb conversion proficiency of large multimodal models . they propose to measure layout information of web pages by parsing the Document Object Model tree . |
| Outcome: | The proposed benchmark measures the layout information of web pages—i.e., the positional relationships between elements—which has been overlooked by prior work. |
Ask-Before-Detection: Identifying and Mitigating Conformity Bias in LLM-Powered Error Detector for Math Word Problem Solutions (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies have demonstrated the potential of large language models (LLMs) for automatic error detection in math word problems (MWPs). |
| Approach: | They propose a framework that generates adaptive reference solutions using LLMs to enhance error detection by reducing conformity bias in MWPs. |
| Outcome: | The proposed framework mitigates the performance gap between conventional and alternative solutions in MWPs, especially when combined with reasoning-enhancing techniques like chain-of-thought prompting. |
Attn-GS: Attention-Guided Context Compression for Efficient Personalized LLMs (2026.acl-long)
Copied to clipboard
Shenglai Zeng, Tianqi Zheng, Chuan Tian, Dante Everaert, Yau-Shian Wang, Yupin Huang, Michael J. Morais, Rohit Patki, Jinjin Tian, Xinnan Dai, Kai Guo, Monica Xiao Cheng, Hui Liu
| Challenge: | Existing approaches to personalize large language models (LLMs) rely on heuristic methods to compress user profiles but they ignore how LLMs process and prioritize different profile components. |
| Approach: | They propose an attention-guided context compression framework that leverages attention feedback from a marking model to mark important personalization sentences and guides a compression model to generate task-relevant compressed user contexts. |
| Outcome: | The proposed framework outperforms baselines across tasks, token limits, and settings while reducing token usage by 50 times. |
Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models (2026.findings-acl)
Copied to clipboard
Hengyuan Zhang, Zhihao Zhang, Ercong Nie, Mingyang Wang, Zunhai Su, Yiwei Wang, Qianli Wang, Shuzhou Yuan, Xufeng Duan, Qibo Xue, Zeping Yu, Chenming Shang, Xiao Liang, Jing Xiong, Hui Shen, Chaofan Tao, Zhengwu Liu, Senjie Jin, Zhiheng Xi, Dongdong Zhang, Sophia Ananiadou, Tao Gui, Ruobing Xie, Hayden Kwok-Hay So, Hinrich Schuetze, Xuanjing Huang, Qi Zhang, Ngai Wong
| Challenge: | Existing literature on mechanistic interpretation (MI) treats it as an observational science, leaving practical applications underexplored. |
| Approach: | They propose a survey structured around the pipeline to identify and improve MI models. |
| Outcome: | The proposed framework enables tangible improvements in Alignment, Capability, and Efficiency. |
INS: An Interactive Chinese News Synthesis System (N19-4)
Copied to clipboard
| Challenge: | In the last decade, news websites and apps become more popular, which can provide us an extremely large volume of news articles. |
| Approach: | They propose a system which automatically synthesizes news articles into a long overview article by interacting with users. |
| Outcome: | The proposed system can generate news overview articles automatically or by interacting with users. |
GraCoRe: Benchmarking Graph Comprehension and Complex Reasoning in Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Existing benchmarks focus primarily on pure graph understanding, lacking a comprehensive evaluation across all graph types and detailed capability definitions. |
| Approach: | They propose a benchmark to evaluate LLMs' graph comprehension and reasoning abilities using a three-tier hierarchical taxonomy and a granular taxonomies. |
| Outcome: | The proposed model includes 11 datasets with 5,140 graphs of varying complexity. |
An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4 (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have fine-tuned judge models based on open-source LLMs to evaluate the quality of other LLM. |
| Approach: | They propose to use open-source LLMs to evaluate Large Language Models (LLMs) their empirical results show that the models underperform GPT-4 in several dimensions . |
| Outcome: | The proposed models outperform GPT-4 on several dimensions including generalizability, fairness and adaptability. |
Locomo-Plus: Beyond-Factual Cognitive Memory Evaluation Framework for LLM Agents (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks and evaluation protocols focus on surface-level factual recall. |
| Approach: | They propose a benchmark for assessing cognitive memory under cue–trigger semantic disconnect. |
| Outcome: | The proposed framework reveals failures not captured by existing benchmarks. |
InstructCoder: Instruction Tuning Large Language Models for Code Editing (2024.acl-srw)
Copied to clipboard
| Challenge: | InstructCoder is the first instruction-tuning dataset designed to adapt LLMs for general-purpose code editing. |
| Approach: | They propose to use Large Language Models to edit code based on user instructions . they use a dataset to adapt LLMs to general-purpose code editing . |
| Outcome: | The proposed model can significantly improve code editing performance compared to proprietary models . the proposed model is based on a human-written execution-based benchmark . |
Do VLMs Have a Moral Backbone? A Study on the Fragile Morality of Vision-Language Models (2026.findings-acl)
Copied to clipboard
Zhining Liu, Tianyi Wang, Xiao Lin, Penghao Ouyang, Gaotang Li, Ze Yang, Hui Liu, Sumit Keswani, Vishwa Pardeshi, Huijun Zhao, Wei Fan, Hanghang Tong
| Challenge: | Vision-Language Models (VLMs) have advanced multimodal learning, driving progress in cross-modal reasoning. |
| Approach: | They propose to examine moral robustness of vision-language models by analyzing their moral stances under multimodal perturbations. |
| Outcome: | The proposed model-agnostic multimodal perturbations expose VLMs to a variety of moral vulnerabilities, including a sycophancy trade-off where stronger instruction-following models are more susceptible to persuasion. |
Knowledge-Selective Pretraining for Attribute Value Extraction (2023.findings-emnlp)
Copied to clipboard
Hui Liu, Qingyu Yin, Zhengyang Wang, Chenwei Zhang, Haoming Jiang, Yifan Gao, Zheng Li, Xian Li, Chao Zhang, Bing Yin, William Wang, Xiaodan Zhu
| Challenge: | Existing methods for AVE are limited on rare attributes due to poor generalization ability. |
| Approach: | They propose to leverage pretraining and transfer learning to address weaknesses in existing methods. |
| Outcome: | The proposed method achieves new state-of-the-art performance without pretraining on rare attributes with limited training resources. |
A Multi-Agent Framework with Automated Decision Rule Optimization for Cross-Domain Misinformation Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for misinformation detection are limited by domain knowledge and expert experience. |
| Approach: | They propose a Multi-Agent Framework for cross-domain misinformation detection with Automated Decision Rule Optimization (MARO) they first employ multiple expert agents to analyze target-domain news, then introduce a question-reflection mechanism that guides expert agents for higher-quality analysis. |
| Outcome: | The proposed framework improves on a common dataset and shows that iteratively improves over existing methods. |
ChildMandarin: A Comprehensive Mandarin Speech Dataset for Young Children Aged 3-5 (2025.acl-long)
Copied to clipboard
Jiaming Zhou, Shiyao Wang, Shiwan Zhao, Jiabei He, Haoqin Sun, Hui Wang, Cheng Liu, Aobo Kong, Yujie Guo, Xi Yang, Yequan Wang, Yonghua Lin, Yong Qin
| Challenge: | Automatic speech recognition systems have advanced significantly with models like Whisper, Conformer, and self-supervised frameworks such as Wav2vec 2.0. |
| Approach: | They propose to use Mandarin speech datasets to analyze pronunciation and tone of children aged 3 to 5 and evaluate their models on speaker verification (SV) They find that the datasets are more robust than those used by adult speech recognition systems and are open-source and available for all academic purposes. |
| Outcome: | The proposed dataset includes 41.25 hours of speech with carefully crafted manual transcriptions, collected from 397 speakers across various provinces in China, with balanced gender representation. |
Enhancing Descriptive Image Captioning with Natural Language Inference (2021.acl-short)
Copied to clipboard
| Challenge: | Existing captioning models tend to generate generic captions, but generating descriptive captions is important. |
| Approach: | They propose a novel approach to encourage captioning models to produce more detailed captions using natural language inference. |
| Outcome: | The proposed method outperforms baseline models on MSCOCO metrics on descriptiveness and descriptiveness. |
Does Gender Matter? Towards Fairness in Dialogue Systems (2020.coling-main)
Copied to clipboard
| Challenge: | Recent studies have shown that AI is unfair in many real-world applications such as computer vision and recommendations. |
| Approach: | They propose to use a benchmark dataset to study the fairness of dialogue systems to understand their bias. |
| Outcome: | The proposed methods reduce the bias in dialogue systems significantly. |
Efficient Learned Data Compression via Dual-Stream Feature Decoupling (2026.acl-long)
Copied to clipboard
| Challenge: | Learned data compression has achieved superior compression ratios, but balancing precise probability modeling with system efficiency remains challenging. |
| Approach: | They propose a Dual-Stream Multi-Scale Decoupler that disentangles local and global contexts to replace deep serial processing with shallow parallel streams. |
| Outcome: | The proposed method achieves state-of-the-art performance in both compression ratio and throughput while maintaining the lowest latency and memory usage. |
LASA: Language-Agnostic Semantic Alignment at the Semantic Bottleneck for LLM Safety (2026.acl-long)
Copied to clipboard
Junxiao Yang, Haoran Liu, Jinzhe Tu, Jiale Cheng, Zhexin Zhang, Shiyao Cui, Jiaqi Weng, Jialing Tao, Hui Xue, Hongning Wang, Han Qiu, Minlie Huang
| Challenge: | Large language models (LLMs) have demonstrated better safety performance in high-resource languages than in low-resourced languages. |
| Approach: | They propose language-agnostic semantic alignment (LASA) which anchors safety alignment directly in semantic bottlenecks. |
| Outcome: | The proposed approach significantly improves safety across all languages: average attack success rate drops from 24.7% to 2.8% on LLaMA-3.1-8B-Instruct and remains within 3–4% across Qwen2.5 and Qwend3 Instruct models (7B–32B). |
Does Multi-Encoder Help? A Case Study on Context-Aware Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | In encoder-decoder neural models, multiple encoders are used to represent contextual information in addition to the individual sentence. |
| Approach: | They propose to use multiple context encoders to encode the individual sentences in document-level neural machine translation (NMT) They propose a noisy dropout setup and a single-encoder approach to encode context sentences. |
| Outcome: | The proposed approach encodes the context and the current sentence without contexts. |
Jointly Learning to Align and Summarize for Neural Cross-Lingual Summarization (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies on cross-lingual summarization focus on pipeline methods and training end-to-end models. |
| Approach: | They propose to jointly learn to align and align to train a neural cross-lingual summarization model by using a large-scale corpus. |
| Outcome: | The proposed model outperforms competing models in most cases and can generate cross-lingual summaries without access to any cross-linguistic corpus. |
Legal Fact Prediction: The Missing Piece in Legal Judgment Prediction (2025.emnlp-main)
Copied to clipboard
Junkai Liu, Yujie Tong, Hui Huang, Bowen Zheng, Yiran Hu, Peicheng Wu, Chuan Xiao, Makoto Onizuka, Muyun Yang, Shuyuan Zheng
| Challenge: | Existing studies use legal facts to predict judgments, but legal facts are difficult to obtain in early stages of litigation. |
| Approach: | They propose a legal fact prediction task that takes evidence from trial as input to make predictions in the absence of ground-truth legal facts. |
| Outcome: | The proposed task can predict court rulings without ground-truth legal facts . the first benchmark dataset, LFPBench, is used to evaluate the task . |
Divide-Verify-Refine: Can LLMs Self-align with Complex Instructions? (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing research shows LLMs struggle with complex instructions involving multiple constraints. |
| Approach: | They propose a framework to divide complex instructions into single constraints and prepare appropriate tools to verify responses. |
| Outcome: | The proposed framework doubles Llama3.1-8B’s constraint adherence and triples Mistral-7B’ s performance. |
Contrastive Learning enhanced Author-Style Headline Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Current work only uses the article itself in the headline generation, but have not taken the writing style of headlines into account. |
| Approach: | They propose a model which takes historical headlines into account to integrate the stylistic features of the author into the model and integrate them into the decoder. |
| Outcome: | The proposed model can integrate the stylistic features of the author into the model and generate a headline that is appropriate for the article and consistent with the author’s style. |
Defending Against Social Engineering Attacks in the Age of LLMs (2024.emnlp-main)
Copied to clipboard
Lin Ai, Tharindu Kumarage, Amrita Bhattacharjee, Zizhou Liu, Zheng Hui, Michael Davinroy, James Cook, Laura Cassani, Kirill Trapeznikov, Matthias Kirchner, Arslan Basharat, Anthony Hoogs, Joshua Garland, Huan Liu, Julia Hirschberg
| Challenge: | Existing research has developed frameworks to understand human-to-human CSE attacks. |
| Approach: | They propose a modular defense pipeline that improves detection at both the message and conversation levels. |
| Outcome: | The proposed model can be exploited to facilitate chat-based social engineering attacks and generate high-quality CSE content, but their detection capabilities are suboptimal, leading to increased operational costs for defense. |
Improve Dense Passage Retrieval with Entailment Tuning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for dense retrieval have demonstrated remarkable performance in IR tasks. |
| Approach: | They propose a method to improve the embedding of dense retrievers by using existence claim as a bridge. |
| Outcome: | The proposed method can be plugged into current dense retrieval methods and the results are published in the journal Nature. |
PlanGenLLMs: A Modern Survey of LLM Planning Capabilities (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on developing LLMs to automate complex planning tasks. |
| Approach: | They propose to provide a comprehensive overview of current LLM planners to fill this gap . they examine performance criteria including completeness, executability, optimality, representation, generalization, and efficiency . |
| Outcome: | The proposed survey examines performance criteria for LLM planners and highlights their strengths and weaknesses. |
HEALing Entropy Collapse: Enhancing Exploration in Few-Shot RLVR via Hybrid-Domain Entropy Dynamics Alignment (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for training reasoning-oriented large language models assume high-resource settings with abundant data. |
| Approach: | They propose a framework that integrates high-value general-domain data to promote more diverse exploration. |
| Outcome: | The proposed framework matches or surpasses RLVR trained with 32 target-domain samples using 32 target domain samples. |
LongFaith: Enhancing Long-Context Reasoning in LLMs with Faithful Synthetic Data (2025.findings-acl)
Copied to clipboard
| Challenge: | Long-context processing ability has emerged as a significant challenge for large language models. |
| Approach: | They propose a pipeline for synthesizing faithful long-context reasoning instruction datasets . they integrate ground truth and citation-based reasoning prompts integrating them . |
| Outcome: | The proposed pipeline eliminates distractions and improves reasoning chains. |
Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Models (2025.findings-acl)
Copied to clipboard
Yingqian Cui, Pengfei He, Jingying Zeng, Hui Liu, Xianfeng Tang, Zhenwei Dai, Yan Han, Chen Luo, Jing Huang, Zhen Li, Suhang Wang, Yue Xing, Jiliang Tang, Qi He
| Challenge: | Chain-of-Thought (CoT) reasoning has improved the performance of large language models (LLMs) however, the detailed reasoning process in CoT often incurs long generation times and high computational costs due to the inclusion of unnecessary steps. |
| Approach: | They propose a method to identify critical reasoning steps using perplexity as a measure of their importance. |
| Outcome: | The proposed method achieves a better balance between reasoning accuracy and efficiency of CoT. |
A Lifelong Multilingual Multi-granularity Semantic Alignment Approach via Maximum Co-occurrence Probability (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to mask and predict tokens in multilingual text limit multilingual interaction . |
| Approach: | They propose a lifelong multilingual multi-granularity semantic alignment approach which continuously extracts massive aligned linguistic units from noisy data via a maximum co-occurrence probability algorithm. |
| Outcome: | The proposed approach improves translation performance on WMT14 18 benchmarks in twelve directions. |
TP-RAG: Benchmarking Retrieval-Augmented Large Language Model Agents for Spatiotemporal-Aware Travel Planning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on large language models (LLMs) focus on basic plan validity, but neglect critical aspects such as route efficiency, POI appeal, and real-time adaptability. |
| Approach: | They propose a benchmark for retrieval-augmented, spatiotemporal-aware travel planning that integrates retrieved trajectories with LLMs’ intrinsic reasoning. |
| Outcome: | The proposed framework improves spatial efficiency and POI rationality while challenging universality and robustness due to conflicting references and noisy data. |
Enhancing Pre-Trained Generative Language Models with Question Attended Span Extraction on Machine Reading Comprehension (2024.emnlp-main)
Copied to clipboard
| Challenge: | Extractive Machine Reading Comprehension (MRC) is a challenging field in the field of Natural Language Processing. |
| Approach: | They propose a Question-Attended Span Extraction module to address the limitations of generative approaches for extractive machine reading comprehension (MRC) . module significantly enhances performance of pre-trained generative language models, enabling them to surpass the extractive capabilities of advanced Large Language Models (LLMs) |
| Outcome: | The QASE module surpasses state-of-the-art models in few-shot settings. |
Data Poisoning for In-context Learning (2025.findings-naacl)
Copied to clipboard
| Challenge: | In-context learning (ICL) has emerged as a capability of large language models (LLMs) but there is limited understanding of its vulnerability against data poisoning attacks. |
| Approach: | They propose an attack method that exploits ICL’s unique learning mechanisms by identifying discrete text perturbations that influence LLM hidden states. |
| Outcome: | The proposed attack method exploits ICL’s learning mechanisms by identifying discrete text perturbations that influence LLM hidden states. |
START: Self-taught Reasoner with Tools (2025.emnlp-main)
Copied to clipboard
Chengpeng Li, Mingfeng Xue, Zhenru Zhang, Jiaxi Yang, Beichen Zhang, Bowen Yu, Binyuan Hui, Junyang Lin, Xiang Wang, Dayiheng Liu
| Challenge: | Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in complex reasoning through long chain-of-thought, yet they struggle with precise computations and algorithmic operations. |
| Approach: | They propose a training-free approach that activates LRMs’ latent tool-use capabilities through artificial hints and a framework that enables models to learn effective tool utilization through diverse hint patterns and rejection-based data synthesis. |
| Outcome: | Experiments show that START significantly improves state-of-the-art LRMs across challenging benchmarks, including competition-level mathematics (AMC23: 95.0%, AIME24: 75.6%) and graduate-level science questions (GPQA: 64.6%). |
MA-GTS: A Multi-Agent Framework for Solving Complex Graph Problems in Real-World Applications (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for solving complex problems are expensive and inefficient when handling large-scale, high-complexity problems. |
| Approach: | They propose a multi-agent framework that decomposes complex problems through agent collaboration by mapping implicitly expressed graph data into clear, structured graph representations and dynamically selecting the most suitable algorithm based on problem constraints and graph structure scale. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on multiple benchmarks with robust performance on both closed- and open-source models. |
Are Large Language Models (LLMs) Good Social Predictors? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies suggest that Large Language Models can generate human-like responses, but it is unclear how well they work and where the plausible predictions derive from. |
| Approach: | They propose to use LLMs to generate human-like responses by mutability and accessibility of social inputs to perform a social prediction task. |
| Outcome: | The proposed model performs well in three realistic settings and a novel social prediction task. |
A General Framework to Enhance Fine-tuning-based LLM Unlearning (2025.findings-acl)
Copied to clipboard
Jie Ren, Zhenwei Dai, Xianfeng Tang, Hui Liu, Jingying Zeng, Zhen Li, Rahul Goutam, Suhang Wang, Yue Xing, Qi He, Hui Liu
| Challenge: | Existing approaches to remove copyrighted and privacy-sensitive data from Large Language Models (LLMs) have been proposed to remove specific data from LLMs without requiring full retraining. |
| Approach: | They propose a general framework that enhances the utility of fine-tuning-based methods by distinguishing target data and suppressing related generations. |
| Outcome: | The proposed framework improves the unlearning and utility of fine-tuning-based methods by distinguishing the target data and suppressing related generations. |
MuSC: Improving Complex Instruction Following with Multi-granularity Self-Contrastive Training (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for complex instruction-following with elaborate constraints rely on a weaker model, especially GPT-4, limiting their application. |
| Approach: | They propose a Multi-granularity Self-Contrastive Training framework to improve instruction alignment without relying on a stronger model. |
| Outcome: | The proposed framework improves instruction-following with elaborate constraints without external supervision on coarse and fine granularity. |
Syntactically Diverse Adversarial Network for Knowledge-Grounded Conversation Generation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing conversation models produce meaningless and generic responses, which significantly reduce the user experience. |
| Approach: | They propose to fuse knowledge to improve informativeness and adopt latent variables to enhance the diversity of responses. |
| Outcome: | The proposed model can generate syntactically diverse and knowledge-accurate responses while maintaining the knowledge accuracy. |
Task-Aware LLM Routing with Multi-Level Task-Profile-Guided Data Synthesis for Cold-Start Scenarios (2026.acl-long)
Copied to clipboard
| Challenge: | Existing routers generalize poorly in cold-start scenarios where in-domain training data is unavailable. |
| Approach: | They propose a task-type–aware router approach that models query-conditioned cost and performance via latent task-like variables with prior regularization derived from the synthesized task taxonomy. |
| Outcome: | The proposed framework improves performance and cost under cold-start and in-domain settings and enables efficient routing. |
WebUncertainty: Dual-Level Uncertainty Driven Planning and Reasoning For Autonomous Web Agent (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing web agents struggle with complex tasks due to rigid planning strategies and hallucination-prone reasoning. |
| Approach: | They propose a task-uncertainty-driven Adaptive Planning Mechanism that adaptively selects planning modes to navigate unknown environments. |
| Outcome: | The proposed framework performs better on the WebArena and WebVoyager benchmarks than existing frameworks. |
Select2Reason: Efficient Instruction-Tuning Data Selection for Long-CoT Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Large reasoning models exhibit human-like behaviors such as exploration, verification, reflection, and correction. |
| Approach: | They propose a supervised fine-tuning framework for long chain-of-thoughts reasoning . they leverage a difficulty-aware reward model to estimate the learning value of questions . |
| Outcome: | The proposed framework performs fine-tuning on large reasoning models on 10% of the data selected. |
MultiConIR: Towards Multi-Condition Information Retrieval (2025.findings-emnlp)
Copied to clipboard
Xuan Lu, Sifan Liu, Bochao Yin, Yongqi Li, Xinghao Chen, Hui Su, Yaohui Jin, Wenjun Zeng, Xiaoyu Shen
| Challenge: | MultiConIR is a benchmark designed to evaluate retrieval and reranking models under nuanced multi-condition query scenarios. |
| Approach: | They propose a benchmark to evaluate retrieval and reranking models under nuanced multi-condition query scenarios. |
| Outcome: | The proposed benchmark evaluates retrieval and reranking models under nuanced multi-condition query scenarios across five domains. |
Deploying Multi-task Online Server with Large Language Model (2025.coling-industry)
Copied to clipboard
| Challenge: | In the industry, numerous natural language processing tasks are deployed online . traditional approaches tackle each task separately by its own network and pipeline . |
| Approach: | They propose a three-stage multi-task learning framework for large language models . it involves task filtering, fine-tuning on high-resource tasks, and finally fine- tuning on all tasks . |
| Outcome: | The proposed framework reduces up to 90% of overhead while reducing latency and resource usage. |
Probing and Boosting Large Language Models Capabilities via Attention Heads (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to identifying capabilities rely on external signals with limited structural grounding . emergence of specific capabilities remains poorly understood . |
| Approach: | They propose a lightweight approach that links LLM capabilities to internal components by identifying correspondences at the level of attention heads. |
| Outcome: | The proposed approach improves accuracy on MMLU and BBH by 1 to 1.5 points over gradient-based method and 5 to 6 points over other intermediate-state baselines. |
AgentGC: Evolutionary Learning-based Lossless Compression for Genomics Data with LLM-driven Multiple Agent (2026.findings-acl)
Copied to clipboard
Sun Hui, Ding Yanfeng, Huidong Ma, Chang Xu, Keyan Jin, Lizheng Zu, Cheng Zhong, Xiaoguang Liu, Gang Wang, Wentong Cai
| Challenge: | Lossless compression has made significant advancements in Genomics Data storage, sharing and management. |
| Approach: | They propose a novel agent-based GD Compressor with 3 layers with a multi-agent named Leader and Worker. |
| Outcome: | The proposed method improves on existing methods with low-level modeling and limited adaptability and user-unfriendly interface. |
Live-Aid: A Large-Scale Dialogue Dataset and Benchmark for Interleaved Multi-party Interactions in Live Streaming (2026.findings-acl)
Copied to clipboard
Yiming Lei, Yize Fan, Zeming Liu, Jiaji Dong, Hui Qiu, Haitao Leng, Qingjie Liu, Kehai Chen, Tingting Gao, Yunhong Wang
| Challenge: | Existing Multimodal Large Language Models struggle with dynamic interactions due to the scarcity of high-quality interleaved data. |
| Approach: | They propose a large-scale interleaved live interaction Chinese dataset with human-annotated video responses. |
| Outcome: | The proposed model can be used to evaluate live interactions in Chinese over 1,100 hours and 80,037 dialogue turns. |
2D-DPO: Scaling Direct Preference Optimization with 2-Dimensional Supervision (2025.findings-naacl)
Copied to clipboard
Shilong Li, Yancheng He, Hui Huang, Xingyuan Bu, Jiaheng Liu, Hangyu Guo, Weixun Wang, Jihao Gu, Wenbo Su, Bo Zheng
| Challenge: | Existing methods that optimize for scalar scores or ranking reward ignore multi-dimensional nature of human preferences. |
| Approach: | They propose to extend the preference of Direct Preference Optimization to two dimensions: segments and aspects. |
| Outcome: | The proposed framework decomposes the overall objective into multi-segment and multi-aspect objectives. |
InteMATs: Integrating Granularity-Specific Multilingual Adapters for Cross-Lingual Transfer (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work relies on full-model fine-tuning on large parallel datasets to enhance cross-lingual alignment of MLLMs. |
| Approach: | They propose an approach that integrates multilingual adapters trained on texts of different levels of granularity into multilingual models. |
| Outcome: | The proposed approach improves the performance of multilingual language models on low-resource languages. |
Iterative Constrained Back-Translation for Unsupervised Domain Adaptation of Machine Translation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing back-translation methods focus on in-domain lexical knowledge, which may lead to poor translation of unseen in- domain words. |
| Approach: | They propose an iterative constrained back-translation method to incorporate in-domain lexical knowledge into synthetic parallel data from BT. |
| Outcome: | The proposed method improves the BLEU score by up to 3.08 on four domains. |
One-Shot Learning as Instruction Data Prospector for Large Language Models (2024.acl-long)
Copied to clipboard
Yunshui Li, Binyuan Hui, Xiaobo Xia, Jiaxi Yang, Min Yang, Lei Zhang, Shuzheng Si, Ling-Hao Chen, Junhao Liu, Tongliang Liu, Fei Huang, Yongbin Li
| Challenge: | Contemporary practices in instruction tuning often hinge on enlarging data scaling without a clear strategy for ensuring data quality. |
| Approach: | They propose a method that leverages one-shot learning to discern and select high-quality instruction data from extensive datasets. |
| Outcome: | Nuggets outperforms existing methods on MT-Bench and Alpaca-Eval benchmarks. |
TrojanSQL: SQL Injection against Natural Language Interface to Database (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on text-to-SQL systems have not investigated its security aspects . however, how to implement such attacks remains an open question. |
| Approach: | They propose a backdoor-based SQL injection framework for text-to-SQL systems that uses boolean-based injection and union-based injecting techniques to exploit SQL injection vulnerabilities. |
| Outcome: | The proposed framework can produce harmful SQL statements invalidating user queries or compromise sensitive information about the database. |
TELLER: A Trustworthy Framework for Explainable, Generalizable and Controllable Fake News Detection (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for detecting fake news are limited due to non-transparent reasoning processes and inherent risks of integration with large language models. |
| Approach: | They propose a framework for trustworthy fake news detection that prioritizes explainability, generalizability and controllability of models. |
| Outcome: | The proposed framework prioritizes explainability, generalizability and controllability of models. |
Enabling Unsupervised Neural Machine Translation with Word-level Visual Representations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Unsupervised neural machine translation methods have been observed to make particular errors in comparison to supervised machine translation, such as confusing nouns that pertain to the same semantic category. |
| Approach: | They propose a method that incorporates images at the word level to augment lexical mappings. |
| Outcome: | Experiments on a multi-lingual dataset show that the proposed method generates more accurate translations with only monolingual data. |
The Right Time Matters: Data Arrangement Affects Zero-Shot Generalization in Instruction Tuning (2025.findings-acl)
Copied to clipboard
Bingxiang He, Ning Ding, Cheng Qian, Jia Deng, Ganqu Cui, Lifan Yuan, Haiwen Hong, Huan-ang Gao, Longtao Huang, Hui Xue, Huimin Chen, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing work on instruction tuning has focused on task level, without considering that tasks are artificially defined and, to LLMs, merely consist of tokens and representations. |
| Approach: | They propose a training data arrangement framework that allows for continual learning and loss reduction. |
| Outcome: | The proposed framework promotes continual learning and loss reduction on unseen tasks. |
LoRE: Enhancing Search Relevance with Progressive Chain-of-Thought and Preference Alignment (2026.findings-acl)
Copied to clipboard
Chenji Lu, Zhuo Chen, Hui Zhao, Zhiyuan Zeng, Gang Zhao, Junjie Ren, null Lihaoran, Songyan Liu, Pengjie Wang, Chuan Yu, Jian Xu, Bo Zheng
| Challenge: | E-commerce search relevance is a critical component of retrieval systems. |
| Approach: | They propose a large-generative model for search relevance that trains reasoning knowledge, multi-modal understanding and rule awareness into three core competencies. |
| Outcome: | The proposed model outperforms GPT-5 in Macro-F1 and achieves 27% online gain. |
SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains (2025.naacl-long)
Copied to clipboard
Ran Xu, Hui Liu, Sreyashi Nag, Zhenwei Dai, Yaochen Xie, Xianfeng Tang, Chen Luo, Yang Li, Joyce C. Ho, Carl Yang, Qi He
| Challenge: | Retrieval-augmented generation (RAG) enhances the question answering abilities of large language models (LLMs) however, adapting general-purpose RAG systems to specialized fields poses unique challenges due to distribution shifts and limited access to domain-specific data. |
| Approach: | They propose a method that equips large language models with joint capabilities of question answering and question generation for domain adaptation. |
| Outcome: | Experiments on 11 datasets across three different domains verify the efficacy of SimRAG over baselines by 1.2%–8.6%. |
AIR: Complex Instruction Generation via Automatic Iterative Refinement (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for generating complex instructions are resource-intensive and lack diversity. |
| Approach: | They propose a framework to generate complex instructions with constraints using a document-generated initial instruction and an iterative refinement framework to incorporate LLM-as-judge guidance. |
| Outcome: | The proposed framework significantly outperforms existing methods for generating complex instructions, and outperformed existing methods. |
Models See Hallucinations: Evaluating the Factuality in Video Captioning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation metrics show little correlation with human factuality annotation. |
| Approach: | They propose a weakly-supervised, model-based factuality metric FactVC which outperforms previous metrics on factual evaluation of video captioning. |
| Outcome: | The proposed model outperforms previous metrics on factuality evaluation of video captioning. |
Beyond Text: Unveiling Privacy Vulnerabilities in Multi-modal Retrieval-Augmented Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Multimodal Models (LMMs) can process text, images, and audio, but they introduce privacy vulnerabilities. |
| Approach: | They propose a compositional structured prompt attack to exploit MRAG privacy vulnerabilities . they show that LMMs can generate outputs resembling retrieved content . |
| Outcome: | The proposed approach generates outputs resembling retrieved content and exposes sensitive information. |
PropaInsight: Toward Deeper Understanding of Propaganda in Terms of Techniques, Appeals, and Intent (2025.coling-main)
Copied to clipboard
Jiateng Liu, Lin Ai, Zizhou Liu, Payam Karisani, Zheng Hui, Yi Fung, Preslav Nakov, Julia Hirschberg, Heng Ji
| Challenge: | Existing research on propaganda detection does not capture the motives behind the content or its broader impact. |
| Approach: | They propose a framework that dissects propaganda into techniques, arousal appeals, and underlying intent. |
| Outcome: | The proposed framework improves performance in a wide range of scenarios and can be used to identify and categorize propaganda techniques. |
A LSTM Approach with Sub-Word Embeddings for Mongolian Phrase Break Prediction (C18-1)
Copied to clipboard
| Challenge: | Existing word embedding methods for Mongolian PB prediction are expensive and time-consuming. |
| Approach: | They propose to use Mongolian word embedding to build a robust Mongolian PB prediction model . they encode sub-word units and feed it to LSTM to decode the best corresponding PB label . |
| Outcome: | The proposed model outperforms traditional model using manual features and achieves 7.49% gain. |
CSL: A Large-scale Chinese Scientific Literature Dataset (2022.coling-1)
Copied to clipboard
| Challenge: | Existing datasets centered around the English language restrict development of Chinese scientific NLP. |
| Approach: | They present a large-scale Chinese scientific literature dataset based on Chinese papers . they use semi-structured data as a natural annotation for many supervised NLP tasks . |
| Outcome: | The proposed dataset can serve as a Chinese corpus and perform many supervised tasks. |
MEIT: Multimodal Electrocardiogram Instruction Tuning on Large Language Models for Report Generation (2025.findings-acl)
Copied to clipboard
Zhongwei Wan, Che Liu, Xin Wang, Chaofan Tao, Hui Shen, Jing Xiong, Rossella Arcucci, Huaxiu Yao, Mi Zhang
| Challenge: | Recent studies have focused on classifying cardiac conditions using ECG data but have overlooked ECG report generation, which is time-consuming and requires clinical expertise. |
| Approach: | They propose a Multimodal ECG Instruction Tuning framework that extends the capability of large language models (LLMs) for the task. |
| Outcome: | The proposed framework outperforms open-source LLMs and LLM backbones across two large-scale ECG datasets. |
Argus: Benchmarking and Enhancing Vision-Language Models for 3D Radiology Report Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing work on 3D radiograph report generation focuses on 2D images, but 3D medical images provide more comprehensive diagnostic information. |
| Approach: | They propose a comprehensive training recipe for building high-performing VLMs for 3DRRG using a publicly available 3D CT-report dataset. |
| Outcome: | The proposed model achieves superior performance across different model sizes and input 3D medical image resolutions. |
On the Generalization of Training-based ChatGPT Detection Methods (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies show that training-based methods are ineffective to detect LLM generated texts from unseen tasks or topics which are not collected during training. |
| Approach: | They propose to train classification models to distinguish LLMs from human texts by a distribution shift caused by prompts, text lengths, topics, and language tasks. |
| Outcome: | The proposed methods can detect LLMs from black-box models, but they suffer from distribution shifts due to a wide range of factors, including prompts, text lengths, topics, and language tasks. |
UER: An Open-Source Toolkit for Pre-training Models (D19-3)
Copied to clipboard
Zhe Zhao, Hui Chen, Jinbin Zhang, Xin Zhao, Tao Liu, Wei Lu, Xi Chen, Haotang Deng, Qi Ju, Xiaoyong Du
| Challenge: | Existing work on pre-training models have shown that it is important to use a framework to deploy various pre- training models efficiently. |
| Approach: | They propose an assemble-on-demand pre-training toolkit that assembles pre-trained models on demand and encapsulates them with rich modules. |
| Outcome: | The proposed framework can reproduce state-of-the-art models or develop models that remain unexplored. |
Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancement (2022.emnlp-main)
Copied to clipboard
| Challenge: | Sarcasm is a linguistic phenomenon indicating a discrepancy between literal meanings and implied intentions. |
| Approach: | They propose a hierarchical framework for sarcasm detection by exploring atomic-level congruity and composition-level convergence. |
| Outcome: | The proposed model outperforms existing methods on a public sarcasm detection dataset based on Twitter . |
Towards Context-Robust LLMs: A Gated Representation Fine-tuning Approach (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) enhanced with external contexts face challenges in handling imperfect evidence. |
| Approach: | They propose a framework that can balance internal knowledge with external contexts . they propose gating mechanisms and low-rank representation adapters to adjust hidden representations based on a lightweight intervention function . |
| Outcome: | The proposed model can effectively balance internal knowledge with external context, similar to human cognitive processes. |
MEDA: Dynamic KV Cache Allocation for Efficient Multimodal Long-Context Inference (2025.naacl-long)
Copied to clipboard
| Challenge: | Long-context Multimodal Large Language Models (MLLMs) require substantial computational resources as their multimodal Key-Value (KV) cache grows with increasing input lengths, challenging memory and time efficiency. |
| Approach: | They propose a dynamic multimodal KV cache allocation strategy that dynamically allocating KV size based on attention entropy to better adapt to multimodal interactions. |
| Outcome: | The proposed model achieves up to 72% KV cache memory reduction and 2.82 faster decoding speeds while maintaining or enhancing performance on various multimodal tasks in a long context. |
Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data (2025.findings-naacl)
Copied to clipboard
Juanhui Li, Sreyashi Nag, Hui Liu, Xianfeng Tang, Sheikh Muhammad Sarwar, Limeng Cui, Hansu Gu, Suhang Wang, Qi He, Jiliang Tang
| Challenge: | Large Language Models (LLMs) have demonstrated superior language understanding abilities in many real-world NLP applications. |
| Approach: | They propose a learning-based sample selection method that incorporates signals from both teacher and student to enhance model performance. |
| Outcome: | The proposed method improves model performance across datasets with higher data efficiency. |
SWE-AGILE: A Software Agent Framework for Efficiently Managing Dynamic Reasoning Context (2026.findings-acl)
Copied to clipboard
| Challenge: | representative ReAct-style approaches lack explicit System-2 reasoning for deep analysis and handling complex edge cases. |
| Approach: | They propose a software agent framework that preserves full reasoning history while compressing historical reasoning content into concise Reasoning Digests. |
| Outcome: | Empirically, the proposed framework sets a new standard for 7B-8B models on SWE-Bench-Verified using only 2.2k trajectories and 896 tasks. |
SUA: Stealthy Multimodal Large Language Model Unlearning Attack (2025.emnlp-main)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) trained on massive data may memorize sensitive personal information and photos, posing privacy and copyright concerns. |
| Approach: | They propose a framework that learns a universal noise pattern to recover unlearned information from MLLMs. |
| Outcome: | The proposed framework learns a universal noise pattern and can reveal unlearned content when applied to images. |
PEAR: Planner-Executor Agent Robustness Benchmark (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing studies examine isolated attack surfaces or specific scenarios, leaving a lack of holistic understanding of MAS vulnerabilities. |
| Approach: | They propose a benchmark to evaluate the utility and vulnerability of planner–executor MAS. |
| Outcome: | The proposed benchmark evaluates planner–executor MAS on a widely adopted design. |
A Semantic Filter Based on Relations for Knowledge Graph Completion (2021.emnlp-main)
Copied to clipboard
| Challenge: | Knowledge graph embedding is a new form of knowledge graphing that allows for better link prediction. |
| Approach: | They propose to use relational embedding to fit symmetry/antisymmetry and combination relationships. |
| Outcome: | The proposed model can fit symmetry/antisymmetry and combination relationships. |
Towards Explainable NLP: A Generative Explanation Framework for Text Classification (P19-1)
Copied to clipboard
| Challenge: | Existing approaches for explainable machine learning systems focus on interpreting outputs or connections between inputs and outputs. |
| Approach: | They propose a generative explanation framework that learns to make classification decisions and generates fine-grained explanations at the same time. |
| Outcome: | The proposed framework surpasses all baselines on two datasets and generates concise explanations at the same time. |
Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are susceptible to a type of attack known as jailbreaking, which misleads LLMs to output harmful contents. |
| Approach: | They propose to leverage hidden representations into existing jailbreak targets to move the attacks along the acceptance direction. |
| Outcome: | The proposed methods are validated using the objective of existing jailbreak attacks. |
ViLBench: A Suite for Vision-Language Process Reward Modeling (2025.emnlp-main)
Copied to clipboard
| Challenge: | Despite its advantages, evaluation on PRMs remains less explored, especially in the multimodal domain. |
| Approach: | They propose to benchmark vision large language models as output reward models and process reward models as process-supervised reward models. |
| Outcome: | The proposed model outperforms both ORM and PRM on vision-language benchmarks and achieves an average improvement of 3.3% over standard CoT and up to 2.5% over its untrained counterpart on ViLBench. |
CENTAUR: Bridging the Impossible Trinity of Privacy, Efficiency, and Performance in Privacy-Preserving Transformer Inference (2025.acl-long)
Copied to clipboard
Jinglong Luo, Guanzhong Chen, Yehong Zhang, Shiyu Liu, Hui Wang, Yue Yu, Xun Zhou, Yuan Qi, Zenglin Xu
| Challenge: | Existing privacy-preserving Transformer Inference frameworks suffer from high computational overhead and performance losses. |
| Approach: | They propose a framework that integrates random permutations and SMPC to address the "impossible trinity" CENTAUR resists diverse data reconstruction attacks and boosts inference speed by 5.030.4 times . |
| Outcome: | CENTAUR achieves an unprecedented balance between privacy, efficiency, and performance. |
EcomScriptBench: A Multi-task Benchmark for E-commerce Script Planning via Step-wise Intention-Driven Product Association (2025.acl-long)
Copied to clipboard
Weiqi Wang, Limeng Cui, Xin Liu, Sreyashi Nag, Wenju Xu, Chen Luo, Sheikh Muhammad Sarwar, Yang Li, Hansu Gu, Hui Liu, Changlong Yu, Jiaxin Bai, Yifan Gao, Haiyang Zhang, Qi He, Shuiwang Ji, Yangqiu Song
| Challenge: | Goal-oriented script planning is used by humans to plan for typical activities . however, this capability remains underexplored due to several challenges . |
| Approach: | They propose a framework that enables product-enriched scripts by associating products with each step based on the semantic similarity between the actions and their purchase intentions. |
| Outcome: | The proposed framework can generate product-enriched scripts from 2.4 million scripts . human annotations are conducted to provide gold labels for a sampled subset . |
OkraLong: A Flexible Retrieval-Augmented Framework for Long-Text Question Answering (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new framework for large language models addresses long-text questions . context compression and dynamic retrieval loops sacrifice critical details or incur iterative costs . |
| Approach: | a new framework is proposed to optimize the entire processing workflow . it uses synergistic components to analyzer, organizer and executor to optimize workflow a . |
| Outcome: | OkraLong improves answer accuracy by 5.7%-41.2% and saves 1.3x-4.7x . |
Domain-Specific Data Generation Framework for RAG Adaptation (2026.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) combines the language understanding and reasoning capabilities of large language models (LLMs) with external retrieval to produce domain-grounded responses. |
| Approach: | They propose a scalable and modular data-centric framework for generating domain-grounded question–answer–context triples tailored to diverse RAG adaptation strategies. |
| Outcome: | The proposed framework generates domain-grounded question–answer–context triples for multiple RAG adaptation strategies. |
Qwen2.5-xCoder: Multi-Agent Collaboration for Multilingual Code Instruction Tuning (2025.acl-long)
Copied to clipboard
Jian Yang, Wei Zhang, Yibo Miao, Shanghaoran Quan, Zhenhe Wu, Qiyao Peng, Liqun Yang, Tianyu Liu, Zeyu Cui, Binyuan Hui, Junyang Lin
| Challenge: | Existing methods to train code LLMs view each programming language in isolation . experimental results show that Qwen2.5-xCoder can bridge the gap between different programming languages . |
| Approach: | They propose a framework that allows agents to collaborate to enhance multilingual instruction tuning for code LLMs. |
| Outcome: | Experimental results show that Qwen2.5-xCoder can transfer knowledge efficiently and effectively between languages. |
Refiner: Restructure Retrieved Content Efficiently to Advance Question-Answering Capabilities (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are limited by their parametric knowledge, leading to hallucinations in knowledge-extensive tasks. |
| Approach: | They propose an end-to-end extract-and-restructure paradigm that leverages a single decoder-only LLM to adaptively extract query-relevant contents verbatim along with the necessary context. |
| Outcome: | Experiments show that a trained Refiner outperforms state-of-the-art RAG and compressing approaches in multiple tasks. |
Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting (2024.findings-naacl)
Copied to clipboard
Zhen Qin, Rolf Jagerman, Kai Hui, Honglei Zhuang, Junru Wu, Le Yan, Jiaming Shen, Tianqi Liu, Jialu Liu, Donald Metzler, Xuanhui Wang, Michael Bendersky
| Challenge: | Existing methods to rank documents using large language models do not understand these challenging ranking formulations. |
| Approach: | They propose to use Pairwise Ranking Prompting to improve ranking performance . they propose to outperform fine-tuned baseline rankers on benchmark datasets . |
| Outcome: | The proposed technique outperforms supervised baselines on benchmark datasets and outperformed other LLM-based solutions by over 10% on average. |
DREAM: Disentangling Risks to Enhance Safety Alignment in Multimodal Large Language Models (2025.naacl-long)
Copied to clipboard
Jianyu Liu, Hangyu Guo, Ranjie Duan, Xingyuan Bu, Yancheng He, Shilong Li, Hui Huang, Jiaheng Liu, Yucheng Wang, Chenchen Jing, Xingwei Qu, Xiao Zhang, Pei Wang, Yanan Wu, Jihao Gu, Yangguang Li, Jianke Zhu
| Challenge: | Multimodal Large Language Models (MLLMs) pose unique safety challenges due to their integration of visual and textual data. |
| Approach: | They propose a method to disentangle risks through step-by-step reasoning within multimodal inputs. |
| Outcome: | The proposed approach improves safety alignment in MLLMs by fine-tuning and iterative Reinforcement Learning from AI feedback. |
Video Paragraph Captioning as a Text Summarization Task (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods for video paragraph captioning use ground-truth event segments. |
| Approach: | They propose a video paragraph captioning task that generates coherent paragraphs without ground-truth event segments. |
| Outcome: | The proposed framework outperforms existing methods on two popular datasets. |
LLM Sensitivity Evaluation Framework for Clinical Diagnosis (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies on the sensitivity of Large Language Models (LLMs) to irrelevant contexts neglect the importance of key information. |
| Approach: | They investigate the sensitivity of large language models to key medical information by introducing different perturbation strategies to investigate their sensitivity. |
| Outcome: | The proposed models are based on three LLMs, namely GPT-3.5, GPT-4, Gemini, Claude3 and LLaMA2-7b, and demonstrate their reliability and sensitivity to medical information. |
Mitigating the Privacy Issues in Retrieval-Augmented Generation (RAG) via Pure Synthetic Data (2025.emnlp-main)
Copied to clipboard
Shenglai Zeng, Jiankun Zhang, Pengfei He, Jie Ren, Tianqi Zheng, Hanqing Lu, Han Xu, Hui Liu, Yue Xing, Jiliang Tang
| Challenge: | Existing literature suggests that RAG systems may face privacy issues when the retrieval process involves private data. |
| Approach: | They propose a two-stage synthetic data generation paradigm that uses attributes to preserve contextual information from the original data. |
| Outcome: | The proposed approach preserves key contextual information from the original data while reducing privacy risks. |
RoChBert: Towards Robust BERT Fine-tuning for Chinese (2022.findings-emnlp)
Copied to clipboard
Zihan Zhang, Jinfeng Li, Ning Shi, Bo Yuan, Xiangyu Liu, Rong Zhang, Hui Xue, Donghong Sun, Chao Zhang
| Challenge: | Pre-trained language models (e.g., BERT) have been proved vulnerable to adversarial texts. |
| Approach: | They propose to fuse Chinese phonetic and glyph features into pre-trained models by using a more comprehensive adversarial graph. |
| Outcome: | The proposed framework outperforms existing methods in significant ways on a wide range of tasks while remaining accurate on benign texts. |
Unraveling the Mechanics of Learning-Based Demonstration Selection for In-Context Learning (2025.acl-long)
Copied to clipboard
| Challenge: | Recent learning-based demonstration selection methods have proven beneficial to in-context learning (ICL) by choosing more useful exemplars. |
| Approach: | They propose two methods to capture task-agnostic similarities between input and output of LLMs. |
| Outcome: | The proposed methods integrate task-agnostic similarities of different levels between input and output of exemplars and test cases to eliminate costly data collection. |
Shallow-to-Deep Training for Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that deep training is 1:4 faster than training from scratch. |
| Approach: | They propose a shallow-to-deep training method that learns deep models by stacking shallow models. |
| Outcome: | The proposed method is 1:4 faster than training from scratch and achieves BLEU scores of 30:33 and 43:29 on two translation tasks. |
Learning to Instruct: Fine-Tuning a Task-Aware Instruction Optimizer for Black-Box LLMs (2025.findings-emnlp)
Copied to clipboard
Yunzhe Qi, Jinjin Tian, Tianci Liu, Ruirui Li, Tianxin Wei, Hui Liu, Xianfeng Tang, Monica Xiao Cheng, Jingrui He
| Challenge: | Learning to Instruct is a new paradigm for black-box LLMs with inaccessible internal states. |
| Approach: | They propose a new paradigm that formulates instruction optimization as an LLM fine-tuning objective for a white-box “instruction engineer” LLM. |
| Outcome: | The proposed framework outperforms strong baselines in performance and efficiency. |
Boundary Matters: Leveraging Structured Text Plots for Long Text Outline Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for generating readable outlines are inability to segment long texts . |
| Approach: | They propose an unsupervised framework to guide large language model outline generation . framework ensures each structured plot encapsulates complete causality by accurately identifying plot boundaries. |
| Outcome: | The proposed framework ensures that each structured plot encapsulates complete causality by accurately identifying plot boundaries. |
Multiple Instance Learning for Offensive Language Detection (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to detect offensive content are expensive and require massive manual effort. |
| Approach: | They propose an approach capable of utilizing the bag-level labeled data for offensive language detection by an annotation-based model. |
| Outcome: | The proposed model can detect offensive language on both bag-level and sentence level. |
Pru-CoT: Towards Efficient Reasoning Distillation via Pruning Chain-of-Thought (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing heuristics fail to capture global causal logic due to rigid rules and limited search spaces. |
| Approach: | They propose a framework that extracts the essential logical structure from reasoning chains. |
| Outcome: | Experiments show that Pru-CoT models generate more compact reasoning paths compared to models trained on verbose data. |
Mitigating Gender Bias for Neural Dialogue Generation with Adversarial Learning (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent research shows that dialogue systems trained on human conversation data are biased and can produce responses that reflect people’s gender prejudice. |
| Approach: | They propose a novel adversarial learning framework Debiased-Chat to train dialogue models free from gender bias while keeping their performance. |
| Outcome: | The proposed framework significantly reduces gender bias in dialogue models while maintaining the response quality. |
DebugBench: Evaluating Debugging Capability of Large Language Models (2024.findings-acl)
Copied to clipboard
Runchu Tian, Yining Ye, Yujia Qin, Xin Cong, Yankai Lin, Yinxu Pan, Yesai Wu, Hui Haotian, Liu Weichuan, Zhiyuan Liu, Maosong Sun
| Challenge: | Large language models (LLMs) have demonstrated exceptional coding capabilities, but their debugging capabilities remain relatively unexplored. |
| Approach: | They propose a debugging benchmark consisting of 4,253 LLMs with four major bug categories and 18 minor types in C++, Java, and Python. |
| Outcome: | The proposed benchmark covers four major bug categories and 18 minor types in C++, Java, and Python. |
Self-Evaluation of Large Language Model based on Glass-box Features (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evaluation methods rely on external evaluators, focusing on training and prompting strategies, but model-aware glass-box features are overlooked. |
| Approach: | They propose to use model-aware glass-box features to evaluate an LLM's output. |
| Outcome: | The proposed model-aware features are reliable quality indicators for self-evaluation on public benchmarks. |
Unsupervised Conversation Disentanglement through Co-Training (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on conversation disentanglement relies heavily on human annotations, which is expensive to obtain in practice. |
| Approach: | They propose to train a conversation disentanglement model without referencing human annotations . they use a message-pair classifier and a session classifier to retrieve local relations . |
| Outcome: | The proposed method achieves competitive performance compared to previous methods on a large movie dialogue dataset. |
Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models (2025.acl-long)
Copied to clipboard
Yancheng He, Shilong Li, Jiaheng Liu, Yingshui Tan, Weixun Wang, Hui Huang, Xingyuan Bu, Hangyu Guo, Chengwei Hu, Boren Zheng, Zhuoran Lin, Dekai Sun, Zhicheng Zheng, Wenbo Su, Bo Zheng
| Challenge: | Current frontier models sometimes generate false outputs or answers that are not substantiated by evidence. |
| Approach: | They propose Chinese SimpleQA, a Chinese benchmark to evaluate LLMs' factuality . they focus on Chinese language over 6 major topics with 99 diverse subtopics . |
| Outcome: | The Chinese SimpleQA benchmark evaluates the factuality ability of LLMs . the questions and answers are short and easy-to-evaluate . |
A Review of Incorporating Psychological Theories in LLMs (2026.eacl-long)
Copied to clipboard
Zizhou Liu, Ziwei Gong, Lin Ai, Zheng Hui, Run Chen, Colin Wayne Leach, Michelle R. Greene, Julia Hirschberg
| Challenge: | a holistic review systematically integrating psychology across the LLM lifecycle remains missing. |
| Approach: | They examine how psychological theories can inform stages of LLM development . they highlight current trends and gaps in how psychological theory is applied . |
| Outcome: | The authors highlight current trends and gaps in how psychological theories are applied . they argue that psychological insights have shaped pivotal NLP breakthroughs . |
EMA: An Episodic Memory Agent for Efficient and Selective Memory (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing memory-augmented methods often incorporate full dialog histories without filtering, resulting in information redundancy and inference latency. |
| Approach: | They propose a framework that abstracts conversational context into Episodic Memory Units (EMUs) they propose EMA, MemDecider and a filtering decision module to reduce noise and improve overall performance. |
| Outcome: | The proposed framework reduces token consumption by 11.48% while improving performance on two widely-used benchmarks. |
A Reward-Guided Dual-Phase Framework for Adaptive Inference-Time Reasoning (2026.findings-acl)
Copied to clipboard
Yingqian Cui, Zhenwei Dai, Pengfei He, Bing He, Hui Liu, Zhan Shi, Xianfeng Tang, Jingying Zeng, Suhang Wang, Yue Xing, Jiliang Tang, Benoit Dumoulin
| Challenge: | Large Language Models (LLMs) have made strong progress in reasoning. |
| Approach: | They propose a dual-phase test-time scaling framework that separates planning and execution and performs search over each phase independently. |
| Outcome: | Experiments on math reasoning and code generation benchmarks show that the proposed approach improves accuracy while reducing redundant computation. |
Improving Pretrained Models for Zero-shot Multi-label Text Classification through Reinforced Label Hierarchy Reasoning (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing zero-shot learning methods for multi-label text classification mostly learn a matching model between the feature space of text and the label space. |
| Approach: | They propose to use a graph encoder to incorporate label hierarchies to learn effective label representations on the zero-shot multi-label text classification problem. |
| Outcome: | The proposed approach outperforms previous non-pretrained methods on the zero-shot multi-label text classification task. |
From Completion to Editing: Unlocking Context-Aware Code Infilling via Search-and-Replace Instruction Tuning (2026.acl-long)
Copied to clipboard
Jiajun Zhang, Zeyu Cui, Jiaxi Yang, Lei Zhang, Yuheng Jing, Zeyao Ma, Tianyi Bai, Zilei Wang, Qiang Liu, Liang Wang, Binyuan Hui, Junyang Lin
| Challenge: | Fill-in-the-Middle (FIM) models suffer from performance degradation and prohibitive latency. |
| Approach: | They propose a search-and-replace infilling framework that integrates agentic verification and editing into a single-pass inference process. |
| Outcome: | The proposed framework harmonizes completion tasks with the instruction-following priors of Chat LLMs, extending the paradigm from static infilling to dynamic context-aware editing. |
NLP+Code: Code Intelligence in Language Models (2025.emnlp-tutorials)
Copied to clipboard
| Challenge: | Language models have shown impressive abilities in a range of natural language processing tasks. |
| Approach: | This tutorial will provide an overview of the latest advances in natural language processing . it will provide preliminaries of training foundation models on code and their common practices . |
| Outcome: | This tutorial aims to provide an overview of recent advances in code modeling . it provides preliminaries of training foundation models on code and their common practices . |
Anchoring the Cache: Mitigating Contextual Hallucination in KV-Compressed Long-Context Summarization (2026.acl-long)
Copied to clipboard
| Challenge: | Recent studies show that KV cache compression can increase hallucination scores in LLMs . modern LLM models support extremely long sequences, but their impact on model hallucinosity remains underexplored. |
| Approach: | They propose a decoding-phase strategy that selectively removes generated KV pairs from retrieval heads responsible for retrieving critical information from source context. |
| Outcome: | The proposed method reduces hallucination across multiple models and datasets while preserving computational efficiency. |
Reasoning with Graphs: Structuring Implicit Knowledge to Enhance LLMs Reasoning (2025.findings-acl)
Copied to clipboard
Haoyu Han, Yaochen Xie, Hui Liu, Xianfeng Tang, Sreyashi Nag, William Headden, Yang Li, Chen Luo, Shuiwang Ji, Qi He, Jiliang Tang
| Challenge: | Large language models (LLMs) have demonstrated remarkable success across a wide range of tasks, however, they still face challenges in reasoning tasks that require understanding and inferring relationships between distinct pieces of information within text sequences. |
| Approach: | They propose to construct explicit graphs from context and leverage them to enhance LLM reasoning performance on reasoning tasks. |
| Outcome: | Extensive experiments show that the proposed method improves both logical reasoning and multi-hop question answering tasks. |
MoEC: A Memory-Routed Mixture-of-Experts Controller for Adaptive Minecraft Control (2026.acl-long)
Copied to clipboard
| Challenge: | Existing systems rely on a monolithic policy to execute subgoals across varying contexts, causing inconsistent outcomes and scaling only partially mitigates. |
| Approach: | They propose a memory-routed mixtureof-experts controller for Adaptive Minecraft Control that routes via a subgoal-indexed expert memory and regulates capacity through failure-triggered expert growth and redundancy-aware consolidation. |
| Outcome: | The proposed controller shows significant gains in adaptability, robustness, and execution consistency over strong baselines. |
Graph-Assisted Large Language Models: A Perspective on Mitigating Intrinsic Limitations (2026.findings-acl)
Copied to clipboard
Haitong Luo, Fali Wang, Weiyao Zhang, Xianren Zhang, Zhiwei Zhang, Tianxiang Zhao, Minhua Lin, Jiahao Zhang, Hui Liu, Xianfeng Tang, Qi He, Suhang Wang, Xuying Meng, Yujun Zhang
| Challenge: | Large language models exhibit intrinsic limitations such as knowledge cutoff, single-threaded reasoning that hinders finer-grained branch and aggregation, and rigid collaboration mechanisms that struggle to coordinate specialized capabilities. |
| Approach: | They propose a taxonomy spanning *Graph-Assisted Knowledge Augmentation*, *Graph Assisted Reasoning and Planning*, and *Graphed LLM Collaboration*. |
| Outcome: | The proposed models show that graphs can augment and correct LLMs and support dynamic coordination among experts and agents in collaborative settings. |
Investigating and Enhancing the Robustness of Large Multimodal Models Against Temporal Inconsistency (2025.acl-long)
Copied to clipboard
Jiafeng Liang, Shixin Jiang, Xuan Dong, Ning Wang, Zheng Chu, Hui Su, Jinlan Fu, Ming Liu, See-Kiong Ng, Bing Qin
| Challenge: | Large Multimodal Models (LMMs) have demonstrated impressive performance on general video comprehension benchmarks, but their robustness needs to be thoroughly investigated for broader applications. |
| Approach: | They propose a temporal robustness benchmark which introduces temporal inconsistency perturbations separately at the visual and textual modalities to assess the robustness of models. |
| Outcome: | The proposed method improves the model’s robustness and reliability in temporal analysis. |
LogToP: Logic Tree-of-Program with Table Instruction-tuned LLMs for Controlled Logical Table-to-Text Generation (2026.findings-eacl)
Copied to clipboard
Yupian Lin, Guangya Yu, Cheng Yuan, Huan Du, Hui Luo, Yuang Bian, Jingping Liu, Zhidong He, Wen Du, Tong Ruan
| Challenge: | Existing LLMs are difficult to achieve satisfactory results in table-related tasks. |
| Approach: | They propose to develop a specialized logical table-to-text generation model that can be used for table-related tasks. |
| Outcome: | The proposed model achieves state-of-the-art on a Logic2Text dataset. |
Learning as Conversation: Dialogue Systems Reinforced for Information Acquisition (2022.naacl-main)
Copied to clipboard
| Challenge: | a novel AI-empowered chat bot for learning as conversation can be applied to various domains without in-domain dialogue data. |
| Approach: | They propose a novel task where a user does not read a passage but gains information and knowledge through conversation with a teacher bot. |
| Outcome: | The proposed system can be transferred to various domains without in-domain dialogue data and can carry out conversations both informative and attentive to users. |
Interpretable Multimodal Misinformation Detection with Logic Reasoning (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for misinformation detection lack interpretability due to the black-box nature of the neural network. |
| Approach: | They propose a logic-based neural model which integrates interpretable logic clauses to express the reasoning process of the target task. |
| Outcome: | The proposed model can be generalizable across multiple misinformation sources and is based on three public datasets. |
Saliency-based Multi-View Mixed Language Training for Zero-shot Cross-lingual Classification (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Recent multilingual pre-trained models have been demonstrated effective in many cross-lingual tasks. |
| Approach: | They propose a framework that leverages code-switched data with multi-view learning to fine-tune XLM-R. |
| Outcome: | The proposed model achieves state-of-the-art on zero-shot cross-lingual sentiment classification and dialogue state tracking tasks. |
Toward Annotator Group Bias in Crowdsourcing (2022.acl-long)
Copied to clipboard
Haochen Liu, Joseph Thekinen, Sinem Mollaoglu, Da Tang, Ji Yang, Youlong Cheng, Hui Liu, Jiliang Tang
| Challenge: | Annotator group bias is a common problem in crowdsourcing, but is often overlooked . |
| Approach: | They propose a probabilistic framework to capture annotator group bias using an extended Expectation Maximization algorithm. |
| Outcome: | The proposed model can model annotator group bias over competitive datasets and demonstrate that it is effective over multiple datasets. |
GenTool: Enhancing Tool Generalization in Language Models through Zero-to-One and Weak-to-Strong Simulation (2025.findings-acl)
Copied to clipboard
Jie He, Jennifer Neville, Mengting Wan, Longqi Yang, Hui Liu, Xiaofeng Xu, Xia Song, Jeff Z. Pan, Pei Zhou
| Challenge: | Large Language Models (LLMs) can expand their capabilities by integrating external tools. |
| Approach: | They propose a training framework that prepares LLMs for diverse generalization challenges in tool utilization. |
| Outcome: | The proposed framework improves the tool-usage capabilities of LLMs by up to 8B parameters, surpassing GPT-4o. |
SpeechLLM-as-Judges: Towards General and Interpretable Speech Quality Evaluation (2026.acl-long)
Copied to clipboard
Hui Wang, Jinghua Zhao, Yifan Yang, Shujie Liu, Junyang Chen, Yanzhe Zhang, Shiwan Zhao, Jinyu Li, Jiaming Zhou, Haoqin Sun, Yan Lu, Yong Qin
| Challenge: | Existing methods for evaluating the perceptual quality of synthetic speech are limited due to the complexity of perceptual quality factors and the diversity of speech generation tasks. |
| Approach: | They propose a new paradigm for enabling large language models to conduct structured speech quality evaluation using a large-scale dataset. |
| Outcome: | The proposed model performs well across tasks and languages. |