Papers by Qiang Wang

85 papers
Attention-guided Self-reflection for Zero-shot Hallucination Detection in Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Hallucination is a significant barrier to the effective application of Large Language Models (LLMs).
Approach: They propose an Attention-Guided SElf-Reflection approach for hallucination detection in Large Language Models.
Outcome: The proposed method significantly outperforms existing methods in zero-shot hallucination detection on four widely-used LLMs across three different halluciation benchmarks.
Make Your Decision Convincing! A Unified Two-Stage Framework: Self-Attribution and Decision-Making (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing frameworks for explaining black-box model behavior are unreliable . large-scale pre-trained models often rely on superficial clues for predictions .
Approach: They propose a unified two-stage framework that uses subsequences from the input text as a rationale to generate model decision.
Outcome: The proposed framework achieves competitive results on five reasoning datasets and in semi-supervised scenarios.
Beyond the Final Actor: Modeling the Dual Roles of Creator and Editor for Fine-Grained LLM-Generated Text Detection (2026.acl-long)

Copied to clipboard

Challenge: Existing methods to detect large language models (LLMs) use binary or ternary classifications, which can only distinguish pure human/LLM text or collaborative text at best.
Approach: They propose a fine-grained method that characterizes distinct signatures of creator and editor by using Rhetorical Structure Theory to construct a logic graph for creator's foundation and extracting Elementary Discourse Unit (EDU)-level features for the editor's style.
Outcome: The proposed method outperforms 12 baselines in identifying fine-grained types with low false alarms, offering a policy-aligned solution for LLM regulation.
A Survey on Asking Clarification Questions Datasets in Conversational Systems (2023.acl-long)

Copied to clipboard

Challenge: Existing studies on Asking Clarification Questions (ACQs) are incomparable due to inconsistent data, experimental setups and evaluation strategies.
Approach: They analyse the current research status on Asking Clarification Questions (ACQs) and propose a set of evaluation metrics and benchmarks for multiple ACQs-related tasks.
Outcome: The proposed techniques are compared with the available datasets and evaluated against benchmarks.
Logical Closed Loop: Uncovering Object Hallucinations in Large Vision-Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Object hallucination has been an Achilles’ heel which hinders the broader applications of large vision-language models (LVLMs).
Approach: They propose a logical closed loop-based framework for Object Hallucination Detection and Mitigation that uses logical consistency probing to raise questions with logical correlations to determine hallucinations.
Outcome: The proposed method can be applied to all existing LVLMs and is effective and general.
Exploring Knowledge Filtering for Retrieval-Augmented Discriminative Tasks (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies have focused on generative tasks, while its potential in discriminative tasks remains largely unexplored.
Approach: They propose a framework that incorporates knowledge filtering and prediction fusion mechanisms to improve model performance.
Outcome: The proposed framework improves model performance on discriminative tasks by filtering out harmful knowledge and integrating it into the input context.
RepoDistill: Distilling Repository Knowledge through Compression-Aware Budget Allocation and Policy Optimization (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have strong performance on code translation tasks, but they struggle with repository-level scenarios where context is extensive and interdependent.
Approach: They propose a framework that integrates retrieval with learning budget allocation for fine-grained context compression.
Outcome: The proposed framework outperforms baselines on SWE-QA, CoderEval, and LongCodeU.
EventRAG: Enhancing LLM Generation with Event Knowledge Graphs (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to text generation often neglect event structures that shape real-world narratives.
Approach: They propose a framework that integrates structured event semantics with iterative retrieval and inference to enhance text generation.
Outcome: Experiments on UltraDomain and MultiHopRAG show that the proposed framework outperforms baseline RAG systems in generation effectiveness, logical consistency, and multi-hop reasoning accuracy.
Probing Relative Interaction and Dynamic Calibration in Multi-modal Entity Alignment (2025.acl-long)

Copied to clipboard

Challenge: Current methods for multi-modal entity alignment ignore relative interactions between modalities and the accuracy of weights.
Approach: They propose a relative interaction and calibration framework for multi-modal entity alignment that uses attention mechanisms to perceive the uncertainty of the weight for each modality.
Outcome: The proposed framework outperforms baselines across 5 datasets and 23 settings.
ReCreate: Reasoning and Creating Domain Agents Driven by Experience (2026.acl-long)

Copied to clipboard

Challenge: Large Language Model (LLM) agents are reshaping the industrial landscape, but tasks differ widely, making them labor-intensive to build.
Approach: They propose an experience-driven framework for the automatic creation of domain agents . they leverage agent interaction histories to provide rich concrete signals on success or failure .
Outcome: The proposed framework outperforms human-designed agents and existing methods in experiments across diverse domains.
RealChart2Code: Bridging the Gap in Real-World Chart-to-Code Generation via Multi-Task Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Vision-Language Models (VLMs) have demonstrated impressive capabilities in code generation across various domains, but their ability to replicate complex, multi-panel visualizations remains largely unassessed.
Approach: They propose a large-scale benchmark to evaluate chart generation from large- scale raw data and assess iterative code refinement in a multi-turn conversational setting.
Outcome: The new benchmark evaluates 14 leading VLMs on real-world data and shows they struggle with complex plot structures and authentic data.
UniSonate: A Unified Model for Speech, Music, and Sound Effect Generation with Text Instructions (2026.acl-long)

Copied to clipboard

Challenge: Generative audio modeling has been fragmented into specialized tasks such as text-to-speech (TTS), text- to-music (TTM), and text-ta (TTA) specialized models require reference audio for timbre cloning and strict phoneme alignment, whereas TTA models generate unstructured textures from open-ended captions.
Approach: They propose a unified flow-matching framework capable of synthesizing speech, music, sound effects . they propose 'token injection mechanism' that projects unstructured environmental sounds into structured temporal latent space .
Outcome: The proposed framework achieves state-of-the-art performance in instruction-based TTS and TTM while maintaining competitive fidelity in TTA.
Beyond Frameworks: Unpacking Collaboration Strategies in Multi-Agent Systems (2025.acl-long)

Copied to clipboard

Challenge: Existing frameworks prioritize structural architectures and role assignments but neglect granular mechanics of agent collaboration.
Approach: They propose to use centralized governance, instructor-led participation, ordered interaction patterns to optimize task accuracy and computational efficiency.
Outcome: The proposed model improves task accuracy and computational efficiency under two context-dependent scenarios.
Exploring Hybrid Sampling Inference for Aspect-based Sentiment Analysis (2025.findings-naacl)

Copied to clipboard

Challenge: Existing methods for inference require multiple sampling with preset size . however, it is a high-cost method that requires multiple sampling .
Approach: They propose a method that combines multiple and single sampling to greatly reduce the cost of multiple sampling without sacrificing performance.
Outcome: The proposed method greatly reduces the cost of multiple sampling without sacrificing performance.
Early Exit with Disentangled Representation and Equiangular Tight Frame (2023.findings-acl)

Copied to clipboard

Challenge: Existing early exit paradigm relies on training parametrical internal classifiers to complete specific tasks.
Approach: They propose a method to decouple two distinct types of representation and introduce a non-parametric tight frame classifier for improvement.
Outcome: Experiments on monolingual and multilingual tasks show that the proposed method improves over existing methods.
SINCon: Mitigate LLM-Generated Malicious Message Injection Attack for Rumor Detection (2025.acl-long)

Copied to clipboard

Challenge: Existing methods define important nodes as important and target them for attacks if the model treats nodes’ predictive influence more uniformly . Existing approaches target high predictive influence nodes but are vulnerable to malicious message injection attacks.
Approach: They propose a defense mechanism that encourages the model to learn graph representations where nodes with varying importance have a more uniform influence on predictions.
Outcome: Extensive experiments on the Twitter and Weibo datasets show that similarizing the predictive Influence of nodes with Contrastive Learning significantly enhances resistance against LLM-driven message injection attacks.
Understanding and Improving the Robustness of Terminology Constraints in Neural Machine Translation (2023.acl-long)

Copied to clipboard

Challenge: Existing terminology constraint test sets are blind to this issue due to oversimplified settings . PH methods retain high constraint accuracy but lower translation quality .
Approach: They propose a method that replaces terminology terms with ordered labels . placeholder methods are better at retaining high constraint accuracy but lower translation quality .
Outcome: The proposed method achieves high accuracy and translation quality regardless of the number or length of constraints.
Personalized Text Generation with Contrastive Activation Steering (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to personalized text generation rely on retrieval-augmented generation and parameter-efficient fine-tuning.
Approach: They propose a training-free framework that disentangles and represents personalized writing style as a vector in LLM’s activation-space.
Outcome: The proposed framework achieves 8% relative improvement in personalized generation while reducing storage requirements by 1700 over PEFT method.
KELE: Residual Knowledge Erasure for Enhanced Multi-hop Reasoning in Knowledge Editing (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing knowledge editing techniques show limitations when applied to multi-hop reasoning . residual single-hop knowledge causes edited models to revert to original answers .
Approach: They propose a knowledge editing method that incorporates a Knowledge Erasure mechanism for Large language model Editing (KELE) they propose an erasure function for residual knowledge and an injection function for new knowledge .
Outcome: The proposed method significantly improves multi-hop reasoning capability of edited models.
GenPilot: A Multi-Agent System for Test-Time Prompt Optimization in Image Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for text-to-image synthesis lack systematic error analysis and refinement strategies, resulting in limited reliability and effectiveness.
Approach: They propose a plug-and-play multi-agent system called GenPilot that integrates error analysis, clustering-based adaptive exploration, fine-grained verification and a memory module for iterative optimization.
Outcome: The proposed method improves text consistency and structural coherence on images with a plug-and-play system.
Logical Consistency as a Bridge: Improving LLM Hallucination Detection via Label Constraint Modeling between Responses and Self-Judgments (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for hallucination detection focus on implicit neural uncertainty or explicit symbolic reasoning, ignoring factual hallucinosities.
Approach: They propose a framework that bridges neural features and symbolic judgments for hallucination detection by leveraging a "meta-judgment" process to map symbolic labels back into the feature space.
Outcome: Extensive experiments on 4 public datasets, across 4 LLMs, against 8 baselines demonstrate the superiority of LaaB.
EX-FEVER: A Dataset for Multi-hop Explainable Fact Verification (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies on fact verification lack a high-quality dataset for explainability . existing systems lack evidence retrieval and veracity prediction, limiting the ability to verify a claim .
Approach: They propose a dataset for multi-hop explainable fact verification that summarises and modifies Wikipedia documents.
Outcome: The proposed dataset aims to improve the accuracy of multi-hop explainable fact verification systems.
Revisiting the Self-Consistency Challenges in Multi-Choice Question Formats for Large Language Model Evaluation (2024.lrec-main)

Copied to clipboard

Challenge: Multi-choice questions (MCQs) are a common method for assessing the world knowledge of large language models.
Approach: They propose three knowledge-equivalent question variants to assess LLMs' world knowledge . they propose option position shuffle, option label replacement, and conversion to a True/False format .
Outcome: The proposed questions are shuffle, label replacement, and True/False format.
Mitigating Action-Relation Hallucinations in LVLMs via Relation-aware Visual Enhancement (2026.acl-long)

Copied to clipboard

Challenge: Existing research has focused on mitigating object hallucinations but often overlooks more complex relation hallucines, especially action relations involving interactions between objects.
Approach: They propose a framework to locate action-relevant image regions and enhance the LVLM’s attention to those regions by using a Relation-aware Visual Enhancement method.
Outcome: The proposed method achieves superior performance in mitigating action-relation hallucinations with negligible additional inference cost.
Commonsense Knowledge Salience Evaluation with a Benchmark Dataset in E-commerce (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing models rank statements solely by confidence scores, and there is no information about which ones are salient from a human perspective.
Approach: They propose a task where a model is required to learn whether a triple is salient . they propose supervised salience evaluation using a new Benchmark dataset .
Outcome: The proposed task is based on a new Benchmark dataset of salience evaluation in e-commerce . it shows that saliency evaluation is hard, where models perform poorly on evaluation set .
GAPO: Robust Advantage Estimation for Real-World Code LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Reinforcement learning (RL) is widely used for post-training large language models (LLMs) in code editing, but in real-world code editing scenarios, reward distributions are often skewed with unpredictable noise, leading to distorted advantage computation and increased rollout outliers.
Approach: They propose a group-relative method that finds an interval with the highest SNR and uses the median of that interval as an adaptive Q to replace the group mean in advantage calculation.
Outcome: The proposed method improves on nine instruction-tuned LLMs while remaining plug-and-play and efficient.
Beyond Quantity: Trajectory Diversity Scaling for Code Agents (2026.findings-acl)

Copied to clipboard

Challenge: Code large language models (LLMs) are becoming tool-interactive agents . quantity-centric scaling exhibits an early bottleneck that underutilizes trajectory data . et al.: a new approach to scale trajectory diversity improves tool-use generalization .
Approach: They propose a Trajectory Diversity Scaling-based data synthesis framework for code agents that scales performance through diversity rather than raw volume.
Outcome: Experiments on general tool-use benchmarks and code agent tasks show that TDScaling improves tool-user generalization and inherent coding proficiency.
Chain-of-History Reasoning for Temporal Knowledge Graph Forecasting (2024.findings-acl)

Copied to clipboard

Challenge: Existing graph-based models excel at capturing structural information within TKGs but lack semantic comprehension abilities.
Approach: They propose a plug-and-play module to enhance the performance of graph-based TKG models by exploring high-order histories step-by-step.
Outcome: Experiments on three datasets and backbones show that CoH is effective in capturing high-order historical information for LLMs.
Logic-Thinker: Teaching Large Language Models to Think more Logically. (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent Large Reasoning Models (LRMs) have demonstrated the ability to generate long chains of thought (LongCoT) LongCoT still faces challenges such as redundancy and logical incoherence.
Approach: They propose a neural-symbolic reasoning framework that generates chains of thought . they propose Logic-Thinker, which transforms symbolic solvers into chains of thoughts .
Outcome: The proposed framework outperforms models fine-tuned with ThinkerCoT on logic reasoning tasks.
Employing Glyphic Information for Chinese Event Extraction with Vision-Language Model (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent studies on event extraction have incorporated a variety of features, including textual elements and annotations.
Approach: They propose a glyphic multi-modal Chinese event extraction model with hieroglyphic images to capture morphological structure from the sequence.
Outcome: The proposed model can extract events from a Chinese and KBP Eval datasets at low cost.
Diving into Mitigating Hallucinations from a Vision Perspective for Large Vision-Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks focus on coarse-grained hallucination detection and fail to capture hallucinics . vision encoders exhibit unique hallucinian characteristics, but suboptimal of simple feature fusion.
Approach: They propose a visual encoder that employs different training paradigms to instill inductive biases in visual encoded models.
Outcome: The proposed system reduces hallucinations and improves model performance.
Zoom Out and Observe: News Environment Perception for Fake News Detection (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for fake news detection "zoom in" to verify content with knowledge sources or check readers’ replies to posts but neglect information in the external news environment where a fake news post is created and disseminated.
Approach: They propose a framework to capture news environment signals and a module to perceive useful signals and assist final prediction.
Outcome: The proposed framework can improve the performance of basic fake news detectors by capturing the environmental signals of news posts and analyzing the results.
Learn over Past, Evolve for Future: Forecasting Temporal Trends for Fake News Detection (2023.acl-industry)

Copied to clipboard

Challenge: Existing work on fake news detection does not consider the temporal shift issue caused by the rapidly-evolving nature of news data.
Approach: They propose a framework to forecast temporal patterns of news data and guide detector to fast adapt to future distributions.
Outcome: The proposed framework forecasts temporal distribution patterns and guides detector to fast adapt to future distribution.
Learning Cross-Architecture Instruction Embeddings for Binary Code Analysis in Low-Resource Architectures (2024.findings-naacl)

Copied to clipboard

Challenge: Applying deep learning to binary code analysis has drawn great attention because of its notable performance.
Approach: They propose to learn cross-architecture instruction embeddings where semantically-similar instructions have close embeddements in a shared space.
Outcome: The proposed approach generates high-quality CAIE with good transferability on four ISAs.
HSGraphAgent: Knowledge-Graph-Guided Large Language Models for Harmonized System Code Classification (2026.acl-long)

Copied to clipboard

Challenge: Harmonized System (HS) code classification is a hierarchically structured and regulation-constrained task, often complicated by short and noisy product descriptions.
Approach: They propose a knowledge-graph-guided LLM framework that formulates HS classification as a stepwise, regulation-aware reasoning process over an explicit HS knowledge graph.
Outcome: The proposed framework constrains inference to legally valid paths while producing explicit and traceable reasoning trajectories.
MorphoBench: A Benchmark with Difficulty Adaptive to Model Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks designed to evaluate the reasoning capabilities of large models are limited in scope and lack flexibility to adapt difficulty according to evolving reasoning capacities of models.
Approach: They propose a benchmark that incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models.
Outcome: The proposed benchmark incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models.
Tailoring Rumor Debunking to You: Diversifying Chinese Rumor-Debunking Passages with an LLM-Driven Simulated Feedback-Enhanced Framework (2026.eacl-industry)

Copied to clipboard

Challenge: Existing methods for fact-checking lack coherence and context, whereas abstractive methods lack cohesion and context.
Approach: They propose a framework that generates Chinese user-specific debunking passages . they propose to use a generative AI framework to generate context-sensitive responses .
Outcome: The proposed framework generates Chinese user-specific debunking passages by iteratively refining outputs based on simulated user feedback.
UnrealLLM: Towards Highly Controllable and Interactable 3D Scene Generation by LLM-powered Procedural Content Generation (2025.findings-acl)

Copied to clipboard

Challenge: UnrealLLM is a novel framework that connects natural language descriptions with the professional PCG system (Unreal Engine 5) to automate scene generation.
Approach: They propose a novel multi-agent framework that connects natural language descriptions with the professional PCG system (Unreal Engine 5) to automate scene generation.
Outcome: The proposed framework achieves competitive performance in technical metrics and aesthetic quality, offering unique advantages in generation scale and interactivity.
Forewarned is Forearmed: Pre-Synthesizing Jailbreak-like Instructions to Enhance LLM Safety Guardrail to Potential Attacks (2025.findings-emnlp)

Copied to clipboard

Challenge: Despite advances in improving large language model (LLM) to refuse to answer malicious instructions, LLMs remain vulnerable to jailbreak attacks where attackers generate instructions with distributions differing from safety alignment corpora.
Approach: They propose a framework that leverages embedding space distribution analysis to generate jailbreak-like instructions.
Outcome: The proposed framework shows significant decreases in attack success rate on Qwen2.5, Llama3.1, and Llma3.2 without compromising their utility.
Hybrid-Regressive Paradigm for Accurate and Speed-Robust Neural Machine Translation (2023.findings-acl)

Copied to clipboard

Challenge: Autoregressive translation (NAT) is less robust in decoding batch size and hardware settings than NAT.
Approach: They propose a two-stage translation prototype that prompts a small number of AT predictions and fills in previously skipped tokens at once.
Outcome: The proposed translation prototype achieves comparable translation quality with AT while having 1.5x faster inference speed regardless of batch size and device.
Enhancing Safe and Controllable Protein Generation via Knowledge Preference Optimization (2025.acl-long)

Copied to clipboard

Challenge: Protein language models pose significant risks of generating harmful sequences, e.g., viral transmissibility, drug resistance, environmental imbalances, public health crises, etc.
Approach: They propose a protein-based model that integrates prior knowledge via a Protein Safety Knowledge Graph to minimize the risk of generating harmful sequences.
Outcome: The proposed framework reduces the likelihood of producing hazardous sequences while maintaining high functionality.
The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmas (2025.emnlp-main)

Copied to clipboard

Challenge: Existing evaluations of LLMs' moral reasoning capabilities rely on single-step evaluations, ignoring how models adapt to evolving ethical challenges.
Approach: They propose a framework to evaluate evolving moral judgments of large language models (LLMs) using multi-step moral dilemma questionnaires.
Outcome: The proposed framework enables a fine-grained analysis of how LLMs adjust their moral reasoning across escalating dilemmas.
A2ATS: Retrieval-Based KV Cache Reduction via Windowed Rotary Position Embedding and Query-Aware Vector Quantization (2025.findings-acl)

Copied to clipboard

Challenge: Long context large language models (LLMs) pose significant challenges for efficient serving due to the large memory footprint and high access overhead of KV cache.
Approach: They propose a retrieval-based method to reduce the memory footprint of LLMs . they propose Windowed Rotary Position Embedding and query-aware vector quantization .
Outcome: The proposed method can achieve lower performance degradation with lower overhead compared to existing methods . it can reduce the memory footprint and access overhead of long context large language models .
Toolscaler: Scalable Generative Tool Calling via Structure-Aware Semantic Tokenization (2025.findings-emnlp)

Copied to clipboard

Challenge: Extensive experiments demonstrate the effectiveness of SGTC across various tasks.
Approach: They propose a generative tool invocation framework that introduces structure-aware semantic tokenization to encode tools as discrete code sequences.
Outcome: The proposed framework reduces the size of the representation space and underutilizes collaborative signals among tools in downstream tasks.
Adaptive Gating in Mixture-of-Experts based Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Existing models employ a fixed gating network where each token is computed by the same number of experts.
Approach: They propose a flexible training strategy that allows tokens to be processed by a variable number of experts based on expert probability distribution.
Outcome: The proposed model reduces training time and inference quality while maintaining sparsity while maintaining inference accuracy.
Multi-layer Representation Fusion for Neural Machine Translation (C18-1)

Copied to clipboard

Challenge: Neural machine translation systems require a number of stacked layers for deep models, but the prediction depends on the sentence representation of the top-most layer with no access to low-level representations.
Approach: They propose a multi-layer representation fusion approach to fusing stacked layers to learn a better representation from the stack.
Outcome: The proposed approach yields 0.92 and 0.56 BLEU points over the strong Transformer baseline on IWSLT German-English and NIST Chinese-English MT tasks respectively.
MapNav: A Novel Memory Representation via Annotated Semantic Maps for VLM-based Vision-and-Language Navigation (2025.acl-long)

Copied to clipboard

Challenge: Vision-language navigation (VLN) is a key task in Embodied AI . traditional approaches rely on historical observations as spatio-temporal contexts for decision making .
Approach: They propose a vision-language navigation model that leverages an annotation system to replace historical frames.
Outcome: The proposed model can be used as a new memory representation method in vision-language navigation . it can be applied to simulated and real-world environments, and it is validated by experiments .
Aligning to Constraints for Data-Efficient Language Model Customization (2025.findings-naacl)

Copied to clipboard

Challenge: General-purpose language models (LMs) are aligned to diverse user intents, but fall short when it comes to specific applications.
Approach: They propose a framework that uses constraints to automatically produce supervision signals for user alignment with constraints.
Outcome: The proposed framework can produce supervision signals for user alignment with constraints.
Learning Decoupled Retrieval Representation for Nearest Neighbour Neural Machine Translation (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to integrate external corpus are sparse in practical applications, and noises in low similarity retrieval could lead to severe performance degradation.
Approach: They propose a method to integrate external corpus into k-nearest neighbor machine translation (kNNMT) instead of storing discrete word sequence, kNN-MT uses a pre-trained NMT model to force decoding the external corpi.
Outcome: The proposed approach improves retrieval accuracy and BLEU score on five domains compared to vanilla kNNMT.
Counterfactual Debiasing for Fact Verification (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for debiasing factchecking models learn such biases instead of understanding the semantic relationship between the claim and evidence.
Approach: They propose a counterfactual framework CLEVER which is augmentation-free and mitigates biases on the inference stage.
Outcome: The proposed method is augmentation-free and mitigates biases on the inference stage.
Learning Latent Relations for Temporal Knowledge Graph Reasoning (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for Temporal Knowledge Graph reasoning capture intra- and inter-time latent relations between entities that appear at different times.
Approach: They propose a Latent relations Learning method for TKG reasoning that captures latent relations between entities at different times.
Outcome: The proposed method exploits the intra- and inter-time latent relations of entities at different times.
LLMs May Perform MCQA by Selecting the Least Incorrect Option (2025.coling-main)

Copied to clipboard

Challenge: Multiple Choice Question Answering (MCQA) is a fundamental format for various tasks in NLP, such as commonsense reasoning.
Approach: They propose a method to increase the number of correct options in a dataset.
Outcome: The proposed method improves the performance of multiple choice question answering (MCQA) and improves its accuracy.
Training Flexible Depth Model by Multi-Task Learning for Neural Machine Translation (2020.findings-emnlp)

Copied to clipboard

Challenge: Experimental results show that multitask learning can support decoding in 24 depth configurations and is superior to individual training.
Approach: They propose to use multi-task learning to train a flexible depth model that can adapt to different depth configurations during inference.
Outcome: The proposed model can support decoding in 24 depth configurations and is superior to the individual training and another flexible depth model training method——LayerDrop.
Sample-Efficient Human Evaluation of Large Language Models via Maximum Discrepancy Competition (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for evaluation of large language models are inefficient and inefficient due to inaccuracy of standard metrics in human perception of text quality and inefficiency in sampling informative test examples.
Approach: They propose a sample-efficient human evaluation method for large language models based on the principle of MAximum Discrepancy (MAD) competition.
Outcome: The proposed method achieves the “golden” ranking of LLMs with a minimum set of input instructions, which in turn reveal their relative strengths and weaknesses.
ALYMPICS: LLM Agents Meet Game Theory (2025.coling-main)

Copied to clipboard

Challenge: Alympics provides a framework for simulating human-like strategic interactions with Large Language Model (LLM) agents.
Approach: They propose a framework utilizing Large Language Models (LLM) agents for empirical game theory research.
Outcome: The proposed framework can be used to study human-like strategic interactions with large language model (LLM) agents in a game on the multi-round auction of scarce survival resources.
SHARP: Steering Hallucination in LVLMs via Representation Engineering (2025.emnlp-main)

Copied to clipboard

Challenge: Large Vision-Language Models (LVLMs) generate responses that are plausible but incorrect or unsupported—commonly referred to as hallucinations.
Approach: They propose a representation-level intervention framework that modulates hallucination-related features during inference by probing their encoded features.
Outcome: The proposed framework reduces hallucinations while maintaining the performance and generalization capabilities of Large Vision-Language Models (LVLMs).
Layer-Wise Multi-View Learning for Neural Machine Translation (2020.coling-main)

Copied to clipboard

Challenge: Existing approaches to neural machine translation are limited to the topmost encoder layer’s context representation and cannot perceive the lower encoder layers.
Approach: They propose a layer-wise multi-view learning approach to solve this problem by incorporating an auxiliary view into the model.
Outcome: The proposed model can achieve stable results over multiple strong baselines and is agnostic to network architectures.
A Simple and Effective Approach to Coverage-Aware Neural Machine Translation (P18-2)

Copied to clipboard

Challenge: Neural Machine Translation (NMT) models are used to solve translation problems using long-term models.
Approach: They propose a method to seek a better balance between model confidence and length preference for Neural Machine Translation.
Outcome: The proposed model improves on Chinese-English and English-German translation tasks.
Plug-and-Play Data Module for Code RL: Adaptive Ambiguity Replay (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to reinforcement learning (RL) rely on static, in-epoch metrics that overlook training dynamics, often introducing low-utility or outdated data.
Approach: They propose a plug-and-play module that prioritizes cross-epoch ambiguous samples to neutralize the noise from stale experiences.
Outcome: Extensive experiments on nine LLMs show that Adaptive Ambiguity Replay outperforms state-of-the-art baselines on real-world code editing tasks.
RIVAL: Reinforcement Learning with Iterative and Adversarial Optimization for Machine Translation (2025.findings-emnlp)

Copied to clipboard

Challenge: Using reinforcement learning from human feedback, large language models perform poorly when applied to colloquial subtitle translation tasks.
Approach: They propose an adversarial training framework that iteratively updates the offline reward model and the online LLM to improve training outcomes.
Outcome: The proposed training framework significantly improves upon translation baselines.
Integrating Semantic and Structural Information with Graph Convolutional Network for Controversy Detection (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for identifying controversial posts on social media are limited . existing methods fail to incorporate semantic information from content-related posts .
Approach: They propose a method to integrate the information from topics, posts, and comments . they extend their model to Disentangled TPC-GCN to disentangle topic-related features .
Outcome: The proposed method outperforms existing methods on two real-world datasets.
LPZero: Language Model Zero-cost Proxy Search from Zero (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing zero-cost (ZC) proxies rely on expert knowledge and incur significant trial-and-error costs.
Approach: They propose a framework that automatically designs zero-cost (ZC) proxies for various tasks and incorporates genetic programming to find the optimal symbolic composition.
Outcome: The proposed framework achieves higher ranking consistency than human-designed proxies on NLP tasks.
GenKIE: Robust Generative Multimodal Document Key Information Extraction (2023.findings-emnlp)

Copied to clipboard

Challenge: Key information extraction (KIE) is a key application for information retrieval and text mining.
Approach: They propose a novel generative end-to-end model, named GenKIE, to address the KIE task.
Outcome: The proposed model generalizes over different types of documents and achieves state-of-the-art results.
Rethinking Entropy Interventions in RLVR: An Entropy Change Perspective (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have remarkable reasoning capabilities in complex tasks such as mathematics and coding.
Approach: They propose an entropy-modulation method that adaptively reweighs tokens based on theoretically-estimated entropic variations.
Outcome: The proposed method outperforms state-of-the-art methods in six mathematical reasoning and three coding benchmarks.
Exploring Unified Training Framework for Multimodal User Profiling (2025.coling-main)

Copied to clipboard

Challenge: Recent studies on user profiling focus on extracting multiple aspects of user attributes from textual reviews, but these studies do not fully exploit the potential of the rich multimodal data at hand.
Approach: They propose a task that utilizes both review texts and their accompanying images to generate comprehensive user profiles.
Outcome: The proposed training framework incorporates historical review texts and images for user profile generation.
LEPO: Latent Reasoning Policy Optimization for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing latent reasoning methods that use chain of thought (CoT) are limited to selecting one discrete token at each reasoning step, which potentially induces information loss.
Approach: They propose a framework that injects controllable stochasticity into latent reasoning via Gumbel-Softmax, restoring LLMs' exploratory capacity and enhancing their compatibility with Reinforcement Learning (RL).
Outcome: The proposed framework preserves richer information for more comprehensive reasoning and is compatible with Reinforcement Learning (RL).
Evaluating the Expressive Appropriateness of Speech in Rich Contexts (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for evaluating expressive speech focus on word accuracy, naturalness, signal quality, or emotional intensity at the utterance level.
Approach: They propose a framework for Evaluating Expressive Appropriateness in speech that assesses whether a speech sample aligns with the underlying communicative intent implied by its discourse-level narrative context.
Outcome: The proposed framework outperforms existing speech evaluation and analysis systems on a human-annotated test set.
InstructProtein: Aligning Human and Protein Language via Knowledge Instruction (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are a promising new approach to understanding biological sequences such as proteins.
Approach: They propose an LLM that can generate protein sequences in human and protein languages by pre-training an Lm on protein and natural language corpora and supervised instruction tuning to facilitate alignment.
Outcome: The proposed model outperforms state-of-the-art LLMs on protein-text generation tasks by a large margin.
Stealthy Attack on Large Language Model based Recommendation (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in recommender systems have been overlooked due to their emphasis on textual content.
Approach: They propose to introduce large language models into recommendation models to exploit the semantic understanding and strong transferability of LLMs.
Outcome: The proposed approach significantly boosts an item’s exposure by altering its textual content during the testing phase, without requiring direct interference with the model’s training process.
REACT: Representation Extraction And Controllable Tuning to Overcome Overfitting in LLM Knowledge Editing (2025.emnlp-main)

Copied to clipboard

Challenge: Large language model editing methods suffer from overfitting, where factual updates can propagate beyond their intended scope, overemphasizing the edited target even when it’s contextually inappropriate.
Approach: They propose a framework for precise and controllable knowledge editing that utilizes two-phase representations and a linear transformation to compute a directional "belief shift" vector.
Outcome: The proposed framework significantly reduces overfitting across nearly all evaluation metrics and on COUNTERFACT and MQuAKE.
MCP-Flow: Facilitating LLM Agents to Master Real-World, Diverse and Scaling MCP Tools (2026.acl-long)

Copied to clipboard

Challenge: Existing research on Large Language Models (LLMs) relies on few servers and lacks training support.
Approach: They propose a web-agent-driven pipeline for large-scale server discovery, data synthesis, and model training that collects and filters data from 1166 servers and 11536 tools.
Outcome: Empirical evidence shows that MCP-Flow generates higher quality instruction-function call pairs and higher agentic task performance than previous work.
Unleashing the Native Recommendation Potential: LLM-Based Generative Recommendation via Structured Term Identifiers (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for constructing item identifiers face bottlenecks due to their large output space and expensive vocabulary expansion and alignment training.
Approach: They propose to use Large Language Models to develop general-purpose, semantically-aware recommender systems that can be generalized and reusable.
Outcome: Experiments on real-world datasets show that GRAM outperforms baselines and significantly outperformed baselines.
FlowMalTrans: Unsupervised Binary Code Translation for Malware Detection Using Flow-Adapter Architecture (2025.findings-emnlp)

Copied to clipboard

Challenge: Using deep learning to detect malware has attracted great attention due to its notable performance.
Approach: a new approach uses Neural Machine Translation and Normalizing Flows to apply deep learning to malware detection.
Outcome: The proposed approach reduces the burden of data collection by enabling malware detection across multiple ISAs.
From Completion to Editing: Unlocking Context-Aware Code Infilling via Search-and-Replace Instruction Tuning (2026.acl-long)

Copied to clipboard

Challenge: Fill-in-the-Middle (FIM) models suffer from performance degradation and prohibitive latency.
Approach: They propose a search-and-replace infilling framework that integrates agentic verification and editing into a single-pass inference process.
Outcome: The proposed framework harmonizes completion tasks with the instruction-following priors of Chat LLMs, extending the paradigm from static infilling to dynamic context-aware editing.
Do Code Semantics Help? A Comprehensive Study on Execution Trace-Based Information for Code Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Code Large Language Models have limited ability to reason about runtime behavior and understand functionality . authors present a generic framework to support integrating semantic information to code task-relevant prompts .
Approach: a study examines the role of trace-based semantic information in boosting supervised fine-tuning and post-phase inference of Code LLMs.
Outcome: a new framework integrates semantic information to code task-relevant prompts . the proposed framework shows that trace-based semantic information boosts reasoning ability .
Deeper Insights Without Updates: The Power of In-Context Learning Over Fine-Tuning (2024.findings-emnlp)

Copied to clipboard

Challenge: Fine-tuning and in-context learning are two prevalent methods in imbuing large language models with task-specific knowledge.
Approach: They propose to use a circuit shift theory to explain why in-context learning is superior to fine-tuning for tasks with implicit patterns.
Outcome: The proposed method can grasp deep patterns and significantly improve accuracy on implicit patterns, compared with fine-tuning and in-context learning.
Enhancing the Comprehensibility of Text Explanations via Unsupervised Concept Discovery (2025.findings-acl)

Copied to clipboard

Challenge: Existing concepts-based explainable approaches do not discover unseen concepts . a recent approach to solve this problem is concept-based explanations .
Approach: They propose a framework that extracts comprehensible concepts automatically with no annotations . ECO-Concept uses an object-centric architecture to extract task-specific semantic concepts .
Outcome: a new framework extracts comprehensible concepts with no concept annotations . the proposed framework outperforms existing methods in computability tests on diverse tasks .
Learning Deep Transformer Models for Machine Translation (P19-1)

Copied to clipboard

Challenge: Neural machine translation models have advanced the previous state-of-the-art by learning mappings between sequences via neural networks and attention mechanisms.
Approach: They propose to use layer normalization to pass the combination of previous layers to the next layer to improve the model.
Outcome: The proposed model outperforms the shallow Transformer-Big/Base baseline model on English-German and Chinese-English tasks by 0.4-2.4 BLEU points.
CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have achieved remarkable performance on various NLP tasks, yet their potential in more challenging task like finance, has not been fully explored.
Approach: They propose a benchmark to assess the financial knowledge of large language models (LLMs) in China.
Outcome: The proposed benchmark is the most comprehensive evaluation benchmark to date for LLMs in finance.
CPRM: A LLM-based Continual Pre-training Framework for Relevance Modeling in Commercial Search (2025.naacl-industry)

Copied to clipboard

Challenge: Relevance modeling between queries and items is a key component of commercial search engines.
Approach: They propose a framework for continual pre-training of LLMs to enhance domain knowledge . they employ queries and multi-field item to jointly pre-train for enhancing domain knowledge.
Outcome: The proposed model achieves convincing performance compared to strong baselines.
Improving Fake News Detection of Influential Domain via Domain- and Instance-Level Transfer (2022.coling-1)

Copied to clipboard

Challenge: Social media spreads both real news and fake news in various domains including politics, health, entertainment, etc.
Approach: They propose a Domain- and Instance-level Transfer Framework for Fake News Detection which could improve the performance of specific target domains.
Outcome: The proposed framework improves performance of target domains by hurting other domains, resulting in unsatisfactory performance in the target domain.
Unified Hallucination Detection for Multimodal Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: despite significant strides in multimodal tasks, MLLMs are plagued by the critical issue of hallucination.
Approach: They propose a meta-evaluation benchmark to facilitate evaluation of advancements in hallucination detection methods.
Outcome: The proposed framework validates hallucinations robustly and provides strategic insights . MHaluBench is a meta-evaluation benchmark designed to facilitate evaluation .
Divide-Then-Align: Honest Alignment based on the Knowledge Boundary of RAG (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) augmented with retrieval systems have significantly advanced natural language processing tasks by integrating external knowledge sources.
Approach: They propose a method that conditions large language models to generate answers even in the absence of reliable knowledge.
Outcome: The proposed approach balances accuracy with appropriate abstention, enhancing the reliability and trustworthiness of retrieval-augmented systems.
Noise-Robust Semi-Supervised Learning for Distantly Supervised Relation Extraction (2023.findings-emnlp)

Copied to clipboard

Challenge: Distantly supervised relation extraction (DSRE) methods are not capable of extracting relation labels for individual sentences.
Approach: They propose a semi-supervised learning relation extraction framework for sentence-level DSRE . they discard only the labels of the noisy samples and utilize them as unlabeled samples .
Outcome: The proposed framework achieves significant performance enhancements on two real-world datasets.
One-Dimensional Object Detection for Streaming Text Segmentation of Meeting Dialogue (2025.findings-acl)

Copied to clipboard

Challenge: Current text segmentation models exhibit numerous limitations, such as imbalances in labels that affect the stability of model training and discrepancies between the model’s training tasks (sentence classification) and the actual text segmenting.
Approach: They implement a sliding window-based segmentation method and employ two different levels of sliding window based balanced label strategies to stabilize the training process of the streaming segmentation model.
Outcome: The proposed method is robust, controllable, and achieves state-of-the-art performance.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations