Papers by He Jiang

94 papers
Semi-Supervised Reward Modeling via Iterative Self-Training (2024.findings-emnlp)

Copied to clipboard

Challenge: Reward models capture values and preferences of humans and are used in Reinforcement Learning with Human Feedback (RLHF) Traditionally, training large language models relies on extensive human-annotated preference data, which poses significant challenges in terms of scalability and cost.
Approach: They propose a method that enhances RM training using unlabeled data.
Outcome: The proposed approach improves reward models without incurring additional labeling costs on unlabeled datasets.
VLA-Mark: A cross modal watermark for large vision-language alignment models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing text watermarking methods disrupt visual-textual alignment, leaving semantic-critical concepts vulnerable.
Approach: They propose a vision-aligned framework that embeds detectable watermarks into outputs . they combine localized patch affinity, global semantic coherence, contextual attention patterns .
Outcome: The proposed framework shows lower PPL and higher BLEU than conventional methods with near-perfect detection (98.8% AUC).
SumSurvey: An Abstractive Dataset of Scientific Survey Papers for Long Document Summarization (2024.findings-acl)

Copied to clipboard

Challenge: a growing need for long document summarization datasets with 16k input is causing problems.
Approach: They propose to use a dataset to analyze salient information in long document summarizations.
Outcome: The proposed dataset outperforms existing models and LLMs in the distribution form of salient information and the distribution of salinal information is an indicator of quality.
Novel Slot Detection: A Benchmark for Discovering Unknown Slot Types in the Task-Oriented Dialogue System (2021.acl-long)

Copied to clipboard

Challenge: Existing slot filling models can only recognize pre-defined in-domain slot types from a limited slot set.
Approach: They introduce a task, Novel Slot Detection, in the task-oriented dialogue system.
Outcome: The proposed task is based on two public NSD datasets and proposes strong baselines . it aims to identify a sequence of tokens and extract semantic constituents from user queries .
Augmenting Compliance-Guaranteed Customer Service Chatbots: Context-Aware Knowledge Expansion with Large Language Models (2025.emnlp-industry)

Copied to clipboard

Challenge: Retrieval-based chatbots leverage human-verified Q&A knowledge to deliver accurate, verifiable responses.
Approach: They propose a similar question generation task for LLM training and inference to enable comprehensive semantic exploration and enhanced alignment with source question-answer relationships.
Outcome: The proposed methods achieve 92% user satisfaction rate in a deployed chatbot system, reflecting an 18% improvement over the baseline.
MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Models (2023.emnlp-demo)

Copied to clipboard

Challenge: MusicAgent integrates numerous music-related tools and an autonomous workflow to address user requirements.
Approach: a new system is built to integrate music-related tools and an autonomous workflow . the system is based on large language models (LLMs) that can be used to organize and decompose requests .
Outcome: the proposed system integrates numerous music-related tools and an autonomous workflow to address user requirements.
The “Knowledge–Behavior Gap” in Cultural Taboo Safety of Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing cultural benchmarks assess cultural knowledge or values biases, but ignore cultural taboos.
Approach: They propose a benchmark to evaluate and improve the cultural taboo safety of large language models.
Outcome: The proposed benchmark spans 77 countries and regions, and includes over 2,020 taboos.
Hierarchical Acoustic-Semantic Modeling: Modality Separation and Semantic Coherence for Full-Duplex SLMs (2026.acl-long)

Copied to clipboard

Challenge: despite significant progress, full-duplex SLMs are constrained by severe modality interference, authors say . modality interferes with acoustic and semantic modeling, making them unintelligent and unnatural . authors propose a hierarchical parameter separation strategy that decouples conflicting modalities in deep layers .
Approach: They propose a hierarchical parameter separation strategy that decouples conflicting modalities in deep layers while preserving cross-modality coherence via a dedicated semantic alignment channel.
Outcome: The proposed method significantly advances the state of the art on full-duplex benchmarks . it decouples conflicting modalities in deep layers while preserving cross-modality coherence .
Pre-trained Models Perform the Best When Token Distributions Follow Zipf’s Law (2025.emnlp-main)

Copied to clipboard

Challenge: Existing large language models typically fix a vocabulary size in advance, then use Byte Pair Encoding (BPE) to construct the tokenizer.
Approach: They propose a method for determining the vocabulary size by analyzing token frequency distributions through Zipf’s law and propose to use it to optimize model performance.
Outcome: The proposed method improves model efficiency and effectiveness across NLP, genomics, and chemistry.
Reason from Fallacy: Enhancing Large Language Models’ Logical Reasoning through Logical Fallacy Understanding (2024.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated good performance in many reasoning tasks, but struggle with some more complex reasoning tasks including logical reasoning.
Approach: They propose five concrete tasks from three cognitive dimensions of WHAT, WHY, and HOW to evaluate LLMs’ capability of logical fallacy understanding.
Outcome: The proposed dataset can be used to evaluate LLMs’ LFU capability and to fine-tune LLM models to obtain significantly enhanced performance on logical reasoning.
OpenHuEval: Evaluating Large Language Model on Hungarian Specifics (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) represent significant strides toward artificial general intelligence (AGI).
Approach: They introduce OpenHuEval, the first benchmark for LLMs focusing on the Hungarian language and specifics.
Outcome: The framework reveals intrinsic patterns and mechanisms of LLMs in non-English languages, with Hungarian serving as an example.
Automated Chinese Essay Scoring from Multiple Traits (2022.coling-1)

Copied to clipboard

Challenge: Current research on AES focuses on scoring the overall quality or single trait of prompt-specific essays.
Approach: They propose a hierarchical multi-task trait scorer to evaluate quality of writing . they propose an inter-sequence attention mechanism to enhance information interaction .
Outcome: The proposed model outperforms several strong models on ACEA and outperformed other models.
Disentangled Knowledge Transfer for OOD Intent Discovery with Unified Contrastive Learning (2022.acl-short)

Copied to clipboard

Challenge: Existing methods to find out out-of-domain (OOD) intents do not take prior knowledge of in-domain data into account.
Approach: They propose a disentangled knowledge transfer method to bridge the gap between IND pre-training and OOD clustering by using a unified multi-head contrastive learning framework.
Outcome: The proposed method is able to group new unknown intents into different clusters, enabling future development of the system.
CipherBank: Exploring the Boundary of LLM Reasoning Capabilities through Cryptography Challenge (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated remarkable capabilities, but their capabilities in cryptographic decryption tasks remain underexplored.
Approach: They propose a benchmark to evaluate the reasoning capabilities of large language models in cryptographic decryption tasks.
Outcome: The proposed benchmark examines the reasoning capabilities of large language models in cryptographic decryption tasks.
T2I-FactualBench: Benchmarking the Factuality of Text-to-Image Models with Knowledge-Intensive Concepts (2025.acl-long)

Copied to clipboard

Challenge: Existing studies on text-to-image (T2I) models focus on text alignment, image quality, and object composition capabilities.
Approach: They propose a T2I-FactualBench benchmark to evaluate the factuality of knowledge-intensive concept generation.
Outcome: The proposed framework evaluates the factuality of knowledge-intensive concept generation tasks.
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline (2022.naacl-main)

Copied to clipboard

Challenge: Rather than pursuing the reachless SOTA accuracy, researchers are focusing on model efficiency and usability.
Approach: They propose an evaluation and a public leaderboard for efficient NLP models that depicts the Pareto Frontier for various language understanding tasks.
Outcome: The proposed model outperforms or performs on par with SOTA compressed and early exiting models.
TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for fine-tuning are resource-efficient, but performance often falls short . a new approach, TeamLoRA, integrates collaborative and competitive modules to improve performance.
Approach: They propose to introduce task-specific LoRA as domain experts to improve learning efficiency . teamLoRA integrates collaborative and competition modules to improve model learning .
Outcome: Experiments show that TeamLoRA improves performance in multi-task learning . teamLorea integrates collaborative and competitive modules to improve performance .
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to adversarial regularization treat adversarials and defending players equally, which is undesirable because only the defending player contributes to the generalization performance.
Approach: They propose a method which formulates adversarial regularization as a Stackelberg game and induces a competition between a leader and a follower.
Outcome: The proposed method outperforms existing adversarial regularization baselines on a set of machine translation and natural language understanding tasks.
GRAIT: Gradient-Driven Refusal-Aware Instruction Tuning for Effective Hallucination Mitigation (2025.findings-naacl)

Copied to clipboard

Challenge: Experimental evaluations on open-ended and multiple-choice questions demonstrate GRAIT significantly outperforms existing RAIT methods in the overall performance.
Approach: They propose a framework to reduce the risk of over-refusal and reduce hallucinations by rejecting unknown questions to minimize hallucinism and ensuring correct answers are not rejected.
Outcome: The proposed framework outperforms existing methods on open-ended and multiple-choice questions.
Detect Camouflaged Spam Content via StoneSkipping: Graph and Text Joint Embedding for Chinese Character Variation Representation (D19-1)

Copied to clipboard

Challenge: Currently, Chinese characters share glyph and phonetic variations to escape detection algorithms due to their complexity and complexity.
Approach: They propose a Chinese variation-enhanced Graph Embedding algorithm that can learn Chinese character embeddings and latent variation families.
Outcome: The proposed model outperforms state-of-the-art models on Chinese spam detection datasets and review datasets.
Calibrated Speculative Decoding: Frequency-Guided Candidate Selection for Efficient Inference (2026.acl-long)

Copied to clipboard

Challenge: Speculative decoding (SD) is a powerful and efficient way to accelerate autoregressive generation.
Approach: They propose a training-free framework that recovers valid tokens discarded by standard verification . they use online correction memory and Semantic Consistency Gating to analyze rejections .
Outcome: The proposed framework outperforms existing methods and achieves peak throughput speedup of 2.33x.
Recurrent Alignment with Hard Attention for Hierarchical Text Rating (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models excel at understanding and generating plain text, but they are not tailored to handle hierarchical text structures or directly predict task-specific properties such as text rating.
Approach: They propose a framework that integrates Recurrent Alignment with Hard Attention to analyze hierarchically structured text.
Outcome: The proposed framework outperforms existing state-of-the-art methods on three hierarchical text rating datasets.
LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have sparked growing interest in building fully autonomous agents.
Approach: They propose to integrate human-provided information, feedback, or control into the agent system to enhance system performance, reliability, and safety.
Outcome: The proposed systems improve system performance, reliability, and safety by integrating human-provided information, feedback, or control into the agent system.
Benchmarking Large Language Models Under Data Contamination: A Survey from Static to Dynamic Evaluation (2025.emnlp-main)

Copied to clipboard

Challenge: In the era of evaluating large language models, data contamination is an increasingly prominent concern . static benchmarking has been used for evaluation, but there are limitations of *dynamic* benchmarks .
Approach: They propose a series of optimal design principles for *dynamic* benchmarking and analyze the limitations of existing *static* benchmarks.
Outcome: The proposed benchmarks highlight a critical gap in the evaluation of LLMs.
Token-wise Curriculum Learning for Neural Machine Translation (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing curriculum learning approaches to Neural Machine Translation (NMT) require sampling sufficient amounts of “easy” samples from training data at the early stage of training.
Approach: They propose a token-wise curriculum learning approach that creates sufficient amounts of easy samples from training data.
Outcome: The proposed approach outperforms baselines on five language pairs on low-resource languages.
HeteroCache: A Dynamic Retrieval Approach to Heterogeneous KV Cache Compression for Long-Context LLM Inference (2026.acl-long)

Copied to clipboard

Challenge: Existing static compression methods suffer from coarse-grained caching and high I/O overhead.
Approach: They propose a training-free dynamic compression framework that uses a sparse attention mechanism to categorize attention heads based on stability and similarity.
Outcome: The proposed framework achieves state-of-the-art performance on long-context benchmarks and accelerates decoding by up to 3 compared to the original model with a 224K context.
Leveraging Web-Crawled Data for High-Quality Fine-Tuning (2024.findings-emnlp)

Copied to clipboard

Challenge: Currently, large language models are fine-tuned using expensive human-annotated data or GPT-4 generated data.
Approach: They propose to use web-crawled data to train a language model on a smaller set of data . their results show that the model can convert web data with irregular formats into high-quality ones .
Outcome: The proposed model outperforms open-source models larger than 32B and outperformed open-sourced models such as GPT-3.5.
AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are promising foundations to build generally-capable agents . however, the community lacks a unified interactive framework that covers diverse environments for comprehensive evaluation of agents.
Approach: They propose a framework that features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction.
Outcome: The proposed framework features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction.
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization (2021.acl-long)

Copied to clipboard

Challenge: 'lottery tickets' can be trained to match the performance of a full model . subnetwork training can also outperform random sampled subnetworks of the same size .
Approach: They propose to train a subnetwork of 'lottery tickets' to match the full model's performance.
Outcome: The proposed model outperforms subnetworks of the same size in a phase transition phenomenon . the proposed model improves single task fine-tuning by 0.9 points on BERT-base and 1.0 points on GLUE large .
Cognitive Scaffold: From Fluid Context to Crystallized Memory for Long-Horizon DeepResearch Agents (2026.acl-long)

Copied to clipboard

Challenge: Scaling LLM-based agents to long-horizon deep research is constrained by context-noise trade-off . solving a single query may require hundreds of interactions with noisy environments .
Approach: They propose a factorized memory architecture that decouples the cognitive state into a Fluid Working Context for immediate reasoning and a persistent Knowledge Graph for long-term retention.
Outcome: The Cognitive Scaffold outperforms baselines on Xbench-DeepSearch, BrowseComp-ZH, and GAIA . it achieves 74.7% Avg@3 and 87.0% Pass@3 on xbench, browseComp, and 88.3% Pass@3.
ChatGPT Is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Models (2024.lrec-main)

Copied to clipboard

Challenge: acquiring and representing commonsense in machines has posed a long-standing challenge (Li et al., 2021; Zhang e t al, 2022; Zhou e al. 2023) .
Approach: They use a commonsense-based LLM to evaluate ChatGPT's commonsensing abilities by analyzing 11 datasets and generating knowledge descriptions.
Outcome: The proposed model can achieve good QA accuracies while still struggling with certain domains of datasets.
ComCLIP: Training-Free Compositional Image and Text Matching (2024.naacl-long)

Copied to clipboard

Challenge: erroneous semantics of individual entities are essentially confounders that cause the matching failure.
Approach: They propose a training-free compositional CLIP model which disentangles input images into subjects, objects, and action subimages and composes CLIP’s vision encoder and text encoder to perform evolving matching over compositional text embedding and subimage embeddments.
Outcome: The proposed model mitigates spurious correlations introduced by the pretrained CLIP models and dynamically evaluates the importance of each component.
Towards Hierarchical Multi-Step Reward Models for Enhanced Reasoning in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing Process Reward Models (PRMs) are vulnerable to reward hacking and require expensive, large-scale annotation of reasoning steps.
Approach: They propose a reward model approach which evaluates both individual and consecutive reasoning steps from fine-grained and coarse-grounded level.
Outcome: Empirical results show that the proposed model performs better than existing PRMs and is more robust than existing models.
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control (2024.emnlp-main)

Copied to clipboard

Challenge: Existing models fail to generate singing voices rich in stylistic nuances for unseen singers due to multifaceted nature of singing styles.
Approach: They propose a zero-shot SVS model for style transfer across cross-lingual speech and singing styles and multi-level style control.
Outcome: Experimental results show that TCSinger outperforms baseline models in synthesis quality, singer similarity, and style controllability.
Are We Using the Right Benchmark: An Evaluation Framework for Visual Token Compression Methods (2026.acl-long)

Copied to clipboard

Challenge: Recent efforts to accelerate inference in Multimodal Large Language Models have focused on visual token compression.
Approach: They propose a framework that leverages downsampling as a discriminator to denoise existing benchmarks.
Outcome: The proposed evaluation framework leverages downsampling as a discriminator to denoise existing benchmarks.
Align Voting Behavior with Public Statements for Legislator Representation Learning (2021.acl-long)

Copied to clipboard

Challenge: Existing studies rely on roll call data to estimate political preference of legislators.
Approach: They propose to integrate voting behavior and public statements on Twitter to jointly model legislators.
Outcome: The proposed model improves on the task of roll call vote prediction . it also shows that the model captures nuances in statements .
BERT-MK: Integrating Graph Contextualized Knowledge into Pre-trained Language Models (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing knowledge representation learning methods do not use graph contextualized knowledge.
Approach: They propose to model subgraphs in a medical KG and integrate it with a pre-trained language model to do knowledge generalization.
Outcome: The proposed model achieves state-of-the-art on several medical NLP tasks . it improves on MedERNIE, and the proposed model is effective .
Syntactic Graph Convolutional Network for Spoken Language Understanding (2020.coling-main)

Copied to clipboard

Challenge: Existing work on slot filling and intent detection builds joint models without prior knowledge of linguistic knowledge.
Approach: They propose a joint model that integrates syntactic structure for learning slot filling and intent detection jointly.
Outcome: The proposed model outperforms existing models on two public benchmark datasets and further improves on slot filling and intent detection.
INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agent (2025.acl-long)

Copied to clipboard

Challenge: Recent advances have underscored the potential of large language model (LLM)-based agents in financial decision-making.
Approach: They propose to evaluate LLM agents using 13 different LLMs as backbone models across various market environments and tasks.
Outcome: The proposed framework assesses the reasoning and decision-making capabilities of 13 different LLMs across various market environments and tasks.
Modeling Discriminative Representations for Out-of-Domain Detection with Supervised Contrastive Learning (2021.acl-short)

Copied to clipboard

Challenge: Existing methods of OOD detection only focus on whether a sample is correctly classified . lack of real OOD examples leads to poor prior knowledge about these unknown intents .
Approach: They propose a supervised contrastive learning objective to minimize intra-class variance . they employ an adversarial augmentation mechanism to obtain pseudo diverse views .
Outcome: The proposed method minimizes intra-class variance by pulling together in-domain intents belonging to the same class and maximizes inter-class variation by pushing apart samples from different classes.
ARCH: Efficient Adversarial Regularized Training with Caching (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to regularize models require generating a perturbation for each sample in each epoch.
Approach: They propose an adversarial regularization method where perturbations are generated and cached once every several epochs.
Outcome: The proposed method significantly eases the computational burden (saves up to 70% of computational time) it produces a notably better (in most of the tasks) or comparable model generalization.
Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer (2025.acl-long)

Copied to clipboard

Challenge: Foundational models and their checkpoints have advanced deep learning, boosting performance across applications.
Approach: They propose a method for pruning fine-tuned models by calculating differences between them and original model.
Outcome: The proposed method can improve performance across vision, NLP, and multi-modal benchmarks.
Beyond the First Error: Process Reward Models for Reflective Mathematical Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for training effective PRMs focus on the first incorrect step and all preceding steps, assuming that all subsequent steps are incorrect.
Approach: They propose a data annotation method specifically designed to score the long CoT reasoning process by using an LLM-based judger for annotation.
Outcome: The proposed method improves PRMs' ability to identify effective self-correction behaviors and reasoning based on erroneous steps.
Eliciting Knowledge from Experts: Automatic Transcript Parsing for Cognitive Task Analysis (P19-1)

Copied to clipboard

Challenge: Cognitive task analysis (CTA) is a type of analysis used to elicit and represent the knowledge and thought processes of domain experts.
Approach: They propose a weakly-supervised framework for automated CTA transcript parsing . they partition the parser process into a sequence labeling task and a text span-pair relation extraction task with distant supervision from human-curated protocol files.
Outcome: The proposed framework reduces human labor and scales the task to a small scale.
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications.
Approach: They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions.
Outcome: The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions.
VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing video metrics are lagging behind in providing reliable scores over generated videos due to lack of large-scale human-annotated dataset.
Approach: They propose to use VideoFeedback to train a human-annotated multi-aspect score over 37.6K synthesized videos from 11 existing video generative models.
Outcome: The proposed model outperforms the prior best metrics by 50 points in the test.
Layer-wise Minimal Pair Probing Reveals Contextual Grammatical-Conceptual Hierarchy in Speech Representations (2025.emnlp-main)

Copied to clipboard

Challenge: a recent study evaluated the extent to which SLMs encode nuanced syntactic and conceptual features . acoustic and phonetic features are shallow, but the extent of nuance is unclear .
Approach: a new study evaluates contextual syntactic and semantic features in transformer-based speech language models . authors compare SLMs to linguistic competence assessments for large language models.
Outcome: a new study compares SLMs with linguistic competence assessments to assess speech recognition and understanding . the results show that SLM models encode grammatical features more robustly than conceptual ones .
LeanK: Learnable K Cache Channel Pruning for Efficient Decoding (2025.emnlp-main)

Copied to clipboard

Challenge: Existing efforts to optimize the key-value (KV) cache include: (1) Eviction, which discards cache of less important tokens; (2) Selection, which retains the full KV cache but selectively reads relevant entries.
Approach: They propose a learning-based method that prunes unimportant key (K) cache channels by leveraging static channel sparsity.
Outcome: Experiments show that LeanK reduces GPU memory and accelerates decoding without sacrificing accuracy.
All That Glisters Is Not Gold: A Benchmark for Reference-Free Counterfactual Financial Misinformation Detection (2026.acl-long)

Copied to clipboard

Challenge: RFC-Bench evaluates large language models on financial misinformation under realistic news . current models struggle to maintain coherent belief states without external grounding, study finds .
Approach: They propose a benchmark for evaluating large language models on financial misinformation under realistic news.
Outcome: The proposed model performs better when context is available, while reference-free settings expose significant weaknesses.
Beyond Self-Report: Bridging the Intention-Behavior Gap in Critical Thinking Assessment via Interpretable Multi-Agent System (2026.acl-long)

Copied to clipboard

Challenge: Accurate assessment of critical thinking is limited by the Intention Behavior Gap in psychology . evaluators that measure self-reported competence are limited by multiagent architectures .
Approach: They propose a framework that operationalizes cognitive assessment into an interpretable multi-agent workflow with Assessment Chain-of-Thought.
Outcome: The proposed framework aligns better with human expert ratings than gold-standard inventories on large-scale simulations and human participants.
Does Large Language Model Contain Task-Specific Neurons? (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated remarkable capabilities in comprehensively handling various types of natural language processing (NLP) tasks.
Approach: They propose a method for task-specific neuron localization based on Causal Gradient Variation with Special Tokens (CGVST) this method identifies task- specific neurons by concentrating on the most significant tokens during task processing, eliminating redundant tokens and minimizing interference from non-essential neurons.
Outcome: The proposed method can locate task-specific neurons across eight public tasks.
Accelerating Prefilling via Decoding-time Contribution Sparsity (2026.findings-acl)

Copied to clipboard

Challenge: Existing acceleration methods exploit attention score sparsity by estimating blocks with high attention scores and applying dynamic sparse attention.
Approach: They propose a method which replaces dense attention with Triangle attention in a subset of layers to reduce the time needed to decode.
Outcome: Experiments show that TriangleMix achieves near-lossless performance on long-context and long-constrast reasoning benchmarks while significantly improving efficiency.
UniMoE-Audio: Unified Speech and Music Generation with Dynamic-Capacity Mixture-of-Experts (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in unified multimodal models indicate a clear trend towards comprehensive content generation.
Approach: They propose a unified speech and music generation model built upon a novel framework . they propose specialized MoE architectures and curated training strategies to tackle data imbalances .
Outcome: The proposed model achieves state-of-the-art performance on major speech and music generation benchmarks.
PromptKeeper: Safeguarding System Prompts for LLMs (2025.findings-emnlp)

Copied to clipboard

Challenge: PromptKeeper is a defense mechanism designed to safeguard system prompts . adversarial and regular queries can exploit LLM vulnerabilities to expose hidden prompts.
Approach: PromptKeeper is a defense mechanism designed to safeguard system prompts . it detects both explicit and subtle leakage and regenerates responses using a dummy prompt .
Outcome: PromptKeeper detects and mitigates side-channel vulnerabilities when prompts are exposed . it regenerates responses using a dummy prompt, ensuring outputs remain indistinguishable from typical interactions .
WebWalker: Benchmarking LLMs in Web Traversal (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of natural language processing tasks.
Approach: They propose a benchmark to assess the ability of LLMs to perform web traversal by using an explore-critic paradigm.
Outcome: The proposed framework mimics human-like web navigation through an explore-critic paradigm and demonstrates the effectiveness of RAG combined with WebWalker in real-world scenarios.
Shuttle Between Symbolic Instructions and Neural Parameters of Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Despite their distinct external representations, a deeper analysis reveals their intrinsic nature: instructions serve as a natural language compression devised by humans for data governing specific mapping patterns, whereas parameters act as 'neuro compression' of the same task data.
Approach: They propose a neural network framework to model and learn the bi-directional mappings between instructions and parameters of large language models by evaluating it on the tasks of instruction deduction and induction.
Outcome: The proposed framework can map one of the instructions/parameters to the other by evaluating it on the tasks of instruction deduction and induction.
A Strategic Coordination Framework of Small LMs Matches Large LMs in Data Synthesis (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models suffer from high computational costs and environmental inefficiency . smaller LMs are more accessible and sustainable, but their individual capabilities often fall short . a collaborative framework for small LM combines specialized roles to iterative refinement and quality control .
Approach: They propose a framework that aggregates specialized roles across small LMs to iterative refinement and quality control typically achieved by a single large LM.
Outcome: The proposed framework aggregates specialized roles across small LMs to iterative refinement and quality control typically achieved by large LM.
Middo: Model-Informed Dynamic Data Optimization for Enhanced LLM Fine-Tuning via Closed-Loop Learning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to improve data quality face limitations in static dataset curation that fail to adapt to evolving model capabilities.
Approach: They propose a self-evolving framework that uses model-aware data selection and context-preserving data refinement to improve LLM performance.
Outcome: The proposed framework improves the quality of seed data and boosts LLM’s performance with improving accuracy by 7.15% on average while maintaining the original dataset scale.
Why and How LLMs Benefit from Knowledge Introspection in Commonsense Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) can improve commonsense reasoning by generating intermediate knowledge, but the effectiveness of this knowledge introspection is not always guaranteed.
Approach: They propose a training-free strategy that optimizes introspection via two stages: Knowledge Detection and Knowledge Regeneration.
Outcome: The proposed approach mitigates the limitations of standard introspection and has consistent performance gains across all settings.
Benchmarking Chinese Commonsense Reasoning of LLMs: From Chinese-Specifics to Reasoning-Memorization Correlations (2024.acl-long)

Copied to clipboard

Challenge: Currently, many benchmarks evaluate the commonsense reasoning of large language models (LLMs), but most are English-based, limiting non-English evaluations.
Approach: They propose to use Chinese commonsense reasoning to evaluate LLMs' commonsensing ability.
Outcome: The proposed benchmark covers both globally known and Chinese-specific commonsense reasoning abilities and can be used as a reference for future research.
Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation (2021.findings-emnlp)

Copied to clipboard

Challenge: Radiology report generation aims at generating descriptive text from radiology images automatically.
Approach: They propose a weakly supervised contrastive loss method that generates descriptive text from radiology images automatically.
Outcome: The proposed method outperforms previous work on correctness and text generation metrics for two public benchmarks.
Position Engineering: Boosting Large Language Models through Positional Information Manipulation (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have demonstrated significant strides towards achieving artificial general intelligence.
Approach: They propose a technique termed position engineering which alters the positional information in the prompt without modifying the text itself.
Outcome: The proposed technique significantly improves on the baseline in retrieval-augmented generation and in-context learning scenarios.
Graph-Based Decoding for Task Oriented Semantic Parsing (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing paradigms for semantic parsing are sequence-to-sequence and AMR parsers.
Approach: They propose to formulate parsing as a sequence-to-sequence task using graph-based decoding techniques developed for syntactic parsers.
Outcome: The proposed approach is competitive with sequence decoders on the standard setting and offers significant improvements in data efficiency and data availability.
The CRECIL Corpus: a New Dataset for Extraction of Relations between Characters in Chinese Multi-party Dialogues (2022.lrec-1)

Copied to clipboard

Challenge: Existing datasets focus on relation extraction between two entities in one sentence, and some focus on cross-sentence relationships.
Approach: They propose to use a Chinese multi-party dialogue dataset for automatic extraction of dialogue-based character relationships.
Outcome: The proposed dataset extracts relationships between 140 entities on the CRECIL corpus and another existing relation extraction corpus.
GATE: Graph-based Adaptive Tool Evolution Across Diverse Tasks (2026.acl-long)

Copied to clipboard

Challenge: Existing toolsets that use large language models are limited to single-task settings.
Approach: They propose a framework that dynamically constructs and evolves a hierarchical graph of reusable tools across multiple scenarios.
Outcome: The proposed framework achieves up to 4.3 faster milestone completion in Minecraft compared to the previous state-of-the-art method and provides an average improvement of 9.23% over existing tool-making methods in code generation tasks and 10.03% in agent tasks.
Domain-Oriented Prefix-Tuning: Towards Efficient and Generalizable Fine-tuning for Zero-Shot Dialogue Summarization (2022.naacl-main)

Copied to clipboard

Challenge: Existing methods for domain adaptation of abstractive dialogue summarization lack generalization ability on new domains.
Approach: They propose a domain-oriented prefix-tuning model that uses a prefix module to alleviate domain entanglement and discrete prompts to guide the model to focus on key contents of dialogues.
Outcome: The proposed model can be generalized to two multi-domain dialogue summarization datasets.
Semantic-Space Exploration and Exploitation in RLVR for LLM Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have substantially improved the reasoning abilities of Large Language Models (LLMs).
Approach: They propose a method that balances exploration and exploitation in the hidden-state space of response trajectories.
Outcome: The proposed model yields consistent improvements across models, algorithms and reasoning benchmarks.
Fin-STAR: Structure-as-Semantics to Resolve Implicitness in Financial Retrieval (2026.findings-acl)

Copied to clipboard

Challenge: Existing Retrieval-Augmented Generation systems treat structure as a physical navigational skeleton rather than intrinsic semantic knowledge.
Approach: They propose a framework that redefining hierarchy as intrinsic semantics and uses snippets to enrich hierarchical lineage.
Outcome: The proposed framework outperforms state-of-the-art hierarchical and graph-based benchmarks on FinTierQA Gold.
LLM-based Open Domain Planning by Leveraging Entity-Attribute-Level Domain Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Currently, large language models (LLMs) based on Open domain Natural language planning have limited application potential.
Approach: They propose a dataset with a baseline for Open domain Natural language planning . the dataset provides the largest dataset for textual procedures to date .
Outcome: The proposed dataset provides the largest dataset for textual procedures to date . it leverages entity-attribute-level action models to reveal relevant physical properties .
Latent Attention Denoising: A Training-Free Energy-Based Framework for Mitigating Hallucinations in Vision-Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing models for large vision-Language Models lack reliable visual hallucination . despite advances in multimodal perception, they are still limited in real-world applications .
Approach: They propose a framework that recasts attention calibration as a one-step score-based denoising process.
Outcome: The proposed framework achieves superior performance on generative and discriminative tasks while maintaining efficiency comparable to standard decoding.
EmoAgent: Assessing and Safeguarding Human-AI Interaction for Mental Health Safety (2025.emnlp-main)

Copied to clipboard

Challenge: EmoAgent evaluates and mitigates mental health hazards in human-AI interactions, especially for vulnerable human users with psychological disorders.
Approach: EmoAgent is a multi-agent AI framework designed to evaluate and mitigate mental health hazards in human-AI interactions.
Outcome: EmoAgent evaluates and mitigates mental health hazards in human-AI interactions.
Revisit Overconfidence for OOD Detection: Reassigned Contrastive Learning with Adaptive Class-dependent Threshold (2022.naacl-main)

Copied to clipboard

Challenge: Existing methods for OOD detection are based on labeled in-domain data . detecting out-of-domain (OOD) or unknown intents is challenging .
Approach: They propose a novel reassigned contrastive learning method to discriminate IND intents for over-confident OOD and an adaptive class-dependent local threshold mechanism to separate similar IND and OOD intents.
Outcome: The proposed method is effective for both aspects of overconfidence issues.
A Survey on Proactive Defense Strategies Against Misinformation in Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for detection of misinformation generated by large language models fail to mitigate societal risks . authors propose a paradigm shift from passive detection to anticipatory mitigation strategies . existing defenses remain reactionary in an era demanding proactive defense, authors say .
Approach: They propose a three-pillar approach to prevent misinformation by fortifying integrity of training data and inference reliability by embedding self-corrective mechanisms during reasoning.
Outcome: The proposed framework improves existing methods in misinformation prevention by 63% . it demonstrates that existing methods exhibit false negative rates against misinformation .
OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering (2022.naacl-main)

Copied to clipboard

Challenge: a table-based question answering system requires complex reasoning and alignment between questions and tables.
Approach: They propose a table-based QA model that consumes both natural and synthetic data . they combine retrieval with masking to pair natural sentences with QA .
Outcome: The proposed model outperforms existing models in few-shot and full settings and on WikiTableQuestions.
A Role-Selected Sharing Network for Joint Machine-Human Chatting Handoff and Service Satisfaction Analysis (2021.emnlp-main)

Copied to clipboard

Challenge: Recent efforts to predict chatbot failure hatches vital apprehensions due to complexity of human conversation.
Approach: They propose a model that integrates dialogue satisfaction estimation and handoff prediction in one multi-task learning framework.
Outcome: The proposed model integrates dialogue satisfaction estimation and handoff prediction in one multi-task learning framework.
CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for expressive text-to-speech only implicitly learn prosody with masked token reconstruction tasks.
Approach: They propose a cross-modal contrastive pre-training framework that learns from prosody variance of the same text token under different contexts.
Outcome: The proposed framework can learn from prosody variance of a text token under different contexts.
INT: Establishing Information Transfer for Multilingual Intent Detection and Slot Filling (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies struggle to achieve performance comparable to that on high-resource languages due to inherent linguistic diversity of multilingual SLU tasks.
Approach: They propose a multilingual information transfer network to solve these challenges . they propose to reformulate SF as a span prediction problem and introduce a slot-matching attention mechanism to achieve slot alignment across languages.
Outcome: The proposed model outperforms baseline models on the MASSIVE and MASSIV-UG datasets in overall accuracy across all languages.
SAIR-Comb : A Structure-Aware Iterative Refinement Framework for Combinatorics Autoformalization (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have catalyzed advances in mathematical reasoning, propelling the development of automated theorem proving (ATP).
Approach: They propose a Structure-Aware Iterative Refinement framework for Combinatorics powered by Lean 4 and LLMs.
Outcome: The proposed framework achieves strong performance on the specialized CombiBench while remaining highly competitive on general-domain benchmarks.
DiffER: Diffusion Entity-Relation Modeling for Reversal Curse in Diffusion Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing large language models exhibit unidirectional behavior when processing bidirectional relationships . authors propose a solution to alleviate the reversal curse in Diffusion LLMs .
Approach: They propose a model that addresses the "reversal curse" of bidirectional behavior in large language models . they propose 'entity-aware training' and balanced data construction to alleviate asymmetry and missing relations .
Outcome: The proposed model alleviates the "reversal curse" in Diffusion LLMs . the proposed model employs whole-entity masking to mitigate entity fragmentation .
IDEA: An Interpretable and Editable Decision-Making Framework for LLMs via Verbal-to-Numeric Calibration (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches fail to integrate domain expert insights beyond simple prompting.
Approach: They propose a framework that extracts LLM decision knowledge into an interpretable parametric model over semantically meaningful factors.
Outcome: Experiments show that IDEA outperforms DeepSeek R1 and GPT-5.2 in accuracy and accuracy.
OAgents: An Empirical Study of Building Effective Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: a recent study shows that agent research practices are far from standard, rigorous . lack of a standard evaluation protocol makes previous works not reproducible, authors say .
Approach: They conduct an empirical study on the GAIA benchmark to investigate agent design choices . they find that lack of a standard evaluation protocol makes previous works not reproducible .
Outcome: The proposed framework achieves state-of-the-art performance among open-source projects.
XLM-D: Decorate Cross-lingual Pre-training Model as Non-Autoregressive Neural Machine Translation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing pre-training language models have been successful in natural language understanding and autoregressive generation tasks, but non-autoregressive models have not been sufficiently successful.
Approach: They propose a pre-trained masked language model (MLM) and a non-autoregressive generation model with a lightweight decorator.
Outcome: The proposed model outperforms the previous mask-predict model on translation datasets by 19.9x.
Flow2Code: Evaluating Large Language Models for Flowchart-based Code Generation Capability (2025.findings-acl)

Copied to clipboard

Challenge: Existing code generation benchmarks neglect flowchart-based code generation . existing benchmarks lack flowcharting-based evaluation, limiting the potential of large language models and minimizing human error.
Approach: They propose to use flowcharts to evaluate existing LLMs' code generation capabilities.
Outcome: The proposed benchmarks show that the supervised fine-tuning technique contributes greatly to the models’ performance.
LLM-KT: Enhancing Large Language Models with Knowledge Tracing via Multi-Level Plug-and-Play Alignment (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to learn behavioral sequences fail to capture complex behavioral patterns due to a lack of deep reasoning capabilities and world knowledge.
Approach: They propose a framework that integrates the reasoning power of Large Language Models with the sequential modeling strengths of traditional KT methods via multi-level plug-and-play alignment.
Outcome: Extensive experiments on four standard datasets show that the proposed framework outperforms existing methods on state-of-the-art questions.
Hierarchical Visual Agent: Managing Contexts in Joint Image-Text Space for Advanced Chart Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing MLLMs are strong at understanding single plots, but struggle with multi-step reasoning . Existing approaches to manage context in chart reasoning include text-based chain-of-thought prompting .
Approach: They propose a hierarchical visual agent framework that iteratively constructs a working context in an image–text space.
Outcome: The proposed framework improves on strong multimodal baselines.
Learning to Contextually Aggregate Multi-Source Supervision for Sequence Labeling (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for Sequence Labeling require high-quality annotations, but imperfect annotations are relatively easy to obtain from crowdsourcing (noisy labels) Existing approaches to learn a model without knowing the underlying ground truth label sequences in the target domain are expensive and time-consuming.
Approach: They propose a framework Consensus Network that can be trained on annotations from multiple sources.
Outcome: The proposed framework improves on learning with crowd annotations and unsupervised cross-domain model adaptation in two practical settings.
Learning Neural Templates for Recommender Dialogue System (2021.emnlp-main)

Copied to clipboard

Challenge: Recent advances in neural models have shown promising progress on this task, but key challenges remain .
Approach: They propose a framework that can decouple dialogue generation from item recommendation . they use a response template generator and item selector to generate a responses template .
Outcome: The proposed framework outperforms the state-of-the-art methods on the benchmark ReDial.
Deep Research with Open-Domain Evaluation and Multi-Stage Guardrails for Safety (2026.acl-long)

Copied to clipboard

Challenge: Existing deep research frameworks lack adequate evaluation procedures and stage-specific protections.
Approach: They propose a framework with open-domain evaluation and a stage-wise safety benchmark to address this oversight.
Outcome: The proposed framework improves defense success rates by 16.53% while reducing over-refusal rates to approximately 6%.
BatonVoice: An Operationalist Framework for Enhancing Controllable Speech Synthesis with Linguistic Intelligence from LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches often fail to leverage the linguistic intelligence of Large Language Models (LLMs) Existing models lack the ability to follow text instructions for controllable Text-to-Speech (TTS).
Approach: They propose a framework where an LLM acts as a conductor, understanding user instructions and generating a textual plan - explicit vocal features.
Outcome: The proposed model outperforms open- and closed-source models in speech synthesis and achieves zero-shot cross-lingual generalization.
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for fine-tuning pre-trained models fail to generalize to unseen data.
Approach: They propose a framework for robust and efficient fine-tuning for pre-trained models . proposed framework achieves new state-of-the-art performance on a number of NLP tasks .
Outcome: The proposed framework outperforms the state-of-the-art T5 model on GLUE, SNLI, SciTail and ANLI.
TextBox: A Unified, Modularized, and Extensible Framework for Text Generation (2021.acl-demo)

Copied to clipboard

Challenge: TextBox is an open-source text generation framework that is modularized and extensible.
Approach: They propose to provide a unified, modularized, and extensible text generation framework that implements 21 text generation models on 9 benchmark datasets.
Outcome: The proposed framework implements 21 models on 9 benchmark datasets and is available under the Apache License 2.0 license.
Evaluating Robustness of Large Audio Language Models to Audio Injection: An Empirical Study (2025.emnlp-main)

Copied to clipboard

Challenge: Large Audio-Language Models (LALMs) are increasingly being deployed in real-world applications, yet their robustness against malicious audio injection remains underexplored.
Approach: They quantitatively assess their vulnerabilities and resilience using metrics: the Defense Success Rate, Context Robustness Score, and Judgment Robustic Index.
Outcome: The proposed models demonstrate significant performance disparities across four attack scenarios.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations