Papers by Han Hu

88 papers
C2DLM: Causal Concept-Guided Diffusion Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Autoregressive (AR) and diffusion language models (DLMs) suffer from insufficient reasoning capabilities.
Approach: They propose a fully connected Diffusion Language Model that uses a concept-level causal graph to guide attention to learn causal relationships between concepts.
Outcome: The proposed model achieves a 12% improvement and 3.2 training speedup on the COT-OrderPerturb task, along with an average gain of 1.31% across six downstream reasoning tasks.
ScaleLLM: A Resource-Frugal LLM Serving Framework by Optimizing End-to-End Efficiency (2024.emnlp-industry)

Copied to clipboard

Challenge: Large language models (LLMs) are widely used in commercial applications . low latency is crucial due to system latency, query concurrency, and computational resources constraints.
Approach: They propose a system that can be resource-efficiently served by addressing bottlenecks beyond LLM inference . they propose 4.3 speed up over vLLM and 1.5 higher throughput .
Outcome: The proposed system outperforms state-of-the-arts with 1.5 higher throughput . it achieves 4.3 speed up with 64 concurrent requests on Mixtral 8x7B .
Autoregressive Speech Synthesis without Vector Quantization (2025.acl-long)

Copied to clipboard

Challenge: MELLE is a novel language modeling approach for text-to-speech synthesis that generates continuous tokens from text . authors demonstrate that it reduces the need for vector quantization and improves model robustness .
Approach: They propose to autoregressively generate continuous mel-spectrogram frames directly from text condition, bypassing vector quantization.
Outcome: The proposed model achieves superior performance across multiple metrics and is more streamlined.
Efficient (Soft) Q-Learning for Text Generation with Limited Good Data (2022.findings-emnlp)

Copied to clipboard

Challenge: Maximum likelihood estimation (MLE) is the predominant method for training text generation models.
Approach: They propose a new RL formulation for text generation from the soft Q-learning perspective using path consistency learning to combine the best of on-/off-policy updates and learn effectively from sparse reward.
Outcome: The proposed approach outperforms MLE and previous RL methods in a wide range of tasks.
TensorOpera Router: A Multi-Model Router for Efficient LLM Inference (2024.emnlp-industry)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable performance across a diverse set of domain-specific tasks.
Approach: They propose a non-monolithic LLM querying system that seamlessly integrates various LLM experts into a single query interface and dynamically routes incoming queries to the most high-performant expert based on query’s requirements.
Outcome: The proposed model improves query efficiency by 40% and costs by 30% while maintaining or enhancing model performance by 10%.
ScalingFilter: Assessing Data Quality through Inverse Utilization of Scaling Laws (2024.emnlp-main)

Copied to clipboard

Challenge: Existing quality filtering methods rely on a high-quality dataset as reference . Existing methods introduce potential biases and compromise diversity .
Approach: They propose a method that evaluates text quality based on the perplexity difference between two language models trained on the same data.
Outcome: The proposed approach improves performance of pre-trained models without increasing training costs.
Log-FGAER: Logic-Guided Fine-Grained Address Entity Recognition from Multi-Turn Spoken Dialogue (2023.emnlp-main)

Copied to clipboard

Challenge: Existing name entity recognition methods combine pre-trained language models with supervised models such as BiLSTM/LSTM-CRF to perform poorly in a spoken dialogue context.
Approach: They propose a logic-guided fine-grained address recognition method that softly applies the logic rule to improve the accuracy of FGAER.
Outcome: The proposed method improves fine-grained address entity recognition from multi-turn spoken dialogues.
No Black Boxes: Interpretable and Interactable Predictive Healthcare with Knowledge-Enhanced Agentic Causal Discovery (2025.findings-emnlp)

Copied to clipboard

Challenge: Deep learning models lacking interpretability and interactivity, authors say . lack of interactive mechanisms prevents clinicians from incorporating their own knowledge into decision-making process.
Approach: a new deep learning model is proposed to improve interpretability and interactivity . authors propose a knowledge-enhanced agent-driven causal discovery framework .
Outcome: a new model improves interpretability and interactivity on EHR data . the proposed model improve interpretability through explicit reasoning and causal analysis .
Early Detection of Fake News by Utilizing the Credibility of News, Publishers, and Users based on Weakly Supervised Learning (2020.coling-main)

Copied to clipboard

Challenge: Existing models for fake news detection are often insufficient or lacking in features . a novel structure-aware multi-head attention network can detect fake news in 4 hours .
Approach: They propose a structure-aware multi-head attention network to detect fake news in mass news . they use credibility of publishers and users as prior weakly supervised information .
Outcome: The proposed model can detect fake news in 4 hours with an accuracy of over 91% . the proposed model is faster than the state-of-the-art models .
Beware of Your Po! Measuring and Mitigating AI Safety Risks in Role-Play Fine-Tuning of LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing role-play fine-tuning techniques improve role adaptability but may degrade safety performance, especially for villainous characters.
Approach: They propose safety-aware Role-Play Fine-Tuning (SaRFT) to balance role-playing capabilities and safety.
Outcome: The proposed method outperforms state-of-the-art baselines under both LoRA and full-parameter fine-tuning settings.
LyapLock: Bounded Knowledge Preservation in Sequential Large Language Model Editing (2025.emnlp-main)

Copied to clipboard

Challenge: Existing models for enhancing knowledge updating are prone to performance degradation due to incomplete knowledge preservation mechanisms.
Approach: They propose a model for locate-then-edit that decomposes long-term constrained programming into tractable stepwise subproblems for efficient solving.
Outcome: The proposed framework achieves asymptotic optimal editing performance while meeting the constraints of long-term knowledge preservation.
Uncertainty-Aware Cross-Modal Alignment for Hate Speech Detection (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for detecting hate speech ignore misalignment and uncertainty between modalities . social media platforms have become conduits for the rapid dissemination of hate speech .
Approach: They propose an uncertainty-aware cross-modal alignment framework for hate speech detection that minimizes the misalignment of image and text in memes.
Outcome: The proposed framework produces a competitive performance compared with existing methods.
Context Reasoner: Incentivizing Reasoning Capability for Contextualized Privacy and Safety Compliance via Reinforcement Learning (2025.emnlp-main)

Copied to clipboard

Challenge: Current mitigation strategies fail to preserve contextual reasoning capabilities in risky scenarios, leading to systemic risks for legal compliance.
Approach: They propose to use reinforcement learning with a rule-based reward to incentivize contextual reasoning capabilities while enhancing compliance with safety and privacy norms.
Outcome: The proposed model outperforms Qwen2.5-7B-Instruct model in safety and privacy benchmarks and achieves +8.58% accuracy improvement.
More Thinking, Less Talking: Internalizing Deliberative Safety into LLM Parameters (2026.acl-long)

Copied to clipboard

Challenge: Existing safety alignment methods leave Large Language Models vulnerable to sophisticated jailbreak attacks.
Approach: They propose a safety reasoning internalization framework that internalizes safety reasoning into an implicit computational pathway using Low-Rank Adaptation (LoRA).
Outcome: The proposed framework achieves a 43% lower Attack Success Rate (ASR) against distinct jailbreak attacks compared to strong baselines.
Reaction Miner: An Integrated System for Chemical Reaction Extraction from Textual Data (2023.emnlp-demo)

Copied to clipboard

Challenge: Reaction Miner is a system designed to extract chemical reactions from raw scientific PDFs.
Approach: They propose a system that extracts chemical reactions directly from raw scientific PDFs.
Outcome: The proposed system can extract chemical reactions from raw scientific PDFs.
DeepSynth-Eval: Objectively Evaluating Information Consolidation in Deep Survey Writing (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are evolving towards autonomous agents . retrieval capabilities are well-benchmarked, but post-retrieval synthesis is under-evaluated due to open-ended writing.
Approach: They propose a benchmark to evaluate information consolidation capabilities using survey papers as gold standards.
Outcome: The proposed benchmark analyzes the post-retrieval synthesis stage of large language models . it leverages high-quality survey papers as gold standards and reverse-engineers research requests . the proposed benchmark outperforms single-turn generation and reduces hallucinations .
PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Parallel Coordinated Reasoning (PaCoRe) overcomes a central limitation of contemporary language models: their inability to scale test-time compute (TTC) far beyond sequential reasoning under a fixed context window.
Approach: They propose a training-and-inference framework to overcome a central limitation of language models: their inability to scale test-time compute (TTC) under a fixed context window.
Outcome: The proposed model scales to multi-million-token effective TTC without exceeding context limits.
DisCal: Distribution-Aware Calibration for Mathematical Reasoning Under Character-Level Noisy Inputs (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for calibration of large reasoning models (LRMs) focus on clean inputs, leaving noise unexplored.
Approach: They propose a confidence calibration framework for character-level noisy inputs that extracts uncertainty signals from both the empirical answer distribution and the model’s predictive distribution and integrates them via a learned calibrator.
Outcome: Experiments on multiple mathematical reasoning benchmarks show that DisCal outperforms existing calibration methods under noisy inputs, reducing expected calibration error (ECE) by up to 39.21% and improving Area Under the Receiver Operating Characteristic Curve (AUROC) by 31.44%.
Beyond Ranking: Fine-Grained Diagnostics and Self-Improvement for MLLMs (2026.acl-long)

Copied to clipboard

Challenge: Current paradigms rely on holistic scoring and static leaderboards to disentangle fine-grained competencies.
Approach: They propose a framework to shift the focus from ranking to fine-grained diagnosis.
Outcome: The proposed framework surpasses the strongest baseline by 7.92%.
Mitigating the Alignment Tax of RLHF (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) acquire a wide range of abilities during pre-training, but aligning LLMs under Reinforcement Learning with Human Feedback (RLHF) can lead to forgetting pretrained abilities, which is also known as the alignment tax.
Approach: They propose to use a model averaging technique to find the most powerful alignment-forging Pareto front among RLHF algorithms.
Outcome: The proposed method achieves the strongest alignment-forging Pareto front among competing methods.
Multi-hop Selector Network for Multi-turn Response Selection in Retrieval-based Chatbots (D19-1)

Copied to clipboard

Challenge: Existing studies focus on matching candidate responses with every context utterance, but it also brings noise signals and unnecessary information.
Approach: They propose a multi-hop selector network to match context with candidate responses . they propose to use a selector to filter the relevant utterances as context .
Outcome: The proposed model outperforms state-of-the-art methods on three public multi-turn dialogue datasets.
PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods to reduce memory usage for large language models neglect inter-layer dependency between layers and huge memory consumption in pre-computation.
Approach: They propose a method that compresses the KV cache by layer-wise retaining crucial context.
Outcome: The proposed method reduces memory usage by layer-wise retaining crucial context . it can improve 2.2x throughput compared to Accelerate with over 54% memory reduction .
InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflection (2026.eacl-long)

Copied to clipboard

Challenge: Existing GUI Agents face challenges in multi-step reasoning and reliance on textual annotations, limiting their effectiveness.
Approach: They propose an MLLM-based GUI Agent with a two-stage supervised fine-tuning pipeline that enhances GUI understanding and grounding.
Outcome: InfiGUIAgent achieves competitive performance on several GUI benchmarks, highlighting the impact of native reasoning skills in enhancing GUI interaction for automation tasks.
CSP:Code-Switching Pre-training for Neural Machine Translation (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods to train neural machine translation models are data-hungry and low-resource . et al., 2018; Radford e.t., 2019; Yang ee.,2019) proposes a new pre-training method for NMT .
Approach: They propose a new pre-training method which randomly replaces some words in the input sentence with their translation words in target language.
Outcome: The proposed method improves on unsupervised and supervised NMT models by making full use of monolingual corpora.
EssayJudge: A Multi-Granular Benchmark for Assessing Automated Essay Scoring Capabilities of Multimodal Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Automated Essay Scoring (AES) systems face three major challenges: reliance on handcrafted features that limit generalizability, difficulty in capturing fine-grained traits like coherence and argumentation, and inability to handle multimodal contexts.
Approach: They propose a multimodal benchmark to evaluate AES capabilities across lexical-, sentence-, and discourse-level traits without manual feature engineering.
Outcome: The proposed system can evaluate AES capabilities across lexical-, sentence-, and discourse-level traits without manual feature engineering.
Exploring Multimodal Challenges in Toxic Chinese Detection: Taxonomy, Benchmark, and Findings (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies show that character substitutions in toxic Chinese text can confuse state-of-the-art LLMs.
Approach: They propose a taxonomy of 3 perturbation strategies and 8 specific approaches in Chinese text to assess if they can detect perturbed Chinese toxic contents.
Outcome: The proposed model can detect perturbed Chinese text with 8 different approaches . the proposed model is compared with 9 other LLMs from the US and China .
MultiPL-MoE: Multi-Programming-Lingual Extension of Large Language Models through Hybrid Mixture-of-Experts (2025.findings-emnlp)

Copied to clipboard

Challenge: MultiPL is a special case of multiple natural languages and requires limited computational resources to generate multilingual code.
Approach: They propose to extend LLMs by combining two paired experts to optimize expert selection at token and segment levels.
Outcome: The proposed extension improves the performance of the base LLMs while retaining the most popular ones using limited computational resources.
OSCBench: Benchmarking Object State Change in Text-to-Video Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on perceptual quality, text–video alignment, or physical plausibility, leaving a critical aspect of action understanding unexplored.
Approach: They introduce a benchmark specifically designed to assess OSC performance in T2V models.
Outcome: The proposed benchmark assesses the performance of open-source and proprietary T2V models on object state change (OSC) in the context of novel and compositional scenarios.
ChemNER: Fine-Grained Chemistry Named Entity Recognition with Ontology-Guided Distant Supervision (2021.emnlp-main)

Copied to clipboard

Challenge: Named entity recognition (NER) is a fundamental step in scientific literature analysis to build AI-driven systems for molecular discovery, synthetic strategy designing, and manufacturing.
Approach: They propose an ontology-guided method for fine-grained named entity recognition (NER) it leverages the chemistry type ontologies to generate distant labels with flexible KB-matching .
Outcome: The proposed method significantly outperforms the state-of-the-art methods with a .25 absolute F1 improvement.
Graph Hawkes Transformer for Extrapolated Reasoning on Temporal Knowledge Graphs (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods for entity prediction cannot predict when an event will occur . there are many facts not related to the query that can confuse the model .
Approach: They propose a temporal knowledge Graph reasoning model based on Graph Hawkes Transformer . the model captures instantaneous structural and temporal evolution information .
Outcome: The proposed model performs much better under long-term evolution scenarios.
Diagnosing Hidden Instabilities in Model Editing via Uncertainty Quantification (2026.acl-long)

Copied to clipboard

Challenge: Existing methods to update large language models (LLMs) without expensive retraining are fragile under single-edit evaluation protocols.
Approach: They propose a framework that characterizes activation-based editing as a constrained intervention on intermediate representations.
Outcome: The proposed method reveals local knowledge conflicts invisible to existing benchmarks.
ReactIE: Enhancing Chemical Reaction Extraction with Weak Supervision (2023.findings-acl)

Copied to clipboard

Challenge: Structured chemical reaction information is a vital tool for chemists engaged in laboratory work and advanced endeavors such as computer-aided drug design.
Approach: They propose a method which utilizes frequent patterns within the text as linguistic cues to identify specific characteristics of chemical reactions.
Outcome: The proposed model outperforms baselines and outperformed existing models.
UBench: Benchmarking Uncertainty in Large Language Models with Multiple Choice Questions (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for benchmarking the uncertainty of large language models face challenges . existing methods require internal model access, additional training, or high computational costs .
Approach: They propose a new benchmark for evaluating the uncertainty of large language models based on confidence intervals . UBench encompasses 11,978 multiple choice questions spanning knowledge, language, understanding, and reasoning capabilities.
Outcome: The proposed method outperforms existing methods for benchmarking the uncertainty of large language models.
Large Language Models Are Cross-Lingual Knowledge-Free Reasoners (2025.naacl-long)

Copied to clipboard

Challenge: Large language models have demonstrated impressive reasoning capabilities across multiple languages, but the relationship between capabilities in different languages is less explored.
Approach: They decompose the process of reasoning tasks into two separate components: knowledge retrieval and knowledge-free reasoning.
Outcome: The proposed model can be transferred across source-target languages despite secondary impact of resource in some specific target languages, while cross-lingual knowledge retrieval significantly hinders the transfer.
TaCube: Pre-computing Data Cubes for Answering Numerical-Reasoning Questions over Tabular Data (2022.emnlp-main)

Copied to clipboard

Challenge: Existing auto-regressive pre-trained language models are challenged by recent emerging numerical reasoning datasets due to the error-prone implicit calculation.
Approach: They propose a pre-computation tool to pre-compute aggregation/arithmetic results for the table in advance, so they are handy and readily available for PLMs to answer numerical reasoning questions.
Outcome: The proposed model improves on TAT-QA and T5 and BART-large on multiple benchmarks.
Multi 3 WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systems (2023.tacl-1)

Copied to clipboard

Challenge: Task-oriented dialog (TOD) is one of the central objectives, hallmarks, and applications of machine intelligence.
Approach: They propose a multilingual, multi-domain, multiparallele ToD dataset that offers culturally adapted dialogs in 4 languages for training and evaluation of multilingual and cross-lingual systems.
Outcome: The proposed dataset is large-scale and culturally adapted to enable training and evaluation of multilingual and cross-lingual ToD systems.
Soft Orthogonal Low-Rank Adaptation for Knowledge Sharing in Large Language Model Continual Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for continual learning (CL) are designed to mitigate catastrophic forgetting while neglecting knowledge sharing across tasks.
Approach: They propose a framework that facilitates knowledge transfer while mitigating catastrophic forgetting by assigning task-specific parameter subspaces to new tasks . they then leverage attribution scores to evaluate task similarity and employ soft orthogonality between task- specific subspace .
Outcome: The proposed framework facilitates knowledge transfer while mitigating catastrophic forgetting.
DUET: Joint Exploration of User–Item Profiles in Recommendation System (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs are opaque and difficult to interpret, resulting in limited interpretability.
Approach: They propose an interaction-aware profile generator that jointly produces user and item profiles conditioned on both user history and item evidence.
Outcome: The proposed model outperforms baselines on three real-world datasets.
DeKeyNLU: Enhancing Natural Language to SQL Generation through Task Decomposition and Keyword Extraction (2025.findings-emnlp)

Copied to clipboard

Challenge: NL2SQL provides a model-centric paradigm that simplifies database access for non-technical users . challenges such as inaccurate task decomposition and keyword extraction remain major bottlenecks .
Approach: They propose a RAG-based NL2SQL pipeline that employs three modules for query understanding, entity retrieval, and generation to improve SQL generation accuracy.
Outcome: The proposed pipeline improves the accuracy of query generation on BIRD and Spider datasets.
Gamma-Guard: Lightweight Residual Adapters for Robust Guardrails in Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are widely deployed as zero-shot evaluators for answer grading, content moderation, and document ranking.
Approach: They propose a system that trains LLMs with adapters to denoise embeddings and refocus attention.
Outcome: The proposed model lifts adversarial accuracy from 5% to 95% a 90 percentage-point gain while reducing clean-data accuracy by just 8 percentage points.
Enhancing Reinforcement Learning with Label-Sensitive Reward for Natural Language Understanding (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have yielded remarkable performance, but objective mismatch issues hinder RLHF learning.
Approach: They propose a Reinforcement Learning framework enhanced with Label-sensitive reward to enhance LLMs' alignment and generation capabilities.
Outcome: The proposed framework improves performance on five diverse models across eight tasks.
OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) and Large Multimodal Models have exceeded general human capabilities in various tasks.
Approach: They present an Olympiad-level bilingual multimodal scientific benchmark featuring 8,476 problems from Olympiad level mathematics and physics competitions.
Outcome: The best performing model, GPT-4V, attains an average score of 17.97% on OlympiadBench, with a mere 10.74% in physics, highlighting the benchmark rigor and the intricacy of physical reasoning.
ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding (2022.coling-1)

Copied to clipboard

Challenge: a new method for learning unsupervised sentence embeddings is proposed . unsup-SimCSE is biased because of the length information encoded into the sentence embeds .
Approach: They propose a new unsupervised sentence embedding method that uses dropout to obtain positive pairs from a pre-trained Transformer encoder.
Outcome: The proposed method outperforms the state-of-the-art unsup-SimCSE on a STS task.
Does Memory Need Graphs? A Unified Framework and Empirical Analysis for Long-Term Dialog Memory (2026.acl-long)

Copied to clipboard

Challenge: Existing literature on dialog memory systems is inconsistent on their effectiveness . empirical findings on graph structures are difficult to attribute to specific design choices .
Approach: They propose a framework that decomposes dialog memory systems into core components . they conduct stage-wise experiments on LongMemEval and HaluMeM, and compare implementation details .
Outcome: The proposed framework compares graph-based and non-graph memory architectures on long-term dialog memory systems.
Chain of Strategy Optimization Makes Large Language Models Better Emotional Supporter (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing supervised fine-tuning (SFT) fails to address these issues, as it trains models on single gold-standard responses without modeling nuanced strategy trade-offs.
Approach: They propose a two-stage framework that optimizes strategy selection preferences at each dialogue turn.
Outcome: The proposed framework improves strategy selection preferences at each dialogue turn.
RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learning (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods for finding the optimal prompt for a task are difficult to optimize.
Approach: They propose an efficient discrete prompt optimization approach with reinforcement learning that generates the optimal discrete stimulus after training with reward.
Outcome: The proposed approach is based on a parameter-efficient policy network that generates the optimal discrete prompt after training with reward.
GCRC: A New Challenging MRC Dataset from Gaokao Chinese for Explainable Evaluation (2021.findings-acl)

Copied to clipboard

Challenge: Existing machine reading comprehension datasets lack an explainable evaluation of systems' reasoning capabilities.
Approach: They propose a dataset with multi-choice questions that evaluates MRC systems' reasoning process . they use sentence-level relevant supporting facts, error reason of distractors to evaluate MRC .
Outcome: The proposed dataset is more challenging and useful for identifying limitations of existing MRC systems in an explainable way.
InfiMM-WebMath-40B: Advancing Multimodal Pre-Training for Enhanced Mathematical Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: InfiMM-WebMath-40B is a dataset of interleaved image-text documents . it consists of 24 million web pages, 85 million image URLs, and 40 billion text tokens .
Approach: InfiMM-WebMath-40B is a high-quality dataset of interleaved image-text documents . it contains 24 million web pages, 85 million image URLs, and 40 billion text tokens .
Outcome: InfiMM-WebMath-40B is a high-quality dataset of interleaved image-text documents . it consists of 24 million web pages, 85 million image URLs, and 40 billion text tokens .
Fine-grained Artificial Neurons in Audio-transformers for Disentangling Neural Auditory Encoding (2023.findings-acl)

Copied to clipboard

Challenge: Existing studies treat each transformer encoding layer as a single artificial neuron . layer-level embeddings aggregate multiple types of contextual attention captured by multiple head modules .
Approach: They propose to embed each transformer encoding layer as a single artificial neuron . they propose to couple those ANs with their biological-neuron counterparts in the human brain .
Outcome: The proposed models can be used to link representations to brain activity, the authors say . their results show that the proposed models carry meaningful neurolinguistic information .
MM-Doc-R1: Training Agents for Long Document Visual Question Answering through Multi-turn Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing work on long document visual question answering is based on Retrieval-Augmented Generation (RAG) where textual or visual content is encoded into embeddings and relevance is determined by similarity scores with respect to the original query.
Approach: They propose a framework that employs an agentic, vision-aware workflow to address long document visual question answering through iterative information discovery and synthesis.
Outcome: The proposed framework outperforms existing RL systems by 10.4% on the MMLongbench-Doc benchmark and demonstrates superior training performance over GRPO.
A Law Reasoning Benchmark for LLM with Tree-Organized Structures including Factum Probandum, Evidence and Experiences (2025.findings-acl)

Copied to clipboard

Challenge: a recent study focuses on generating impartial and interpretable judicial judgments based on established criminal fact.
Approach: They propose a law reasoning schema enriched with hierarchical factum probandum, evidence, and implicit experience that enables public scrutiny and preventing bias.
Outcome: The proposed schema enables public scrutiny and prevents bias in the "Intelligent Court" it employs a suite of legal analysis tools to address the challenge task.
RaP: Redundancy-aware Video-language Pre-training for Text-Video Retrieval (2022.findings-emnlp)

Copied to clipboard

Challenge: sparse sampling of videos suffers from inter-modal redundancy and visual redundancies . et al., 2021) proposes to sparsestly sample frames from videos to alleviate temporal redundance .
Approach: They propose to use sparse sampling to alleviate temporal redundancy in videos . they propose to penalize high-redundant video patches and text tokens .
Outcome: The proposed method improves on four benchmark datasets.
Beyond the Turn-Based Game: Enabling Real-Time Conversations with Duplex Models (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are increasingly permeating daily lives and require real-time interactions that mirror human conversations.
Approach: They propose to use time-division-multiplexing to process queries and responses pseudo-simultaneously.
Outcome: The proposed model can listen to users while generating output and adjust to provide instant feedback.
AdaSteer: Your Aligned LLM is Inherently an Adaptive Jailbreak Defender (2025.emnlp-main)

Copied to clipboard

Challenge: Activation steering offers training-free defense but relies on fixed steering coefficients, resulting in suboptimal protection and increased false rejections of benign inputs.
Approach: They propose an adaptive activation steering method that dynamically adjusts model behavior based on input characteristics.
Outcome: The proposed method outperforms baseline methods across multiple jailbreak attacks with minimal impact on utility.
UltraEval: A Lightweight Platform for Flexible and Comprehensive Evaluation for LLMs (2024.acl-demos)

Copied to clipboard

Challenge: Existing evaluation platforms are complex and poorly modularized, hindering seamless incorporation into researcher’s workflows.
Approach: They propose a lightweight evaluation framework characterized by lightweight, comprehensiveness, modularity, and efficiency that integrates models, data, and metrics into a unified evaluation workflow.
Outcome: The proposed evaluation framework is lightweight, comprehensive, modular, and efficient.
Is Compound Aspect-Based Sentiment Analysis Addressed by LLMs? (2024.findings-emnlp)

Copied to clipboard

Challenge: Aspect-based sentiment analysis (ABSA) aims to predict aspect-based elements from text . large language models (LLMs) have impressive abilities in handling human instructions .
Approach: They propose a framework to evaluate LLMs' ability to handle complex ABSA tasks . they use constrained prompts to automatically organize the returned predictions .
Outcome: The proposed framework outperforms supervised methods in some cases, but it is still lacking in other areas.
Resolving the Security-Auditability Dilemma with Auditable Latent Chain-of-Thought Alignment (2026.acl-long)

Copied to clipboard

Challenge: Extensive experiments show that ALCA reduces the success rate of adaptive jailbreak attacks by over 40% compared to strong baselines, while preserving performance.
Approach: They propose a framework that decouples internal reasoning from external output and allows the model to reconstruct its latent reasoning into human-readable text for supervision under specific guidance.
Outcome: The proposed framework reduces the success rate of adaptive jailbreak attacks by over 40% compared to baselines while preserving performance.
Let’s Ask GNN: Empowering Large Language Model for Graph In-Context Learning (2024.findings-emnlp)

Copied to clipboard

Challenge: Textual Attributed Graphs (TAGs) are crucial for modeling complex real-world systems, yet leveraging large language models (LLMs) for TAGs presents unique challenges due to the gap between sequential text processing and graph-structured data.
Approach: They propose a novel approach that leverages In-Context Learning to integrate graph data and task-specific information into large language models (LLMs) they employ a Graph Neural Network-powered structure-enhanced retriever to select labeled nodes across graphs, incorporating complex graph structures and their supervision signals.
Outcome: Experiments on three tasks and seven LLMs show that AskGNN performs better than existing methods.
CloneMem: Benchmarking Long-Term Memory for AI Clones (2026.acl-long)

Copied to clipboard

Challenge: Existing memory benchmarks rely on user–agent conversational histories, which are temporally fragmented and insufficient for capturing continuous life trajectories.
Approach: They propose a benchmark for evaluating long-term memory in AI Clone scenarios grounded in non-conversational digital traces, including diaries, social media posts, and emails, spanning one to three years.
Outcome: Experiments show that existing memory benchmarks struggle in this setting, highlighting open challenges for life-grounded personalized AI.
OxyGent: Making Multi-Agent Systems Modular, Observable, and Evolvable via Oxy Abstraction (2026.acl-demo)

Copied to clipboard

Challenge: Existing MAS frameworks lack standardized abstractions, leading to low efficiency and repetitive implementation of core functions.
Approach: They propose an open-source framework that encapsulates agents, tools, and reasoning flows as pluggable atomic components.
Outcome: The OxyGent framework provides a robust and scalable foundation for multi-agent systems in industrial environments.
DSMoE: Matrix-Partitioned Experts with Dynamic Routing for Computation-Efficient Dense LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Existing sparsification methods like pruning can lose model knowledge through parameter removal.
Approach: They propose a novel approach that achieves sparsification by partitioning pre-trained FFN layers into computational blocks.
Outcome: The proposed approach achieves superior performance across language modeling and downstream tasks under equivalent computational constraints.
RAPO: An Adaptive Ranking Paradigm for Bilingual Lexicon Induction (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches focus on minimizing distances between words in aligned pairs, while suffering from low discriminative capability to distinguish the relative orders between positive and negative candidates.
Approach: They propose a ranking-oriented induction model to learn personalized mapping function for each word.
Outcome: The proposed model can learn personalized mapping function for each word on public datasets including rich-resource and low-resourced languages.
Strengthened Symbol Binding Makes Large Language Models Reliable Multiple-Choice Selectors (2024.acl-long)

Copied to clipboard

Challenge: Multiple-Choice Questions (MCQs) are a critical area of research in the study of Large Language models (LLMs).
Approach: They propose an efficient SFT algorithm for MCQs, termed Point-wise Intelligent Feedback, which constructs negative instances by randomly combing the incorrect option contents with all candidate symbols.
Outcome: The proposed algorithm significantly reduces the model’s selection bias by improving its MCSB capability.
Uncertainty-Guided Modal Rebalance for Hateful Memes Detection (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for integrating hate information from different modalities ignore the modality uncertainty caused by the contribution degree of each modality to hate sentiment.
Approach: They propose an Uncertainty-guided Modal Rebalance framework for hateful memes detection . they propose to combine cross-modal fusion features with unimodal features .
Outcome: The proposed framework produces state-of-the-art performance on four widely-used datasets.
MEraser: An Effective Fingerprint Erasure Approach for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have raised critical concerns about model ownership and intellectual property protection.
Approach: They propose a method for effectively removing backdoor-based fingerprints from LLMs . they propose deleting backdoor fingerprints using a transferable erasure mechanism .
Outcome: The proposed method removes backdoor-based fingerprints while maintaining model performance.
KET-QA: A Dataset for Knowledge Enhanced Table Question Answering (2024.lrec-main)

Copied to clipboard

Challenge: Existing datasets that ignore the challenge of missing knowledge in TableQA are limited in their use.
Approach: They propose to use a knowledge base as the external knowledge source for TableQA and construct a dataset with fine-grained gold evidence annotation.
Outcome: The proposed model achieves remarkable performance improvements on three different settings, but still lags behind the human-level performance.
A Systematic Study of Performance Disparities in Multilingual Task-Oriented Dialogue Systems (2023.emnlp-main)

Copied to clipboard

Challenge: Existing systems trained for Arabic or Turkish using annotated data fully parallel to English ToD data still exhibit diminished ToD task performance.
Approach: They define new quantitative measures of absolute and relative equivalence in system performance, capturing disparities across languages and within individual languages.
Outcome: The proposed measures capture disparities across languages and within individual languages.
LAD-RAG: Layout-aware Dynamic RAG for Visually-Rich Document Understanding (2026.acl-long)

Copied to clipboard

Challenge: Conventional retrieval-augmented generation (RAG) methods encode content in isolated chunks during ingestion, losing structural and cross-page dependencies, and retrieve a fixed number of pages at inference.
Approach: They propose a Layout-Aware Dynamic RAG framework that encodes content in isolated chunks during ingestion and retrieves a fixed number of pages at inference.
Outcome: Experiments on MMLongBench-Doc, LongDocURL, DUDE, and MP-DoxVQA show that LAD-RAG improves retrieval, achieving over 90% perfect recall on average without any top-k tuning, and outperforming baseline retrievers by up to 20% in recall at comparable noise levels.
MR-ALIGN: Meta-Reasoning Informed Factuality Alignment for Large Reasoning Models (2026.findings-acl)

Copied to clipboard

Challenge: Large reasoning models (LRMs) show strong capabilities in complex reasoning, yet their marginal gains on evidence-dependent factual questions are limited.
Approach: They propose a Meta-Reasoning informed alignment framework that quantifies state-transition probabilities along the model’s thinking process and constructs a transition-aware implicit reward that reinforces beneficial reasoning patterns while suppressing defective ones at the atomic thinking segments.
Outcome: Empirical evaluations of four factual QA datasets and one long-form factuality benchmark show that MR-ALIGN consistently improves accuracy and truthfulness while reducing misleading reasoning.
SafeConf: A Confidence-Calibrated Safety Self-Evaluation Method for Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have many advantages but they also pose significant safety risks.
Approach: They propose a method to enhance the safety self-evaluation capability of LLMs . they perform semantic mutations on the original safety evaluation questions .
Outcome: The proposed method improves safety self-evaluation accuracy by 5.86% and 7.79% over baseline methods on Chinese and English datasets.
ContextLens: Modeling Imperfect Privacy and Safety Context for Legal Compliance (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to contextualize safety and privacy assessments assume the availability of complete and clear context, whereas real-world contexts tend to be ambiguous and incomplete.
Approach: They propose a semi-rule-based framework that leverages large language models to ground the input context in the legal domain and explicitly identify both known and unknown factors for legal compliance.
Outcome: The proposed framework can significantly improve existing baselines without training and can identify the ambiguous and missing factors.
FABLE: Fine-grained Fact Anchoring for Unstructured Model Editing (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for model editing memorize text holistically without reliable fine-grained fact access.
Approach: They propose a hierarchical framework that decouples fine-grained fact injection from holistic text generation.
Outcome: The proposed framework significantly improves fine-grained question answering while maintaining state-of-the-art holistic editing performance.
RealMem: Benchmarking LLMs in Real-World Memory-Driven Interaction (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks focus on casual conversation or task-oriented dialogue, failing to capture “long-term project-oriented” interactions where agents must track evolving goals.
Approach: They propose a benchmark that simulates the dynamic evolution of memory in real-world projects.
Outcome: The proposed benchmarks simulate the dynamic evolution of memory in real-world projects.
LLMBox: A Comprehensive Library for Large Language Models (2024.acl-demos)

Copied to clipboard

Challenge: a library to facilitate the development, use, and evaluation of large language models (LLMs) is presented.
Approach: They propose a unified library to facilitate the development, use and evaluation of large language models (LLMs).
Outcome: The proposed library is based on extensive experiments in a variety of evaluation settings.
From Style to Story: A Curriculum Learning Approach for Imitative Novel Generation (2026.findings-acl)

Copied to clipboard

Challenge: Novels create rich, immersive worlds with intricate plots and distinct styles, captivating readers through complex storytelling.
Approach: They propose a novel generation system that imitates novel elements by predicting plot developments and writing concrete details using vivid, expressive language.
Outcome: The novel imitative novel generation system is trained through a curriculum learning paradigm, progressing from low-level stylistic mastery to high-level narrative coherence.
Multi-Modal Multi-Granularity Tokenizer for Chu Bamboo Slips (2025.coling-main)

Copied to clipboard

Challenge: Using a multi-modal multi-granularity tokenizer, we analyze ancient Chinese scripts . a large proportion of the characters in ancient Chinese are rare or undeciphered .
Approach: They propose a multi-modal multi-granularity tokenizer specifically designed for ancient Chinese scripts.
Outcome: The proposed tokenizer improves on the part-of-speech tagging task on the Chu bamboo slip script.
Chain of Attack: Hide Your Intention through Multi-Turn Interrogation (2025.findings-acl)

Copied to clipboard

Challenge: Existing jailbreak attacks focus on single-turn dialogue scenarios, leaving vulnerabilities in multi-turn contexts inadequately explored.
Approach: They propose an optimal interrogation principle to conceal the jailbreak intent and introduce a multi-turn attack chain generation strategy called CoA.
Outcome: The proposed method shows that black-box LLMs exhibit insufficient resistance under multi-turn interrogation, with more advantages (ASR, 83% vs 64%)
Smoothed Contrastive Learning for Unsupervised Sentence Embedding (2022.coling-1)

Copied to clipboard

Challenge: Unsupervised contrastive sentence embedding models use InfoNCE loss function . increasing batch size leads to performance degradation when it exceeds threshold .
Approach: They propose a simple smoothing strategy upon the InfoNCE loss function to reduce the number of false-negative pairs in a batch without increasing the batch size.
Outcome: The proposed smoothing strategy improves unsupervised SimCSE on semantic similarity tasks.
MedPlan: A Two-Stage RAG-Based System for Personalized Medical Plan Generation (2025.acl-industry)

Copied to clipboard

Challenge: Existing systems focus primarily on assessment rather than treatment planning.
Approach: They propose a framework that structures LLM reasoning to align with real-life workflows.
Outcome: The proposed framework outperforms baseline approaches in assessment accuracy and treatment plan quality.
InterIDEAS: Philosophical Intertextuality via LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: a new dataset aims to bridge philosophy, literary studies, and natural language processing (NLP) by integrating theories of intertextuality with bibliometric techniques.
Approach: They propose a dataset that bridges philosophy, literary studies, and natural language processing (NLP) it combines theories of intertextuality from literary studies with bibliometric techniques and recent LLMs .
Outcome: a new dataset bridges philosophy, literary studies, and natural language processing (NLP) to analyze intertextuality . the proposed method helps scholars understand the intellectual, social, and historical relations embedded in texts . it also contributes to the development of language models, authors say .
A Knowledge-Guided Framework for Frame Identification (2021.acl-long)

Copied to clipboard

Challenge: Existing frameworks for frame identification are limited to only a few types of frame knowledge.
Approach: They propose a Knowledge-Guided Frame Identification framework that integrates frame knowledge to learn better frame representation.
Outcome: The proposed framework outperforms the state-of-the-art methods on two benchmark datasets.
Supervised Attention Mechanism for Low-quality Multimodal Data (2025.emnlp-main)

Copied to clipboard

Challenge: Current studies address missing and noisy modalities separately in multimodal data . missing modality is often caused by unavailable data collection equipment or sensor failures .
Approach: They propose a framework for multimodal affective computing that addresses missing and noisy modalities to enhance model robustness in low-quality data scenarios.
Outcome: The proposed model outperforms state-of-the-art baselines on multiple datasets under the settings of complete modalities, missing modalités, and noisy modality.
BvSP: Broad-view Soft Prompting for Few-Shot Aspect Sentiment Quad Prediction (2024.acl-long)

Copied to clipboard

Challenge: Aspect sentiment quad prediction aims to predict aspects due to distinct data distribution.
Approach: They propose a method that aggregates multiple templates with a broader view . they first construct a few-shot ASQP dataset that contains richer categories .
Outcome: The proposed method outperforms the state-of-the-art methods under four few-shot settings and other public datasets.
PrivaCI-Bench: Evaluating Privacy with Contextual Integrity and Legal Compliance (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in generative large language models (LLMs) have enabled wider applicability, accessibility, and flexibility.
Approach: They propose a contextual privacy evaluation benchmark that covers the entire relevant social context through private information flows.
Outcome: The proposed benchmarks cover legal compliance, real court cases, privacy policies, and synthetic data.
ChildEval:WHEN LARGE LANGUAGE MODELS MEET CHILDREN’S PERSONALITIES (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have achieved remarkable success in effectively understanding and generating human language, leading to a revolutionary era in LLMs.
Approach: They propose a benchmark to evaluate LLMs' ability to infer and follow child-centered preferences in long-context conversations.
Outcome: The proposed benchmark spans five top-level and fourteen sub-level categories covering children’s daily lives and development.
ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Activation sparsity is a promising paradigm for accelerating model inference . few large language models achieve high activation spar and comparable performance .
Approach: They propose a method to achieve activation sparsity and acceleration in large language models . they introduce ReLU activation and adopt progressive sparse regularization .
Outcome: The proposed method achieves high activation sparsity and comparable model performance.
InfoCSE: Information-aggregated Contrastive Learning of Sentence Embeddings (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on contrastive learning for sentence embeddings are weak . researchers have started to use contrastive training to learn better unsupervised sentences.
Approach: They propose an information-aggregated contrastive learning framework for learning unsupervised sentence embeddings.
Outcome: The proposed framework outperforms SimCSE on several benchmark datasets w.r.t the semantic text similarity task.
Efficient Table Retrieval and Understanding with Multimodal Large Language Models (2026.findings-eacl)

Copied to clipboard

Challenge: Tabular data is often captured in image form across a wide range of real-world scenarios.
Approach: They propose a framework that enables MLLMs to answer queries over large tables.
Outcome: The proposed framework outperforms existing methods by 7.0% in retrieval recall and 6.1% in answer accuracy on a newly constructed dataset with 48,504 unique tables.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations