Papers by Yuan Xu

145 papers
MIBench: Evaluating Multimodal Large Language Models over Multiple Images (2024.emnlp-main)

Copied to clipboard

Challenge: Existing benchmarks and MLLMs focus on single-image input scenarios, leaving performance of ML models when handling multiple images underexplored.
Approach: They propose a benchmark to evaluate fine-grained abilities of multimodal large language models in multi-image scenarios.
Outcome: The proposed benchmark categorizes the multi-image abilities into three scenarios: MII, MKS and MIC.
Text-to-Distribution Prediction with Quantile Tokens and Neighbor Context (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for text regression lack local grounding and rely on shared representations.
Approach: They propose a distributional regression model with quantile tokens that insert dedicated quantiles into the input sequence.
Outcome: The proposed method outperforms baseline models on the inside Airbnb and StackSample datasets.
PropGenie: A Multi-Agent Conversational Framework for Real Estate Assistance (2026.eacl-demo)

Copied to clipboard

Challenge: PropGenie is a multi-agent framework based on large language models (LLMs) it provides comprehensive real estate assistance in real-world scenarios .
Approach: They propose a multi-agent framework based on large language models to deliver comprehensive real estate assistance in real-world scenarios.
Outcome: The proposed framework outperforms a general-purpose LLM and a domain-specific chatbot in real-world scenarios.
Self-Criticism: Aligning Large Language Models with their Understanding of Helpfulness, Honesty, and Harmlessness (2023.emnlp-industry)

Copied to clipboard

Challenge: Recent studies have shown that large language models are useful, honest, harmless (HHH) however, RLHF requires high hardware resources and human efforts.
Approach: They propose a framework that allows LLMs to align themselves with HHH . they use IF and reinforcement learning from human feedback to fine-tune their models .
Outcome: The proposed framework achieves similar performance to RLHF and human-generated models with a minimal alignment tax.
Safe: Enhancing Mathematical Reasoning in Large Language Models via Retrospective Step-aware Formal Verification (2025.acl-long)

Copied to clipboard

Challenge: Chain-of-Thought prompting is a de facto method to elicit reasoning capabilities from large language models (LLMs).
Approach: They propose a step-aware formal verification framework Safe to address hallucinations in CoT prompting . they propose 'formal step' as a benchmark for step correctness theorem proving with 30,809 formal statements.
Outcome: The proposed framework shows significant performance improvement while offering interpretable and verifiable evidence.
Dynamic Routing Transformer Network for Multimodal Sarcasm Detection (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for multimodal sarcasm detection rely on fixed architectures to capture cross-modal incongruity.
Approach: They propose a method that uses dynamic paths to activate different routing transformer modules with hierarchical co-attention adapting to cross-modal incongruity.
Outcome: The proposed method is compared to state-of-the-art methods on a public dataset.
HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference (2025.findings-acl)

Copied to clipboard

Challenge: Existing top-k attention methods struggle to strike a balance between efficiency and accuracy.
Approach: They propose a top-k attention approach that integrates low-overhead techniques into the Top-k Attention process to achieve 7.2 speedup compared to vanilla full attention.
Outcome: The proposed approach achieves 7.2 speedup compared to current top-k attention methods while maintaining model accuracy.
OpenVNA: A Framework for Analyzing the Behavior of Multimodal Language Understanding System under Noisy Scenarios (2024.acl-demos)

Copied to clipboard

Challenge: OpenVNA is an open-source framework for analyzing the behavior of multimodal language understanding systems under noisy conditions.
Approach: They propose to use OpenVNA to analyze behavior of multimodal language understanding systems under noisy conditions.
Outcome: The proposed framework provides high flexibility and extensibility, enabling customization with user-defined noise types and models.
PunMemeCN: A Benchmark to Explore Vision-Language Models’ Understanding of Chinese Pun Memes (2025.emnlp-main)

Copied to clipboard

Challenge: Pun memes combine wordplay with visual elements to create humor, irony, or other rhetorical effects.
Approach: They propose a benchmark to assess Chinese pun memes' processing capabilities across three progressive tasks: pun meme detection, sentiment analysis, and chat-driven meme response.
Outcome: The proposed model can detect pun memes, analyze sentiments, and respond to chats, while ignoring homophone wordplay.
DTDES-KGE: Dual-Teacher Knowledge Distillation with Distinct Embedding Spaces for Knowledge Graph Embeddings (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing knowledge distillation methods rely on a single teacher embedding space . existing methods overlook valuable complementary knowledge from teachers in distinct embeddable spaces.
Approach: They propose a knowledge distillation framework that leverages dual teachers in embedding spaces to enhance performance.
Outcome: The proposed framework significantly improves knowledge distillation performance by leveraging dual teachers in distinct embedding spaces.
TableVista: Benchmarking Multimodal Table Reasoning under Visual and Structural Complexity (2026.findings-acl)

Copied to clipboard

Challenge: TableVista evaluates multimodal table reasoning under visual and structural complexity . current models struggle to maintain reasoning consistency when structural complexity combined with visually integrated presentations.
Approach: They propose a benchmark for evaluating multimodal table reasoning under visual and structural complexity.
Outcome: The proposed model performs poorly on visual and structural complexity.
ImaRA: An Imaginative Frame Augmented Method for Low-Resource Multimodal Metaphor Detection and Explanation (2025.findings-naacl)

Copied to clipboard

Challenge: Existing methods for multimodal metaphor detection neglect cross-domain and attribute similarity characteristics underlying multimodal understanding.
Approach: They propose an Imaginative FRame Augmented method for multimodal metaphor detection and explanation . they use a cross-modal imagination dataset rich in multimodal multimodal expressions .
Outcome: The proposed method outperforms existing methods with training data on two datasets.
NAP2: A Benchmark for Naturalness and Privacy-Preserving Text Rewriting by Learning from Human (2025.findings-emnlp)

Copied to clipboard

Challenge: a large number of large language models are being used to protect user privacy . sanitizing sensitive text using two common strategies is the answer .
Approach: They propose sanitizing sensitive text using deleting expressions and abstracting them . they propose a tool for text rewriting that uses crowdsourcing and large language models .
Outcome: The proposed approach protects privacy before sending sensitive data to large language models . it combines crowdsourcing and large language modeling to create a text rewrite tool .
Adaptive Hyper-parameter Learning for Deep Semantic Retrieval (2023.emnlp-industry)

Copied to clipboard

Challenge: Existing methods for deep semantic retrieval are highly sensitive to hyper-parameters . a novel adaptive metric learning method is proposed to overcome this limitation .
Approach: They propose a method that adaptively obtains hyper-parameters without fixed or extra-trainable hyper-parmeters . they adopt a symmetric metric learning method to mitigate model collapse issues .
Outcome: The proposed method outperforms existing methods on a real-world dataset and brings economic benefits.
One QuantLLM for ALL: Fine-tuning Quantized LLMs Once for Efficient Deployments (2025.acl-long)

Copied to clipboard

Challenge: Quantization has shown promise for Large Language Models, but current methods require lengthy training to alleviate quantization loss.
Approach: They propose to decouple weights and incorporate Low-Rank adapters to reduce weight sharing . they validate the approach on LLaMA2 families and Mistral on downstream evaluation .
Outcome: The proposed approach shows high performance while reducing deployment time faced with multiple scenarios.
Modeling Conceptual Attribute Likeness and Domain Inconsistency for Metaphor Detection (2023.emnlp-main)

Copied to clipboard

Challenge: Metaphor detection aims to distinguish between metaphorical and literal expressions in text.
Approach: They propose an attribute likeness and domain inconsistency learning framework for wordpair metaphor detection based on conceptual metaphor theory . they model attribute likeity with an attribute siamese network and devise a domain contrastive learning strategy to learn semantic inconsistentness of concepts in source and target domains .
Outcome: The proposed framework outperforms existing word-pair and token-level methods on four datasets.
Biology-Instructions: A Dataset and Benchmark for Multi-Omics Sequence Understanding Capability of Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Biology-Instructions is the first large-scale instruction-tuning dataset for multi-omics biological sequences.
Approach: They propose a large-scale instruction-tuning dataset for multi-omics biological sequences . they propose 'chatMultiOmics' to overcome limitations of current LLMs on multi-ome tasks .
Outcome: The proposed dataset bridges LLMs and complex biological sequence-related tasks while maintaining conversational fluency.
ULMR: Unlearning Large Language Models via Negative Response and Model Parameter Average (2024.emnlp-industry)

Copied to clipboard

Challenge: Large language models (LLMs) have attracted significant interest from the research community due to their broad applicability in many language-oriented tasks.
Approach: They propose a framework which uses pre-training datasets to rewrite instructions and generate negative responses to preserve the performance of the original LLM.
Outcome: The proposed framework can erase the pre-training data while maintaining the performance of the original model.
Evaluating Text Generation Quality Using Spectral Distances of Surprisal (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing metric fails to capture text surprisal, but FACE-2 produces stronger agreement with human preferences.
Approach: They propose a new automatic evaluation metric for open-ended text generation . they propose metric that extracts the dynamic patterns (spectrum) of text surprisal .
Outcome: The proposed metric outperforms existing methods in revealing the model scaling effect . it produces stronger agreement with human preferences from a large human-annotated dataset .
Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Training (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models exhibit a level of intelligence that is both impressive and everevolving, but their ability to refuse generating unsafe content is a double-edged sword.
Approach: They propose a method to tackle a refusal position bias within safety tuning data that compromises the models’ ability to appropriately refuse generating unsafe content.
Outcome: The proposed method significantly improves model safety without compromising performance and surpasses baseline methods in defending against attacks.
Discovering and Mitigating Indirect Bias in Attention-Based Model Explanations (2024.findings-naacl)

Copied to clipboard

Challenge: Discrimination is the unfair treatment or prejudice directed towards individuals, groups, or certain ideas or beliefs, intentionally or unintentionally.
Approach: They propose an algorithm to detect and mitigate indirect bias in transformer models by leveraging attention explanations.
Outcome: The proposed algorithm shows that it is more accurate than traditional fairness metrics and that it can be used to mitigate bias in transformer models.
HELPD: Mitigating Hallucination of LVLMs by Hierarchical Feedback Learning with Vision-enhanced Penalty Decoding (2024.emnlp-main)

Copied to clipboard

Challenge: Existing work detects hallucination by directly judging whether an object exists in an image, overlooking the association between the object and semantics.
Approach: They propose a framework that incorporates hallucination feedback at both object and sentence semantic levels to alleviate over 15% of hallucinism.
Outcome: The proposed framework can alleviate over 15% of hallucination even with a marginal degree of training.
Incentivizing Strong Reasoning from Weak Supervision (2026.eacl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated impressive performance on reasoning-intensive tasks, but enhancing their reasoning abilities typically relies on expensive high-quality demonstrations and reinforcement learning.
Approach: They propose to incentivize reasoning abilities of large language models without expensive demonstrations and reinforcement learning.
Outcome: The proposed model can recover 94% of the gains of expensive RL at a fraction of the cost.
Extrapolating Multilingual Understanding Models as Multilingual Generators (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing multilingual understanding models are not capable of generating high-quality text compared with decoder-based causal language models.
Approach: They propose a method to adapt a multilingual encoder to a language generator with a small number of additional parameters.
Outcome: The proposed approach outperforms initialization-based methods with 9.4 BLEU on machine translation, 8.1 Rouge-L on question generation, and 5.5 METEOR on story generation.
Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for idea generation either trivially prompt LLMs or expose LLM to extensive literature without indicating useful information.
Approach: They propose a chain-of-ideas agent that organizes literature in a chains structure . they propose evaluating idea-generation methods from different perspectives .
Outcome: The proposed agent outperforms existing methods and matches human quality in idea generation.
Cutting Off the Head Ends the Conflict: A Mechanism for Interpreting and Mitigating Knowledge Conflicts in Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods to expand internal memory boundaries of language models by providing external context can often conflict, leading to knowledge conflicts.
Approach: They propose a method that prunes conflicting attention heads without updating model parameters.
Outcome: The proposed method can flexibly control eight LMs to use internal memory or external context without updating model parameters.
Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for improving large language models have focused on improving model responses rather than judgment capabilities, resulting in rapid saturation during iterative training.
Approach: They propose an iterative Meta-Rewarding step where the model judges its own judgements and uses that feedback to refine its judgment skills.
Outcome: The proposed model improves Llama-3-8B-Instruct from 22.9% to 39.4% on AlpacaEval 2 and 20.6% to 29.1% on Arena-Hard.
HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classification (2024.naacl-long)

Copied to clipboard

Challenge: Existing self-supervised methods in natural language processing rely on augmentation rules to generate contrastive samples.
Approach: They propose a hierarchy-aware information lossless contrastive learning scheme that uses syntactic information reserved in the input sample and fused during the learning process.
Outcome: The proposed learning scheme is superior to existing methods in hierarchical text classification . the proposed learning system is based on a structure encoder and a text encoder .
DEEPER Insight into Your User: Directed Persona Refinement for Dynamic Persona Modeling (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for generating personas from static historical data fail to capture dynamic behaviors and evolving preferences in real-world interactive scenarios.
Approach: They propose a novel approach that iteratively updates personas using streaming user behavior data to continually enhance their quality.
Outcome: The proposed approach delivers 32.2% reduction in user behavior prediction error over four update rounds, outperforming the best baseline by 22.92%.
i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data (2024.findings-naacl)

Copied to clipboard

Challenge: i-Code V2 is one of the first models capable of generating natural language from any combination of Vision, Language, and Speech data.
Approach: They propose to create a model that can generate natural language from any combination of Vision, Language, and Speech data.
Outcome: i-Code V2 matches or outperforms state-of-the-art single- and dual-modality baselines on 7 multimodal tasks.
Do We Always Need Query-Level Workflows? Rethinking Agentic Workflow Generation for Multi-Agent Systems (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches generate workflows either at task level or query level, but their relative costs and benefits remain unclear.
Approach: They propose a query-level workflow generation framework that generates tasks at task level and query level.
Outcome: The proposed framework reduces token usage by up to 83% compared to existing approaches . it maintains competitive performance with an average degradation of just 0.61% compared with existing approaches across multiple datasets .
Meta-Information Guided Meta-Learning for Few-Shot Relation Classification (2020.coling-main)

Copied to clipboard

Challenge: Existing meta-learning models rely on implicit instance statistics and are unreliability and weak interpretability.
Approach: They propose a meta-information guided meta-learning framework that uses semantics to guide meta- learning . experimental results demonstrate the effectiveness of the proposed framework .
Outcome: The proposed framework can establish connections between instance-based information and semantic-based data, enabling faster initialization and adaptation.
Transition-based Directed Graph Construction for Emotion-Cause Pair Extraction (2020.acl-main)

Copied to clipboard

Challenge: Existing methods to extract emotions and causes from unannotated text are pipelined, causing error propagation.
Approach: They propose to transform a task into a procedure of parsing-like directed graph construction . they propose to generate a directed graph with labeled edges based on a sequence of actions .
Outcome: The proposed method outperforms the state-of-the-art methods by 6.71% (p0.01) in F1 measure.
Beyond Black-Box Interventions: Latent Probing for Faithful Retrieval-Augmented Generation (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve contextual faithfulness treat the LLM as a black box, generating responses that are inconsistent with the provided context.
Approach: They propose a framework for faithful RAG that operates in three stages: (i) fine-grained knowledge pruning to filter irrelevant context, (ii) latent conflict probing to identify hard conflicts in the model’s latent space, and (iv) conflict-aware attention to modulate attention heads toward faithful context integration.
Outcome: Experiments show that ProbeRAG significantly improves both accuracy and contextual faithfulness.
Taylor Unswift: Secured Weight Release for Large Language Models via Taylor Expansion (2024.emnlp-main)

Copied to clipboard

Challenge: Existing mechanisms compromise ownership rights or raise data privacy concerns . existing mechanisms compromise security of released large language models .
Approach: They propose a TaylorMLP to preserve the ownership of large language models by transforming the weights of LLMs into Taylor-series parameters instead of releasing original weights .
Outcome: The proposed model preserves ownership of large language models and prevents their abuse by adjusting the generation speed and causing low-speed token generation.
MMAG: Multimodal Learning for Mucus Anomaly Grading in Nasal Endoscopy via Semantic Attribute Prompting (2025.emnlp-main)

Copied to clipboard

Challenge: Accurate grading of rhinitis severity relies heavily on the characterization of key secretions, notably clear nasal discharge (CND) and purulent nasal secretion (PUS).
Approach: They propose a framework that integrates structured prompts with rank-aware vision-language modeling for joint detection and grading.
Outcome: The proposed model improves AUC and F1 scores on CND and PUS datasets by 6.31% and 4.79%.
M-SENA: An Integrated Platform for Multimodal Sentiment Analysis (2022.acl-demo)

Copied to clipboard

Challenge: M-SENA is an open-source platform for multimodal sentiment analysis.
Approach: They propose to use a platform for multimodal sentiment analysis to facilitate advanced research by providing flexible toolkits, reliable benchmarks, and intuitive demonstrations.
Outcome: The proposed framework provides reliable benchmarks and baseline results of different modality features and MSA benchmarks.
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning (2025.emnlp-demos)

Copied to clipboard

Challenge: Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs.
Approach: They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction.
Outcome: The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI.
Two Streams, One Sarcasm: Orthogonal Expert Tuning for Holistic Multimodal Sarcasm Understanding (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for multimodal satirical cognition hinder evaluation of multimodal Sarcasm Understanding . lack of a unified benchmark for holistic satire cognition hampers evaluation of MSU .
Approach: They propose a framework to decouple experts into orthogonal shared perception and private execution streams to physically block gradient interference between tasks.
Outcome: The proposed framework achieves superior performance on DocMSU-PLUS.
Can Public Large Language Models Help Private Cross-device Federated Learning? (2024.findings-naacl)

Copied to clipboard

Challenge: Recent studies have shown that public data can be used to improve privacy-utility trade-offs for large and small language models.
Approach: They propose to use large-scale public data to help differentially private FL training . they propose a distribution matching algorithm with theoretical grounding to sample public data close to private data distribution .
Outcome: The proposed method is efficient and effective for training private models by taking advantage of public data.
ParaCook: On Time-Efficient Planning for Multi-Agent Systems (2026.findings-acl)

Copied to clipboard

Challenge: Existing agent benchmarks focus on task completion while neglecting time efficiency in parallel and asynchronous operations.
Approach: They propose a framework for large language models that allows agents to plan long-horizon tasks in a scalable way.
Outcome: The proposed framework is based on the Overcooked game and can be used to evaluate time efficiency-aware multi-agent planning.
Turn the Combination Lock: Learnable Textual Backdoor Attacks via Word Substitution (2021.acl-long)

Copied to clipboard

Challenge: Recent studies show that neural natural language processing models are vulnerable to backdoor attacks.
Approach: They propose to inject neural models with backdoors activated by word substitution . their results raise a serious alarm to the security of NLP models, they argue .
Outcome: The proposed backdoors are activated by a learnable combination of word substitution and exhibit higher invisibility than previous methods.
TaoType: Predicting Fine-Grained Typing Intent for Faster Search (2026.acl-industry)

Copied to clipboard

Challenge: Large-scale industrial ranking systems operate under stringent real-time performance requirements.
Approach: They propose a client-side framework that determines whether a user’s query is complete at each typing . this method leverages client-based typing behavior for real-time early prediction .
Outcome: The proposed framework achieves offline precision/recall/accuracy of 0.7936/0.8196/0.7742 and decreases online response time by 640.5193.65 milliseconds.
Beyond Single View: A Comprehensive Benchmark for Medical Multimodal Large Language Models on Multi-Image Understanding (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for multimodal large language models are limited to multiview diagnostics.
Approach: They propose a benchmark specifically designed for medical multi-image understanding that evaluates MLLMs across four dimensions.
Outcome: The proposed model performs better in multi-image contexts than open-source models . the model perform better when processing increased visual loads than closed-source ones .
K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing pre-trained language models are not explicitly aware of domain-specific knowledge, which is essential for downstream tasks in many domains, such as tasks in e-commerce scenarios.
Approach: They propose a knowledge-injected pre-trained language model that can be transferred to both natural language understanding and generation tasks.
Outcome: The proposed model significantly outperforms baselines across the board in e-commerce scenarios.
BERT-MK: Integrating Graph Contextualized Knowledge into Pre-trained Language Models (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing knowledge representation learning methods do not use graph contextualized knowledge.
Approach: They propose to model subgraphs in a medical KG and integrate it with a pre-trained language model to do knowledge generalization.
Outcome: The proposed model achieves state-of-the-art on several medical NLP tasks . it improves on MedERNIE, and the proposed model is effective .
Following Length Constraints in Instructions (2025.emnlp-main)

Copied to clipboard

Challenge: Existing instruction following models fail to follow length constraints in their evaluations.
Approach: They propose to train models that can be controlled at inference time with instructions containing desired length constraints.
Outcome: The proposed models outperform standard instruction following models in length instructed evaluations.
RBPtool: A Deep Language Model Framework for Multi-Resolution RBP-RNA Binding Prediction and RNA Molecule Design (2025.emnlp-main)

Copied to clipboard

Challenge: RNA-binding proteins play key roles in post-transcriptional gene regulation . existing methods focus on shallow sequence features or coarse structural representations . large language models allow for precise modeling and biologically informed de novo RNA design .
Approach: They extend RPI15223 into a multi-resolution, structure-level RBP-RNA dataset and introduce RBPtool, a framework that fuses sequence and structural information.
Outcome: The proposed framework achieves state-of-the-art performance on public benchmarks and the RPI15223 dataset while supporting fine-grained level predictions.
SOLAR: Serendipity Optimized Language Model Aligned for Recommendation (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models have shown strong potential in recommendation tasks . however, their application to serendipity-oriented recommendations remains challenging .
Approach: They propose a domain-adaptive instruction tuning method that aligns Large Language Models with recommendation tasks.
Outcome: The proposed framework bridges the domain gap between LLMs and recommendation tasks.
OpenNRE: An Open and Extensible Toolkit for Neural Relation Extraction (D19-3)

Copied to clipboard

Challenge: OpenNRE provides a framework to implement neural relation extraction (RE) . the toolkit provides various functional modules based on TensorFlow and PyTorch .
Approach: OpenNRE is an open-source framework to implement neural relation extraction models. they also release an online system to meet real-time extraction without any training and deployment.
Outcome: OpenNRE provides a framework to implement neural models for relation extraction (RE) the toolkit also includes an online system to meet real-time extraction without training and deployment .
IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact (2024.findings-acl)

Copied to clipboard

Challenge: Existing quantization methods are compromising performance of large language models (LLMs) despite their high computational intensity, LLMs are still demanding intensive computation.
Approach: They propose to generate the KV cache of pivot tokens losslessly from the full-precision model.
Outcome: The proposed method generates the KV cache of pivot tokens losslessly from the full-precision model with no extra inference overhead.
Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection (2026.findings-acl)

Copied to clipboard

Challenge: Existing research on LLM biases has focused on direct questioning or general-purpose settings . pronounced behavioral biase despite their growing deployment in financial analysis, forecasting, and decision support.
Approach: They propose a benchmark to evaluate behavioral biases of large language models in MFMD . they use a multilingual financial misinformation dataset to integrate these with misinformation claims .
Outcome: The proposed benchmark evaluates behavioral biases of large language models across economic scenarios.
EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms (2025.naacl-long)

Copied to clipboard

Challenge: Existing work on extending specialized agents to multi-agent systems is dependent on human-designed frameworks, limiting the functional scope and scalability of agent systems.
Approach: They propose a generic method to automatically extend specialized agents to multi-agent systems via evolutionary algorithm . they consider existing agent frameworks as the initial individual and apply evolutionary operators to generate multiple agents with diverse settings.
Outcome: The proposed method can extend specialized agents to multi-agent systems . it can generate multiple agents with diverse settings, and improves performance across tasks .
AnaMeta: A Table Understanding Dataset of Field Metadata Knowledge Shared by Multi-dimensional Data Analysis Tasks (2023.findings-acl)

Copied to clipboard

Challenge: Tabular data analysis is performed everyday across various domains.
Approach: They propose to use a dataset of 467k tables with supervision labels for four types of field metadata.
Outcome: The proposed framework improves the understanding capability of tabular models by incorporating distribution and knowledge information.
Unifying Latent and Lexicon Representations for Effective Video-Text Retrieval (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for video-text retrieval capture fine-grained semantic concepts . however, they lack the ability to capture finer-grain concepts such as objects and actions.
Approach: They propose a dual-encoder architecture for fast video-text retrieval that learns lexicon representations to capture fine-grained semantics.
Outcome: The proposed framework outperforms existing methods with 4.8% and 8.2% improvement on MSR-VTT and DiDeMo respectively.
Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown great potential to enhance Natural Language Processing (NLP) models in areas such as predictive accuracy, fairness, robustness, and explainability.
Approach: They evaluate or improve generative Large Language Models from a causal perspective in areas such as reasoning capacity, fairness and safety issues, explainability, and handling multimodality.
Outcome: The proposed models can be used to perform causal relationship discovery and causal effect estimation tasks.
Training-Free Adaptive Speculative Decoding via Linguistic Priors (2026.findings-acl)

Copied to clipboard

Challenge: Speculative decoding (SPD) is a promising technique to accelerate Large Language Models (LLMs). current approaches neglect the inherent heterogeneity of natural language and fail to distinguish between semantically-rich content and structurally-predictable syntax.
Approach: They propose a training-free framework that leverages linguistic priors to enable adaptive drafting and verification.
Outcome: The proposed framework significantly accelerates inference without additional training.
Bypassing Neural Evaluations for Fast Audio Editing via Adaptive Trajectory Extrapolation (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in audio diffusion models have significantly improved text-to-audio editing via inversion techniques, but these models typically rely on dense, fixed-step sampling trajectories to maintain structural integrity.
Approach: They propose a model-agnostic Adaptive Trajectory Extrapolation framework that accelerates inversion-based editing process by dynamically evaluating only the most critical generative phases.
Outcome: The proposed framework achieves a 3.9 speedup with negligible loss in fidelity.
Verify Before You Commit: Towards Faithful Reasoning in LLM Agents via Self-Auditing (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to reasoning faithfulness violate constraints, authors say . a science fantasy series and companion books are among the books .
Approach: They propose a framework that enforces verification over internal belief states within the agent before action commitment, achieving faithful reasoning.
Outcome: The proposed framework improves reasoning faithfulness while preserving competitive end-task performance.
FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluation (D18-1)

Copied to clipboard

Challenge: Empirical results show that even the most competitive few-shot learning models struggle on this task, especially as compared with humans.
Approach: They propose a Few-Shot Relation Classification Dataset consisting of 70, 000 sentences on 100 relations derived from Wikipedia and annotated by crowdworkers.
Outcome: The proposed methods perform well on the most competitive few-shot learning models, especially as compared with humans.
Towards IP Intelligence: Benchmarking Large Language Models on Intellectual Property Knowledge and Practice (2026.findings-acl)

Copied to clipboard

Challenge: Existing datasets and benchmarks focus only on patents or cover limited aspects of the IP field, lacking alignment with real-world scenarios.
Approach: They propose a bilingual IP task taxonomy and a large-scale bilingual benchmark to evaluate LLMs in real-world IP practice.
Outcome: The proposed model achieves only 75.8% accuracy, indicating room for improvement . open-source IP and law-oriented models lag behind closed-source general-purpose models .
CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Current music information retrieval systems struggle to meet linguistic diversity challenges . current systems struggle with text queries in non-English languages .
Approach: They propose a music information retrieval system that supports both ABC notation and MIDI . CLaMP 2 includes a multilingual text encoder and a multiple-modal music encoder .
Outcome: The proposed system achieves state-of-the-art results in multilingual semantic search and music classification across modalities.
Investigating and Mitigating the Multimodal Hallucination Snowballing in Large Vision-Language Models (2024.acl-long)

Copied to clipboard

Challenge: Large Vision-Language Models (LVLMs) suffer from multimodal hallucinations . however, the generated hallucines could influence the models’ subsequent generation .
Approach: They propose a framework to evaluate LVLMs' behaviors when encountering generated hallucinations and a method to revise the output distribution of LVLs with the one derived from the residual visual input.
Outcome: The proposed framework reduces the performance of open-source LVLMs by 31%, indicating that they are prone to accept the generated hallucinations and make false claims that they would not have supported without distractions.
QFinZero: A Unified Financial Toolchain for LLM-Based Trading Agents (2026.acl-demo)

Copied to clipboard

Challenge: Existing trading systems rely on fragmented and task-specific APIs, resulting in inconsistent schemas and limited reproducibility.
Approach: They propose a unified trading environment for large language model (LLM) agents that standardizes three core capabilities . they argue that such a standardized trading environment is essential for scalable research on LLM-based financial agents.
Outcome: The proposed trading environment reduces engineering overhead and supports reproducible evaluation through comprehensive logging and deterministic replay.
BizCompass: Benchmarking the Reasoning Capabilities of LLMs in Business Knowledge and Applications (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks focus on narrow tasks and leave a fundamental question unanswered . Existing models only focus on specific tasks, requiring rigorous reasoning and knowledge .
Approach: They propose a benchmark to connect theoretical foundations with practical business knowledge and applications.
Outcome: The benchmark systematically evaluates both open-source and commercial LLMs . it reveals how theoretical knowledge translates into practical performance in business .
Semantics-enhanced Cross-modal Masked Image Modeling for Vision-Language Pre-training (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for vision-language pre-training lack high-level semantics and text is not sufficiently involved in masked modeling.
Approach: They propose a semantics-enhanced cross-modal MIM framework for vision-language representation learning that harvests high-level semantics from global image features via self-supervised agreement learning and transfers them to local patch encodings by sharing the encode space.
Outcome: The proposed model achieves state-of-the-art or competitive performance on multiple vision-language tasks.
Lego-MT: Learning Detachable Models for Massively Multilingual Machine Translation (2023.findings-acl)

Copied to clipboard

Challenge: Existing monolithic models for multilingual neural machine translation encounter parameter interference and inefficient inference for large models.
Approach: They propose a detachable multi-way model that assigns each language to an individual branch . they use data from OPUS to build a translation benchmark covering 433 languages .
Outcome: The proposed model outperforms existing models in OPUS and is faster than existing models.
KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches (2024.findings-emnlp)

Copied to clipboard

Challenge: Long context capability is a crucial competency for large language models as it mitigates the human struggle to digest long-form texts.
Approach: They propose to evaluate 10+ state-of-the-art approaches for long context-capable LLMs.
Outcome: The proposed methods are compared against 10+ state-of-the-art approaches across seven categories of long context tasks.
PRIME: A Process-Outcome Alignment Benchmark for Verifiable Reasoning in Mathematics and Engineering (2026.acl-long)

Copied to clipboard

Challenge: Current outcome-centric verification paradigms neglect potential errors in the derivation process.
Approach: They propose a process-aware RLVR training paradigm utilizing verifiers selected via **PRIME**.
Outcome: The proposed approach outperforms the baseline verification paradigm on AIME24, AIME25, and Beyond-AIME models.
APB-V: Accelerating Long-Video Understanding via Sequence-Parallelism-aware Approximate Attention (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for long-video inference use compression or sparse attention . existing methods restrict LMMs from handling longer, more complex videos .
Approach: They propose a sequence-parallel framework with optimized attention that accelerates long-video inference across multiple GPUs.
Outcome: The proposed framework delivers speedups of 12.72x, 1.70x, and 1.18x over FlashAttn, ZigZagRing, and APB without significant performance loss.
Self-Attention Guided Copy Mechanism for Abstractive Summarization (2020.acl-main)

Copied to clipboard

Challenge: Abstractive summarization models have been widely used to extract words from source into summary, but how to ensure that important words in source are copied remains a challenge.
Approach: They propose a Transformer-based model to enhance copy mechanism by identifying the importance of each source word based on the degree centrality.
Outcome: The proposed model outperforms baseline methods on CNN/Daily Mail and Gigaword datasets.
A Speaker-Aware Co-Attention Framework for Medical Dialogue Information Extraction (2022.emnlp-main)

Copied to clipboard

Challenge: With the development of medical digitization, the extraction and structuring of electronic medical records (EMRs) have become challenging but fundamental tasks.
Approach: They propose a speaker-aware dialogue encoder with multi-task learning which takes the speaker's identity into account and a co-attention fusion network to aggregate the utterance information.
Outcome: The proposed framework outperforms the state-of-the-art methods on the public medical dialogue extraction datasets to demonstrate its superiority.
Collab-Overcooked: Benchmarking and Evaluating Large Language Models as Collaborative Agents (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) based agent systems have made great strides in real-world applications beyond traditional NLP tasks.
Approach: They propose a new LLM-based Multi-Agent System benchmark, Collab-Overcooked, built on the popular Overcooked-AI game with more applicable and challenging tasks in interactive environments.
Outcome: The proposed benchmark provides a multi-agent framework supporting diverse tasks and objectives and encourages collaboration through natural language communication.
GraphDx: A Cost-Aware Knowledge-Enhanced Multi-Agent Framework for Sequential Diagnosis (2026.findings-acl)

Copied to clipboard

Challenge: Existing Large Language Models struggle to reason systematically under cost constraints . Existing approaches lack the knowledge-reasoning capability to reason under cost .
Approach: They propose a knowledge-enhanced framework that leverages large language models to construct MDKGs . they propose three collaborative agents that handle language understanding and generation .
Outcome: GraphDx improves diagnostic success rates from 50–68% to 79–93% while reducing test costs by 20–54%.
Open Hierarchical Relation Extraction (2021.naacl-main)

Copied to clipboard

Challenge: Existing OpenRE methods cast different relation types in isolation without considering their hierarchical dependency.
Approach: They propose a framework to establish bidirectional connections between OpenRE and relation hierarchies by integrating hierarchy information into relation representations.
Outcome: The proposed framework outperforms state-of-the-art models on relation clustering and hierarchy expansion.
Capturing Minds, Not Just Words: Enhancing Role-Playing Language Models with Personality-Indicative Data (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing role-playing models focus on character knowledge and tones, but lack personality-indicative data to capture characters' minds.
Approach: They propose to enhance role-playing agents (RPAs) via personality-indicative data by asking psychological scales to capture broad aspects of personality traits in individuals.
Outcome: The proposed model exhibits advanced role-playing capabilities for both general and personality-related evaluations.
PILLOW: Enhancing Efficient Instruction Fine-tuning via Prompt Matching (2023.emnlp-industry)

Copied to clipboard

Challenge: Low-Rank Adaptation (LoRA) has been used to adapt Large Language Models to a variety of tasks, but it requires substantial computational resources to perform.
Approach: They propose a low-rank adaptive learning approach that leverages LoRA's in-context learning capability through prompt matching via reinforcement learning in resource-constrained environments.
Outcome: The proposed model improves LoRA performance on evaluation metrics and utilises consumer-grade GPU resources.
PRINCE: Prefix-Masked Decoding for Knowledge Enhanced Sequence-to-Sequence Pre-Training (2022.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on injecting noises into the input sequence, but feasibility of injecting them into the decoding sequence remains an open question.
Approach: They propose a pre-training paradigm that integrates knowledge-enhanced decoding with noises in the prefix to strengthen the representation learning of entities that span over multiple input tokens.
Outcome: The proposed model achieves state-of-the-art results on two knowledge-driven data-to-text generation tasks with up to 2% BLEU gains.
Open Relation Extraction: Relational Knowledge Transfer from Supervised Data to Unsupervised Data (D19-1)

Copied to clipboard

Challenge: Existing methods to extract relational facts from open domain corpora are time-consuming and human-intensive.
Approach: They propose a framework to learn similarity metrics of relations from labeled data . they propose to transfer relational knowledge to identify novel relations in unlabeled data.
Outcome: Experiments on two real-world datasets show that the proposed framework improves compared with state-of-the-art methods.
Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and Masking (2021.acl-short)

Copied to clipboard

Challenge: Existing methods to learn consecutive tasks without forgetting how to perform previously trained problems are lacking.
Approach: They propose a continual learning method which preserves performance on previously encountered tasks while accelerating learning progress on subsequent tasks.
Outcome: The proposed method preserves performance on previously encountered tasks while accelerating learning progress on subsequent tasks.
ChemAmp: Amplified Chemistry Tools via Composable Agents (2026.findings-acl)

Copied to clipboard

Challenge: LLM-based agents are powerful tools for automating complex scientific workflows, especially in chemistry, but their single-task performance is limited by tool constraints.
Approach: They propose a framework that optimizes the collective capabilities of specialized tools by dynamic coordination within individual tasks.
Outcome: The proposed framework outperforms chemistry-specialized models, generalist LLMs, and agent systems with tool orchestration.
Curing Miracle Steps in LLM Mathematical Reasoning with Rubric Rewards (2026.acl-long)

Copied to clipboard

Challenge: Existing models are susceptible to reward hacking, leading to a substantial overestimation of a model's reasoning ability.
Approach: They propose a Rubric Reward Model that rewards the entire reasoning trajectory against problem-specific rubrics.
Outcome: The proposed model outperforms outcome-only supervision on four math benchmarks and boosts Verified Pass@1024 from 26.7% to 62.6% and reduces the incidence of Miracle Steps by 71%.
BayesFlow: A Probability Inference Framework for Meta-Agent Assisted Workflow Generation (2026.findings-eacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable generality, often solving tasks with a single carefully engineered prompt.
Approach: They propose to cast automatic workflow generation as Bayesian inference over a posterior distribution on workflows and instantiate BayesFlow as Bayer-based workflow generation framework.
Outcome: The proposed framework improves accuracy by 9 percentage points over baselines and 65 percentage points on pool-wide benchmarks.
Curse of Knowledge: Your Guidance and Provided Knowledge are biasing LLM Judges in Complex Evaluation (2025.findings-emnlp)

Copied to clipboard

Challenge: a recent study has focused on simple settings, but their reliability in complex tasks remains understudied.
Approach: They propose to use large language models as judges to evaluate reliability in complex tasks . they use a challenge benchmark to expose and quantify Auxiliary Information Induced Biases .
Outcome: The proposed benchmark exposes and quantifies Auxiliary Information Induced Biases across 12 basic and 3 advanced scenarios.
InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews (2024.acl-long)

Copied to clipboard

Challenge: Existing methods focus on knowledge and linguistic patterns of characters.
Approach: They propose to evaluate character fidelity of role-playing agents with psychological scales . they propose to use psychological scale to measure personality traits of RPAs based on personality traits.
Outcome: The proposed model reproduces character fidelity with psychological scales and shows that it is effective in measuring personality traits.
GCIG: GraphRAG-based Cross-document Instruction Generation for Boosting LLM Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for fine-tuning large language models struggle in knowledge-intensive domains and complex reasoning tasks due to their limited coverage of single-document knowledge and repetitive content.
Approach: They propose a GraphRAG-based cross-document instruction generation framework that generates diverse questions through task-aware prompts and context-sensitive retrieval.
Outcome: The proposed framework outperforms existing methods on knowledge-intensive and multi-hop question-answering tasks.
CtrlNews: LLM-based Multi-Agent Controllable News Writing via Knowledge Gravitational Field (2025.findings-emnlp)

Copied to clipboard

Challenge: Current approaches to news writing rely on superficially retrieved information and oversimplified knowledge enumeration resulting in shallow, repetitive, and unordered outputs.
Approach: They propose an LLM-based multi-agent controllable news writing framework called CtrlNews . they propose a fine-grained viewpoint control mechanism to regulate bias, emotion, and exaggeration attributes.
Outcome: The proposed framework simulates expert questioning through automated role assignment and question generation followed by a three-layer hierarchical gravitational graph iteratively refined via expansion-reflection cycles.
MTAVG-Bench: A Diagnostic Benchmark for Multi-Talker Dialogue-Centric Audio-Video Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation benchmarks for text-to-audio-video (T2AV) generation are largely designed for human-recorded videos or single-speaker settings.
Approach: They propose a failure-driven diagnostic benchmark for multi-talker dialogue-centric audio-video generation.
Outcome: The benchmark evaluates multi-speaker dialogue generation at four levels: audio-visual signal fidelity, temporal attribute consistency, social interaction, and cinematic expression.
ShortGPT: Layers in Large Language Models are More Redundant Than You Expect (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies have identified significant redundancy in large language models . quantization and pruning are two methods that reduce computational resources .
Approach: They propose simple pruning methods that prune redundant layers based on their BI scores.
Outcome: The proposed pruning methods demonstrate superior performance over previous pruning methods.
Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have limitations when it comes to comprehending and expressing world knowledge that extends beyond the boundaries of natural language.
Approach: They propose a model that integrates symbolic data into LLM training without loss of generality ability.
Outcome: The proposed model performs better on symbol- and NL-centric tasks.
Question Directed Graph Attention Network for Numerical Reasoning over Text (2020.emnlp-main)

Copied to clipboard

Challenge: Numerical reasoning requires both natural language understanding and arithmetic computation.
Approach: They propose a graph representation for the context of the passage and question needed for numerical reasoning.
Outcome: The proposed model achieves remarkable results in benchmark datasets such as DROP.
Fine-tuning LLMs with Cross-Attention-based Weight Decay for Bias Mitigation (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) excel in natural language processing tasks but often propagate societal biases from their training data, leading to discriminatory outputs.
Approach: They propose a method that modifies the LLM architecture to mitigate bias by adjusting the attention weights of sensitive tokens.
Outcome: The proposed method can handle multiple sensitive attributes and does not require full knowledge of sensitive tokens presented in the dataset.
Merge Hijacking: Backdoor Attacks to Model Merging of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing research on model merging focuses on optimizing model performance and minimizing backdoors.
Approach: They propose a backdoor attack targeting model merging in Large Language Models that creates a unified model for multi-domain tasks.
Outcome: The proposed attack is effective across models, merging algorithms, and tasks while maintaining utility across tasks.
LET: Leveraging Error Type Information for Grammatical Error Correction (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for grammatical error correction (GEC) are mainly divided into detection-based and end-to-end generative models.
Approach: They propose an end-to-end framework which Leverages Error Type (LET) information in the generation process to introduce more convincing error type information.
Outcome: The proposed framework outperforms existing methods on various datasets by a clear margin.
TacoPrompt: A Collaborative Multi-Task Prompt Learning Method for Self-Supervised Taxonomy Completion (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods for automating taxonomy completion use subtasks to learn subtask results, ignoring the effects of subtask on the final prediction.
Approach: They propose a multi-task automatic taxonomy completion method that attaches emerging concepts to an appropriate pair of hypernym and hyponym in existing taxonomies.
Outcome: The proposed method improves on three datasets and improves inference efficiency.
On the Faithfulness for E-commerce Product Summarization (2020.coling-main)

Copied to clipboard

Challenge: e-commerce product summarization requires consistency between product attributes and summary . inconsistent product summaries can mislead users and decrease public credibility .
Approach: They propose a model to generate e-commerce product summaries with product attributes . they encode product attribute table and constrain attribute words to be presented only through copying .
Outcome: The proposed model significantly improves the faithfulness of e-commerce product summarization tasks.
TEMP: Taxonomy Expansion with Dynamic Margin Loss through Taxonomy-Paths (2021.emnlp-main)

Copied to clipboard

Challenge: Existing taxonomies are unable to maintain coverage due to the rising of new concepts . TEMP uses pre-trained contextual encoders to predict the position of new ideas .
Approach: They propose a self-supervised taxonomy expansion method that ranks taxonomies by ranking them . they use pre-trained contextual encoders to train the model with dynamic margin loss .
Outcome: The proposed method outperforms state-of-the-art taxonomy expansion methods by 14.3% and 15.8% on public benchmarks.
A Theory Guided Scaffolding Instruction Framework for LLM-Enabled Metaphor Reasoning (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods for metaphor detection and reasoning struggle to explain the underlying reasoning process behind the metaphorical/literal judgment.
Approach: They propose a Theory guided Scaffolding Instruction framework that instructs an LLM to infer the underlying reasoning process of metaphor detection guided by metaphor theories for the first time.
Outcome: The proposed method significantly outperforms both the LLM-based reasoning methods and the SOTA methods in metaphor detection.
KG-Adapter: Enabling Knowledge Graph Integration in Large Language Models through Parameter-Efficient Fine-Tuning (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are criticized for lack of expertise and knowledge conflict . KG-Adapter is a parameter-level KG integration method for decoder-only LLMs .
Approach: They propose a parameter-level KG integration method based on parameter-efficient fine-tuning . they use KG-Adapter to integrate knowledge graphs with LLMs and perform joint reasoning .
Outcome: The proposed method outperforms the current state-of-the-art method on four datasets for two different tasks.
CENTAUR: Bridging the Impossible Trinity of Privacy, Efficiency, and Performance in Privacy-Preserving Transformer Inference (2025.acl-long)

Copied to clipboard

Challenge: Existing privacy-preserving Transformer Inference frameworks suffer from high computational overhead and performance losses.
Approach: They propose a framework that integrates random permutations and SMPC to address the "impossible trinity" CENTAUR resists diverse data reconstruction attacks and boosts inference speed by 5.030.4 times .
Outcome: CENTAUR achieves an unprecedented balance between privacy, efficiency, and performance.
R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have shown compelling abilities in reasoning, decision-making, and instruction following.
Approach: They propose a benchmark to evaluate the proficiency of large language models (LLMs) in judging and identifying safety risks given agent interaction records.
Outcome: The proposed model outperforms the best-performing model, GPT-4o, while no other models significantly exceed the random.
Denoising Relation Extraction from Document-level Distant Supervision (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods to generate auto-labeled sentences for relation extraction (RE) are difficult to extend to document-level relation extraction as noise from DS may be even multiplied in documents.
Approach: They propose a pre-trained model which de-emphasizes noisy DS data via multiple pre-training tasks.
Outcome: The proposed model can capture useful information from noisy data and achieve promising results on the large-scale DocRE benchmark.
Evaluating Character Understanding of Large Language Models via Character Profiling from Fictional Works (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have catalyzed numerous AI applications, among which role-playing agents (RPAs) are particularly popular.
Approach: They propose to evaluate LLMs' character understanding capability via the character profiling task, i.e., summarizing character profiles from corresponding materials, a widely adopted yet understudied practice for RPA development.
Outcome: The proposed model outperforms existing models and literature summarization methods and proves its ability to understand fictional characters in downstream tasks.
Bridging the Sensory Gap: Visual Injection for Taxonomy Completion (2026.acl-long)

Copied to clipboard

Challenge: Existing text-only methods suffer from a "Sensory Gap" in integrating new concepts into existing hierarchies.
Approach: They propose a framework leveraging Visual Injection for Taxonomy Completion that maps synthesized images into intrinsic pseudo-tokens and decouples magnitude from selection to prevent visual signals from being drowned out.
Outcome: Experiments on three datasets show that VITC achieves state-of-the-art performance . it delivers an average absolute gain of over 19% in Hit@1.
SaFER: A Robust and Efficient Framework for Fine-tuning BERT-based Classifier with Noisy Labels (2023.acl-industry)

Copied to clipboard

Challenge: Existing noise-handling methods could not improve performance of BERT on noisy datasets . existing methods could only improve performance on noisy data, authors say .
Approach: They propose a fine-tuning framework for BERT-based text classifiers that combats label noises without access to clean data for training or validation.
Outcome: The proposed framework achieves superior performance on multiple text classification benchmarks.
EASYTOOL: Enhancing LLM-based Agents with Concise Tool Instruction (2025.naacl-long)

Copied to clipboard

Challenge: EASYTOOL combines tools from diverse tool documentation into a single tool instruction.
Approach: They propose a framework that transforms tool documentation into a unified tool instruction.
Outcome: EASYTOOL combines extensive tool documentation into a concise tool instruction . it reduces token consumption and improves performance of LLM-based agents .
Fine-Grained Legal Argument-Pair Extraction via Coarse-Grained Pre-training (2024.lrec-main)

Copied to clipboard

Challenge: Current methods conceptualize LAE as a supervised sentence-pair classification problem and necessitate extensive manual annotations.
Approach: They propose a model that focuses on fine-grained alignment of argument pairs building upon coarse-grain complaint-defense pairs.
Outcome: The proposed model outperforms baseline models by 3.7 and 2.4 points on average.
MavenCoder: Competitive Code Generation via Model Adaptive Planning Strategies and Multi-Perspective Verification Enhancement (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have significantly enhanced automated program synthesis.
Approach: They propose a model-adaptive and verification–enhanced framework for competition-level code generation that leverages adaptive assessment aligned with the model’s capabilities to select planning strategies while providing timely feedback and correction via multi-perspective verification.
Outcome: The proposed framework outperforms existing state-of-the-art approaches on livecodebench, humanEval+, MBPP+, and codecontests, and achieves pass@1 results exceeding 3%–40%.
OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Code LLMs lack reproducible data pipelines and training protocols for reproducible advancements in code intelligence.
Approach: They propose a top-tier code LLM that releases model weights and inference code . reproducible data pipelines, rigorous experimental ablation results and training protocols are included .
Outcome: The proposed model achieves comparable performance to leading models and serves as an "open cookbook" reproducible training data, rigorous experimental ablation results, and detailed training protocols are also included in the model.
Discover and Prove: An Open-source Agentic Framework for Hard Mode Automated Theorem Proving in Lean 4 (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to solving mathematical problems fall into two broad categories: informal methods and formal methods.
Approach: They propose to use LLM natural-language reasoning to discover answers . they introduce Discover And Prove framework that rewrites Hard Mode statements into Easy Mode ones for existing ATP provers.
Outcome: The proposed framework can be used to prove hard mode statements on ATP benchmarks.
Collision to Cognition: Hash-Driven Graph Construction for Efficient RAG (2026.acl-long)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) has been used for enhancing large language models with external knowledge.
Approach: They propose a framework for mining efficient graph structures via hashing to enhance RAG . they adopt an inductive paradigm where global graph structure emerges from local hash collisions .
Outcome: The proposed framework outperforms existing baselines while requiring no GPU resources or token budget.
RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment (2025.findings-acl)

Copied to clipboard

Challenge: Existing retrieval augmented language models often overlook effective alignment with human preferences.
Approach: They propose a benchmark to evaluate RMs in retrieval augmented language models . they incorporate 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity .
Outcome: The proposed benchmark combines 18 RAG subsets, six retrievers, and 24 RALMs to increase diversity of data sources.
Generating Textual Adversaries with Minimal Perturbation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing word-level adversarial approaches for textual data have various limitations due to the large search space consisting of combinations of candidate words.
Approach: They propose a novel attack strategy to find adversarial texts with high similarity to original texts without perturbation.
Outcome: The proposed approach achieves higher success rates and lower perturbation rates in four benchmark datasets compared with state-of-the-art approaches.
LegoMT2: Selective Asynchronous Sharded Data Parallel Training for Massive Neural Machine Translation (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to train a single model for massive languages have huge communication overheads and parameter interference.
Approach: They propose an efficient training approach with an asymmetric multi-way model architecture for massive multilingual neural machine translation.
Outcome: The proposed model is 16.2 faster than the distributed training method for M2M-100-12B while improving the translation performance by an average of 2.2 BLEU on Flores-101.
LongDocURL: a Comprehensive Multimodal Long Document Benchmark Integrating Understanding, Reasoning, and Locating (2025.acl-long)

Copied to clipboard

Challenge: Existing document understanding benchmarks only handle a small number of pages . existing models are limited to handling only a limited number of documents .
Approach: They propose a long document understanding benchmark that integrates three primary tasks and 20 sub-tasks based on different primary tasks.
Outcome: The proposed model outperforms existing benchmarks on open-source and closed-source models . the model outpersforms other models on more than 33,000 pages of documents .
Mask the Correct Tokens: An Embarrassingly Simple Approach for Error Correction (2022.emnlp-main)

Copied to clipboard

Challenge: Text error correction methods usually use the source (incorrect) sentence as encoder input and generate the target (correct) sentences through the decoder.
Approach: They propose a method to correct errors in text sequences by randomly masking out the correct tokens in the source sentence.
Outcome: The proposed method improves accuracy on Mandarin and English datasets with autoregressive and non-autoregressive generation models.
SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check (2020.acl-main)

Copied to clipboard

Challenge: Existing methods to detect and correct spelling errors in Chinese take external input or just heuristic rules.
Approach: They propose to incorporate phonological and visual similarity knowledge into Chinese language models by using a specialized graph convolutional network.
Outcome: The proposed method outperforms existing models on three human-annotated datasets.
Learn to Copy from the Copying History: Correlational Copy Network for Abstractive Summarization (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for abstractive summarization use encoder-decoder attention, but this leads to incomplete copying.
Approach: They propose a copying scheme that takes advantage of prior copying distributions and explicitly encourages the model to copy the input word that is relevant to the previously copied one.
Outcome: The proposed scheme achieves state-of-the-art on summarization benchmarks . it takes advantage of prior copying distributions and explicitly encourages copying .
LM-Interview: An Easy-to-use Smart Interviewer System via Knowledge-guided Language Model Exploitation (2024.emnlp-demo)

Copied to clipboard

Challenge: Semi-structured interviews are a crucial method of data acquisition in qualitative research.
Approach: They propose a semi-structured interview system that automates interview preparation, analysis and control by interviewers.
Outcome: Experimental results show that LM-Interview performs comparable to human interviewers . the system can be used to analyze semi-structured interviews without interviewers' involvement .
Target-Oriented Relation Alignment for Cross-Lingual Stance Detection (2023.findings-acl)

Copied to clipboard

Challenge: Existing work on cross-lingual stance detection has ignored the inconsistency in the occurrences and distributions of targets between languages, which consequently degrades the performance of stance detector in low-resource languages.
Approach: They propose a fine-grained method which considers both target-level associations and language-level alignments to learn the in-language and cross-language associations.
Outcome: The proposed method is compared with competing methods under variant settings and shows that it performs better in low-resource languages.
Harnessing Negative Signals: Reinforcement Distillation from Teacher Data for LLM Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in model distillation show that data from advanced reasoning models can effectively train smaller student models.
Approach: They propose a method to use both positive and negative distilled reasoning traces to maximize LLM reasoning performance in offline settings.
Outcome: The proposed model outperforms existing methods in the distillation context.
Bridging Word-Pair and Token-Level Metaphor Detection with Explainable Domain Mining (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for word-pair metaphor detection provide intermediate explainable clues for detection results.
Approach: They propose a method to bridge word-pair and token-level metaphor detection by modeling word pairs as explainable intermediate information.
Outcome: The proposed method bridges word-pair and token-level metaphor detection by using word pairs . it provides intermediate explainable clues for the detection results, but this is a challenge .
HydraRAG: Structured Cross-Source Enhanced Large Language Model Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Current RAG system retrieves evidence from knowledge graphs and text documents but has limitations in multi-hop reasoning, multi-entity questions, and source verification.
Approach: They propose a training-free framework that unifies graph topology, document semantics, and source reliability to support deep, faithful reasoning in large language models.
Outcome: The proposed framework outperforms the current hybrid model-based model-driven system by 20.3% and 30.1% on seven benchmark datasets.
CryptoTrade: A Reflective LLM-based Agent to Guide Zero-shot Cryptocurrency Trading (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have been used for financial decision-making and stock market prediction for years.
Approach: They propose to use Large Language Models to analyze on-chain and off-chain data to provide a comprehensive overview of the cryptocurrency market.
Outcome: The proposed trading agent leverages the transparency and immutability of on-chain data, as well as the timeliness and influence of off-chain signals, providing a comprehensive overview of the cryptocurrency market.
Conformal Event Prediction with Temporal Knowledge Graph (2026.findings-acl)

Copied to clipboard

Challenge: Current event prediction methods lack rigorous uncertainty quantification, which limits their reliability for decision-making.
Approach: They propose a conformal prediction framework that applies conformal predictions to event prediction to address this challenge.
Outcome: The proposed framework guarantees coverage while improving efficiency on three public datasets.
Taming the Real-world Complexities in CPT E/M Coding with Large Language Models (2025.emnlp-industry)

Copied to clipboard

Challenge: Evaluation and Management (E/M) coding is performed by physicians and trained human coders who review clinical encounter notes and electronic health record data to assign appropriate codes.
Approach: They propose a framework that automates evaluation and management coding tasks using the Current Procedural Terminology (CPT) taxonomy.
Outcome: The proposed framework achieves an increase in coding accuracy of more than 36% over a commercial CPT E/M coding system and almost 5% over our strongest single-prompt baseline.
GlotEval: A Test Suite for Massively Multilingual Evaluation of Large Language Models (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing evaluation frameworks focus on English and a handful of high-resource languages, thereby overlooking the realistic performance of large language models in multilingual and lower-resourced scenarios.
Approach: They propose a unified and lightweight framework that integrates 27 benchmarks under a standard ISO 639-3 language identifier system to enable seamless incorporation of new benchmarks.
Outcome: The proposed framework integrates 27 benchmarks under a standard ISO 639-3 language identifier system, allowing for seamless incorporation of new benchmarks.
“A good pun is its own reword”: Can Large Language Models Understand Puns? (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies on the understanding of puns in large language models (LLMs) have not explored the use of pun in creative writing and humor creation.
Approach: They propose to use pun recognition, explanation and generation tasks to evaluate the capabilities of large language models (LLMs) they adopt automated evaluation metrics from prior research and introduce new evaluation methods and metrics that align more closely with human cognition.
Outcome: The proposed methods align more closely with human cognition than previous evaluation metrics.
BenchMAX: A Comprehensive Multilingual Evaluation Suite for Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing multilingual benchmarks focus primarily on language understanding tasks.
Approach: They develop a multi-way multilingual benchmark that measures critical capabilities of large language models across languages.
Outcome: Extensive experiments on BenchMAX reveal uneven utilization of core capabilities across languages, emphasizing the performance gaps that scaling model size alone does not resolve.
GuideLLM: Exploring LLM-Guided Conversation with Applications in Autobiography Interviewing (2025.naacl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated their effectiveness in human-guided dialogues, but tasks in the real world are more complex and require greater autonomy from LLMs.
Approach: They propose to characterize LLM-guided conversation into three fundamental components: Goal Navigation, Context Management, Empathetic Engagement and implement an interviewing environment for the evaluation of LLMs.
Outcome: The proposed LLM outperforms baseline LLMs in interviewing quality and autobiography generation quality.
Emotion-Cause Pair Extraction as Sequence Labeling Based on A Novel Tagging Scheme (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods to extract emotions and causes from unannotated emotion texts are labor intensive and limited applications in real-world scenarios.
Approach: They propose a novel task to find emotions and corresponding causes in unannotated emotion texts.
Outcome: The proposed model outperforms the state-of-the-art method by 2.26% (p0.001) in F1 measure.
i-Code Studio: A Configurable and Composable Framework for Integrative AI (2024.emnlp-demo)

Copied to clipboard

Challenge: Existing frameworks for Integrative AI lack flexibility and composability to handle multimodal tasks.
Approach: They propose a configurable framework for Integrative AI that orchestrates multiple pre-trained models to conduct complex multimodal tasks.
Outcome: The proposed framework achieves impressive results on zero-shot multimodal tasks . it can communicate and personalize for users, and it can be used in a multimodal agent .
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark (2022.acl-long)

Copied to clipboard

Challenge: a new benchmark for biomedical language understanding is being developed in Chinese . most benchmarks are limited to English, which makes it difficult to replicate success in other languages.
Approach: They propose to use Chinese biomedical language understanding evaluation benchmarks to evaluate Chinese models.
Outcome: The proposed benchmarks show that the current models perform worse than the human ceiling.
ToolHop: A Query-Driven Benchmark for Evaluating Large Language Models in Multi-Hop Tool Use (2025.acl-long)

Copied to clipboard

Challenge: Effective evaluation of multi-hop tool use is critical for analyzing the understanding, reasoning, and function-calling capabilities of large language models.
Approach: They propose a dataset that provides rigorous evaluation of multi-hop tool use.
Outcome: The proposed model achieves 49.04% accuracy across five model families.
LLM Prompt Duel Optimizer: Efficient Label-Free Prompt Optimization (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are highly sensitive to prompts, but most automatic prompt optimization methods assume access to ground-truth references that are costly to obtain.
Approach: They propose a sample-efficient framework for label-free prompt optimization based on pairwise preference feedback from an LLM judge.
Outcome: Experiments on BIG-bench Hard and MS MARCO show that the proposed framework identifies stronger prompts than label-free baselines while offering favorable quality–cost trade-offs.
CPRM: A LLM-based Continual Pre-training Framework for Relevance Modeling in Commercial Search (2025.naacl-industry)

Copied to clipboard

Challenge: Relevance modeling between queries and items is a key component of commercial search engines.
Approach: They propose a framework for continual pre-training of LLMs to enhance domain knowledge . they employ queries and multi-field item to jointly pre-train for enhancing domain knowledge.
Outcome: The proposed model achieves convincing performance compared to strong baselines.
Target-based Sentiment Annotation in Chinese Financial News (2020.lrec-1)

Copied to clipboard

Challenge: Using a large corpus of 8,314 target-level sentiment annotations, sentiment classification on multiple opinion aspects/targets level is unsatisfactory.
Approach: They propose to construct a large-scale target-based sentiment annotation corpus on Chinese financial news text.
Outcome: The proposed corpus has 8,314 target-level sentiment annotations on Chinese financial news text.
Reasoning Fails Where Step Flow Breaks (2026.acl-long)

Copied to clipboard

Challenge: Existing analysis tools struggle with long chain of thought traces.
Approach: They propose a saliency-inspired test-time intervention that adjusts shallow saliencies to improve accuracy on math, science, and coding tasks.
Outcome: The proposed model improves accuracy on math, science, and coding tasks without retraining.
From Outcomes to Processes: Guiding PRM Learning from ORM for Inference-Time Alignment (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to align large language models with human preferences suffer from inconsistent scoring and suboptimal alignment.
Approach: They propose a dual-consistency framework that aligns partial sequences with human preferences.
Outcome: The proposed framework significantly reduces granularity discrepancies and improves GPT-4 evaluation scores.
An Expert is Worth One Token: Synergizing Multiple Expert LLMs as Generalist via Expert Token Routing (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated remarkable capabilities across a wide spectrum of tasks, but performance and reliability in certain specialized domains still fall short of expectations.
Approach: They propose a unified generalist framework that facilitates seamless integration of multiple expert LLMs.
Outcome: The proposed framework outperforms existing multi-LLM collaboration paradigms across six diverse expert domains.
Character is Destiny: Can Persona-assigned Language Models Make Personal Choices? (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent research has demonstrated the potential of using LLMs to develop role-playing language agents (RPLAs) however, imitative decision-making necessitates a more nuanced understanding of personas.
Approach: They propose a method that uses persona-based memory retrieval to improve RPLAs.
Outcome: The proposed method significantly advances RPLAs on this task.
MathFlow: Enhancing the Perceptual Flow of MLLMs for Visual Mathematical Problems (2026.acl-long)

Copied to clipboard

Challenge: Existing multimodal large language models (MLLMs) exhibit significant limitations when extracting essential information and reasoned properties from diagrams and performing complex reasoning based on these visual inputs.
Approach: They propose a benchmark that provides a fine-grained evaluation of MLLMs’ perception and reasoning capabilities.
Outcome: The proposed benchmark shows that existing MLLMs exhibit limitations when extracting essential information and reasoned properties from diagrams and performing complex reasoning based on these visual inputs.
Controllable Memory Usage: Balancing Anchoring and Innovation in Long-Term Human–Agent Interaction (2026.acl-long)

Copied to clipboard

Challenge: Existing systems that use memory as an "all-or-nothing" approach to memory usage are often static and rely on experience-following tendencies.
Approach: They propose a framework that allows users to dynamically regulate memory reliance by adding context into the model's prompt.
Outcome: The proposed model outperforms prompting and memory masking strategies in multiple scenarios.
DocRED: A Large-Scale Document-Level Relation Extraction Dataset (P19-1)

Copied to clipboard

Challenge: Existing relation extraction methods focus on extracting intra-sentence relations for single entities.
Approach: They propose a relation extraction dataset from Wikipedia and Wikidata with three features . document-level relation extraction is a task to identify relational facts between entities .
Outcome: The proposed dataset is the largest human-annotated dataset for document-level RE from plain text.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations