Papers by Xiang Zhang

222 papers
Chronos: Learning Temporal Dynamics of Reasoning Chains for Test-Time Scaling (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for testing time scales treat reasoning traces or tokens equally, ignoring substantial variations in trajectory quality and localized logical failures.
Approach: They propose a chronological reasoning scorer that models each trajectory as a time series.
Outcome: The proposed method achieves relative improvements of 34.21% over Pass@128 and 22.70% over Maj@135 on HMMT25, highlighting its effectiveness.
Agentic Knowledgeable Self-awareness (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have achieved considerable performance across various agentic planning tasks.
Approach: They propose a data-centric approach that applies agents with knowledgeable self-awareness like humans to a heuristic situation judgement criterion to mark special tokens on their self-explored trajectories for collecting training data.
Outcome: The proposed paradigm outperforms baseline models on various tasks with minimal external knowledge.
Muse: Towards Reproducible Long-Form Song Generation with Fine-Grained Style Control (2026.findings-acl)

Copied to clipboard

Challenge: Recent commercial systems such as Suno demonstrate strong capabilities in long-form song generation, but academic research remains non-reproducible due to the lack of publicly available training data.
Approach: They propose a system for long-form song generation with fine-grained style conditioning that includes a licensed synthetic dataset and a song generation model, Muse.
Outcome: The proposed system achieves competitive performance on phoneme error rate, text–music style similarity, and audio aesthetic quality while enabling controllable segment-level generation across different musical structures.
Text Embedding as Treatment: A Meta Causal Approach for Robust Sentiment Classification (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for sentiment classification use binary treatment of words . Existing approaches limit generalizability to novel words and low-frequency words if there is a word in a sentence that is not treated .
Approach: They propose a meta-causal approach that uses a single training task to identify causal words for arbitrary words.
Outcome: The proposed method reduces the spurious correlation between word treatment and sentiment classification by removing words with low treatment effects from a pre-trained language model.
LLM-based Translation Inference with Iterative Bilingual Understanding (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies show that the ability of large language models to generate contextual understanding of the sentence can degrade translation quality.
Approach: They propose a method that generates contextual understanding for both source and target languages separately.
Outcome: The proposed method outperforms strong comparison methods in multiple domains.
Revisiting Chain-of-Thought Prompting: Zero-shot Can Be Stronger than Few-shot (2025.findings-emnlp)

Copied to clipboard

Challenge: In-Context Learning (ICL) is an essential emergent ability of Large Language Models (LLMs).
Approach: They introduce CoT to exemplars of ICL to enhance the reasoning capability . however, it remains unclear whether CoT exemplar is still beneficial for recent, stronger models in such tasks.
Outcome: The enhanced exemplars fail to improve the model’s reasoning performance, despite being constructed using answers from advanced models such as Qwen2.5-Max and DeepSeek-R1.
ALRPHFS: Adversarially Learned Risk Patterns with Hierarchical Fast & Slow Reasoning for Robust Agent Defense (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing safety checks fail to capture complex semantic risks posed by harmful user inputs or unsafe agent behaviors.
Approach: They propose a framework to bridge the semantic gap between safety checks and real-world risks.
Outcome: The proposed framework achieves superior overall performance compared to existing baselines.
SGA-MCTS: Decoupling Planning from Execution via Training-Free Atomic Experience Retrieval (2026.findings-acl)

Copied to clipboard

Challenge: a new framework casts LLM planning as non-parametric retrieval, but high latency of inference-time search and supervised fine-tuning are limitations.
Approach: They propose a framework that casts LLM planning as non-parametric retrieval . they leverage Monte Carlo Tree Search to explore the solution space .
Outcome: Empirical results show that SGA-MCTS can match the performance of SOTA systems without task-specific fine-tuning.
AnRe: Analogical Replay for Temporal Knowledge Graph Forecasting (2025.acl-long)

Copied to clipboard

Challenge: Temporal Knowledge Graphs (TKGs) are vital for event prediction, yet current methods face limitations.
Approach: They propose a training-free Analogical Replay reasoning framework that uses LLMs to extract historical contexts and generate analogical reasoning examples as contextual inputs.
Outcome: The proposed model outperforms existing training-free methods on four benchmarks.
Don’t Half-listen: Capturing Key-part Information in Continual Instruction Tuning (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to improve instruction tuning for large language models may cause catastrophic forgetting (CF) CF is a problem where previously learned abilities are degraded .
Approach: They propose a continual instruction tuning method that uses key-part information gain to replay data and refine training objective.
Outcome: The proposed method achieves superior performance on both seen and held-out tasks.
Doc-React: Multi-page Heterogeneous Document Question-answering (2025.acl-short)

Copied to clipboard

Challenge: Existing methods for integrating information across multiple modalities are suboptimal for multi-page, multimodal documents.
Approach: They propose an adaptive iterative framework that balances information gain and uncertainty reduction at each step.
Outcome: The proposed framework captures relevant multimodal content and achieves strong performance on complex QA tasks.
Can LLMs substitute SQL? Comparing Resource Utilization of Querying LLMs versus Traditional Relational Databases (2024.acl-srw)

Copied to clipboard

Challenge: Large Language Models (LLMs) can automate or substitute different types of tasks in software engineering.
Approach: They evaluate the resource utilization and accuracy of Large Language Models (LLMs) in interpreting and executing natural language queries against traditional SQL within relational database management systems.
Outcome: The proposed model can perform a variety of tasks in the software engineering process without consuming energy.
Towards Robust Neural Machine Translation with Iterative Scheduled Data-Switch Training (2022.coling-1)

Copied to clipboard

Challenge: Existing methods on robust neural machine translation (NMT) construct adversarial examples by injecting noise into authentic examples and indiscriminately exploit two types of examples.
Approach: They propose an iterative scheduled data-switch training framework to mitigate this problem by injecting noise into authentic examples and indiscriminately exploiting two types of examples.
Outcome: The proposed model outperforms several competitive benchmarks on four translation benchmarks.
LightNER: A Lightweight Tuning Paradigm for Low-resource NER via Pluggable Prompting (2022.coling-1)

Copied to clipboard

Challenge: Existing approaches for Named Entity Recognition (NER) use extensive labeled data for model training, which struggles in low-resource scenarios.
Approach: They propose a lightweight tuning paradigm for low-resource NER via pluggable prompting . they construct a learnable verbalizer of entity categories without any label-specific classifiers .
Outcome: The proposed model outperforms baselines and class transfer models in low-resource scenarios.
PRISM: Probabilistic Reward Model with Inherent Structural Modeling (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluators compress diverse human judgments into a single scalar, leading to brittle alignment and reward hacking.
Approach: They propose a Gaussian-based reinterpretation of reward evaluation as a conditional distribution and a mixture of Gaussians to capture conflicting preference dimensions.
Outcome: The proposed model outperforms scalar baselines in accuracy and generalization.
Good Visual Guidance Make A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extraction (2022.findings-naacl)

Copied to clipboard

Challenge: Existing approaches for named entity recognition and relation extraction suffer from error sensitivity when irrelevant object images are incorporated in texts.
Approach: They propose a hierarchical visual prefix fusion NeTwork for visual-enhanced entity and relation extraction using pluggable visual prefixed visual features.
Outcome: The proposed method achieves state-of-the-art on three benchmark datasets.
Importance of Synthesizing High-quality Data for Text-to-SQL Parsing (2023.findings-acl)

Copied to clipboard

Challenge: Existing text-to-SQL parsers lack the data to perform well with augmented synthetic data.
Approach: They propose a framework that imposes strong typing constraints and incorporates key relationships from schema.
Outcome: The proposed framework improves on the high-quality synthesized SQL and natural language question (NLQ) models have significant accuracy boosts and achieve new state-of-the-art performance on spider.
SafeSteer: A Decoding-level Defense Mechanism for Multimodal Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing defense methods rely on fine-tuning or inefficient post-hoc interventions, limiting their ability to address novel attacks.
Approach: They propose a decoding-level defense mechanism that employs a lightweight discriminator to iteratively steer the decoding process toward safety.
Outcome: The proposed method improves safety performance by up to 33.40% without fine-tuning on multiple MLLMs.
Demystifying Small Language Models for Edge Deployment (2025.acl-long)

Copied to clipboard

Challenge: Small language models (SLMs) are a promising solution for resource-constrained devices such as smartphones and the Web of Things.
Approach: They propose to use SLMs to build and optimize a set of small language models that are publicly accessible.
Outcome: The proposed models outperform 7B models in general tasks, while their in-context learning capabilities remain limited and their efficiency has significant optimization potential.
Masked Part-Of-Speech Model: Does Modeling Long Context Help Unsupervised POS-tagging? (2022.naacl-main)

Copied to clipboard

Challenge: Recent Part-Of-Speech (POS) induction models assume certain independence assumptions that do not hold in real languages.
Approach: They propose a Masked Part-of-Speech Model (MPoSM) that can model arbitrary tag dependency and perform POS induction through the objective of masked POS reconstruction.
Outcome: The proposed model can model arbitrary tag dependency and perform POS induction through the objective of masked POS reconstruction.
LaMP-Val: Large Language Models Empower Personalized Valuation in Auction (2025.findings-emnlp)

Copied to clipboard

Challenge: Currently, most research focuses on the bidding algorithms used within auction mechanisms.
Approach: They propose a personalized valuation framework that integrates Large Language Models to incorporate personalized semantic preference into users valuation process.
Outcome: The proposed framework incorporates Large Language Models to incorporate personalized semantic preference into users valuation process.
Title2Event: Benchmarking Open Event Extraction with a Large-scale Chinese Title Dataset (2022.emnlp-main)

Copied to clipboard

Challenge: Existing EE datasets define fixed event types and design specific schemas for each of them, failing to cover diverse events emerging from the online text.
Approach: They propose to use a sentence-level dataset to benchmark Open Event Extraction without restricting event types.
Outcome: The proposed dataset contains more than 42,000 news titles in 34 topics collected from Chinese web pages.
Benchmarking and Improving Large Vision-Language Models for Fundamental Visual Graph Understanding and Reasoning (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for enhancing understanding and reasoning abilities in graphbased tasks focus on specific graph types or tasks, posing challenges in designing versatile systems suitable for various tasks and graphs across diverse domains.
Approach: They propose a structure-aware fine-tuning framework to enhance LVLMs with structure learning abilities through three self-supervised learning tasks.
Outcome: Extensive evaluations on 14 LVLMs reveal that LVLs are weak in basic graph understanding and reasoning tasks, particularly those concerning relational or structurally complex information.
Tracing and Dissecting How LLMs Recall Factual Knowledge for Real World Questions (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models have shown promising ability to perform commonsense reasoning.
Approach: They propose a two-dimensional analysis framework that incorporates token back-tracing and token decoding to uncover how LLMs conduct factual knowledge recall.
Outcome: The proposed framework shows that LLMs lack relevant knowledge but struggle to select the most accurate information based on context during the retrieval and rerank phase.
CSTree-SRI: Introspection-Driven Cognitive Semantic Tree for Multi-Turn Question Answering over Extra-Long Contexts (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have achieved remarkable success in natural language processing (NLP), particularly in single-turn question answering (QA) on short-text.
Approach: They propose a framework that captures logical correlations across chunks of ELC and maintains coherence of multi-turn Questions.
Outcome: The proposed framework is able to capture logical correlations across chunks of ELC and maintain coherence of multi-turn Questions.
ProtT3: Protein-to-Text Generation for Text-based Protein Understanding (2024.acl-long)

Copied to clipboard

Challenge: Language Models excel in understanding textual descriptions of proteins, but struggle to process texts.
Approach: They propose a framework for Protein-to-Text Generation for Text-based Protein Understanding that integrates a PLM as its protein understanding module.
Outcome: The proposed framework surpasses existing baselines and is highly efficient in protein-to-text generation.
FinKario: Event-Enhanced Automated Construction of Financial Knowledge Graph (2026.acl-long)

Copied to clipboard

Challenge: Equity research reports are crucial resources for investors, but lack professional analysis and the rapid evolution of market events outpaces their update cycles.
Approach: They propose an event-Enhanced automated construction of financial knowledge graph (FinKario) that automatically integrates real-time company fundamentals and market events through prompt-driven extraction guided by professional institutional templates.
Outcome: The proposed model outperforms financial LLMs by 18.81% and institutional strategies by 17.85% on average in backtesting.
LLM-as-Scheduler: Agentic Workflow Dynamic Scheduling (2026.acl-long)

Copied to clipboard

Challenge: Experiments show that LAS cuts token usage by 43% and reduces end-to-end latency by more than 36%, while causing at most a 1.4 percentage-point drop in accuracy compared with a strong fixed workflow.
Approach: They propose a system that dynamically chooses the right workflow for each query.
Outcome: Experiments show that LAS cuts token usage by 43% and reduces end-to-end latency by more than 36% while causing at most a 1.4 percentage-point drop in accuracy compared with a strong fixed workflow.
CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents (2025.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for MLM agents in interactive environments are limited by their focus on a single environment, lack of detailed and generalized evaluation methods, and the complexity of constructing tasks and evaluators.
Approach: They propose a cross-environment agent benchmark framework that integrates graph-based evaluation and task generation methods.
Outcome: The proposed framework supports multiple devices and can be easily extended to any environment with a Python interface.
Learning Dialogue Representations from Consecutive Utterances (2022.naacl-main)

Copied to clipboard

Challenge: Dialogue Sentence Embedding (DSE) is a self-supervised contrastive learning method that learns effective dialogue representations suitable for a wide range of dialogue-oriented tasks.
Approach: They propose a self-supervised contrastive learning method that learns dialogue representations suitable for a wide range of dialogue tasks.
Outcome: The proposed method outperforms baselines on five dialogue tasks on a few-shot and zero-shot datasets.
SINCon: Mitigate LLM-Generated Malicious Message Injection Attack for Rumor Detection (2025.acl-long)

Copied to clipboard

Challenge: Existing methods define important nodes as important and target them for attacks if the model treats nodes’ predictive influence more uniformly . Existing approaches target high predictive influence nodes but are vulnerable to malicious message injection attacks.
Approach: They propose a defense mechanism that encourages the model to learn graph representations where nodes with varying importance have a more uniform influence on predictions.
Outcome: Extensive experiments on the Twitter and Weibo datasets show that similarizing the predictive Influence of nodes with Contrastive Learning significantly enhances resistance against LLM-driven message injection attacks.
Xiaomingbot: A Multilingual Robot News Reporter (2020.acl-demos)

Copied to clipboard

Challenge: Xiaomingbot is a multilingual and multimodal software robot with four capabilities: news generation, news translation, news reading and avatar animation.
Approach: They propose to build a multilingual and multimodal software robot with four inte- gal capabilities: news generation, news translation, news reading and avatar animation.
Outcome: The proposed system generates Chinese news, then reads it in multiple languages and generates an animated avatar reading it.
BoolQuestions: Does Dense Retrieval Understand Boolean Logic in Language? (2024.findings-emnlp)

Copied to clipboard

Challenge: Dense retrieval systems focus on optimizing text embedding space while overlooking Boolean logic in language.
Approach: They propose a task to investigate whether retrieval systems can comprehend Boolean logic in language.
Outcome: The proposed method is based on a benchmark dataset covering complex queries containing basic Boolean logic and corresponding annotated passages.
MAB-DQA: Addressing Query Aspect Importance in Document Question Answering with Multi-Armed Bandits (2026.acl-long)

Copied to clipboard

Challenge: Document Question Answering (DQA) requires interpreting visual layouts, which has prompted recent studies to adopt multimodal Retrieval-Augmented Generation (RAG) that processes page images for answer generation.
Approach: They propose a multi-armed bandit-based DQA framework that explicitly models the varying importance of multiple implicit aspects in a query.
Outcome: The proposed framework shows an improvement of 5%-18% over the state-of-the-art method on four benchmarks.
Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model (2023.findings-acl)

Copied to clipboard

Challenge: Pretrained language models have achieved remarkable success in various natural language processing tasks.
Approach: They propose to use end-task knowledge to select a tiny subset of pretraining corpus to influence performance.
Outcome: The proposed model outperforms pretrained models on eight datasets covering four domains with 0.45% of the data and a three-orders-of-magnitude lower computational cost.
Hello Again! LLM-powered Personalized Agent for Long-term Dialogue (2025.naacl-long)

Copied to clipboard

Challenge: Existing dialogue systems focus on brief single-session interactions, neglecting real-world needs for long-term companionship and personalized interactions.
Approach: They propose a model-agnostic framework for long-term dialogue agents . they use event summary and persona management to enable reasoning .
Outcome: The proposed framework incorporates three independently tunable modules dedicated to event perception, persona extraction, and response generation.
Self-Supervised Prompt Optimization (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing prompt optimization methods rely heavily on external references such as ground truth or by humans, limiting their applicability in real-world scenarios where such data is unavailable or costly to obtain.
Approach: They propose a cost-efficient framework that discovers effective prompts for both closed and open-ended tasks without external reference.
Outcome: The proposed framework outperforms state-of-the-art prompt optimization methods with significantly lower costs and fewer samples.
Call Me When Necessary: LLMs can Efficiently and Faithfully Reason over Structured Environments (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown potential in reasoning over structured environments, e.g., knowledge graphs and tables.
Approach: They propose a framework that allows LLMs to efficiently and faithfully reason over structured environments.
Outcome: The proposed framework surpasses state-of-the-art fine-tuned methods on three KGQA and two TableQA datasets and surpasse CWQ and WTQ methods.
Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling (P19-3)

Copied to clipboard

Challenge: upcoming open-source natural language processing repository aims to train conversational agents for multi-turn situations.
Approach: They present the Intelligent Conversation Engine: Code and Pre-trained Systems (ICECAPS) the framework wraps TensorFlow functionality in a modular component-based architecture.
Outcome: The Intelligent Conversation Engine: Code and Pre-trained Systems (ICECAPS) is an open-source natural language processing repository.
Gradient-guided Attention Map Editing: Towards Efficient Contextual Hallucination Mitigation (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) often experience “contextual hallucination” where they prioritize self-generated content over input context, leading to a disregard for pertinent details.
Approach: They propose a method that dynamically adjusts attention maps to enhance contextual relevance by using a trained classifier to identify attention maps likely to induce hallucinations.
Outcome: The proposed approach reduces hallucinations across open-source models on summarization and open-book QA tasks.
Zero-Shot Cross-Domain Dialogue State Tracking via Dual Low-Rank Adaptation (2024.acl-long)

Copied to clipboard

Challenge: Existing approaches to zero-shot dialogue state tracking (DST) involve embedding prompts into language models, but these methods have inherent limitations.
Approach: They propose a plug-and-play architecture designed for zero-shot dialogue state tracking (DST) dual low-rank adaptation targets dialogue context processing and prompt optimization without incurring additional inference latency.
Outcome: The proposed architecture outperforms baseline methods on multi-domain datasets and the MultiWOZ dataset.
Beyond Logits: Aligning Feature Dynamics for Effective Knowledge Distillation (2025.acl-long)

Copied to clipboard

Challenge: Knowledge distillation (KD) compresses large language models into lightweight versions called student models.
Approach: They propose to align the entire feature dynamics between teacher and student models by using two additional loss terms to achieve this.
Outcome: The proposed method matches the entire feature dynamics between teacher and student models rather than just the final states.
LayoutDIT: Layout-Aware End-to-End Document Image Translation with Multi-Step Conductive Decoder (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods struggle to capture the visual layout in complex document images.
Approach: They propose to integrate layout knowledge into document image translation by using a layout-aware encoder and a multi-step conductive decoder to achieve the translation step by step.
Outcome: The proposed model outperforms state-of-the-art methods with better parameter efficiency.
Answering Ambiguous Questions through Generative Evidence Fusion and Round-Trip Prediction (2021.acl-long)

Copied to clipboard

Challenge: Open-domain question answering is a task to answer questions using passages with diverse topics.
Approach: They propose a model that aggregates evidence from multiple passages to adaptively predict a single answer or a set of question-answer pairs for ambiguous questions.
Outcome: The proposed model achieves state-of-the-art performance on AmbigQA dataset and shows competitive performance on NQ-Open and TriviaQA.
ReactXT: Understanding Molecular “Reaction-ship” via Reaction-Contextualized Molecule-Text Pretraining (2024.findings-acl)

Copied to clipboard

Challenge: Molecular-text modeling is an emerging research field that aims to facilitate molecule-relevant tasks with a textual interface and textual knowledge.
Approach: They propose a new method for reaction-text modeling that uses three types of input contexts to incrementally pretrain LMs.
Outcome: The proposed method improves experimental procedure prediction and molecule captioning and offers competitive results in retrosynthesis.
Coarse-to-fine Few-shot Learning for Named Entity Recognition (2023.findings-acl)

Copied to clipboard

Challenge: Existing few-shot NER solutions do not consider sub-class discrimination and various granularity of new classes during coarse training.
Approach: They propose a method that uses a cluster-based prototype loss to learn group-wise discriminative representations of coarse-grained classes and a mixture prototype loss for learning the representations.
Outcome: The proposed method shows superior performance over baseline methods on in-domain and cross-domain settings with various target granularity.
From Selection to Generation: A Survey of LLM-based Active Learning (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have been used for selection and training of data for active learning.
Approach: They propose an intuitive taxonomy that categorizes LLM-based active learning techniques and discuss the transformative roles they can play in the active learning loop.
Outcome: The proposed model can generate entirely new data instances and provide more cost-effective annotations with fewer labeled data instances.
Video-MMMU: Evaluating Knowledge Acquisition from Multidisciplinary Professional Videos (2026.acl-long)

Copied to clipboard

Challenge: Existing video benchmarks do not evaluate the knowledge acquisition capabilities of Large Multimodal Models (LMMs) existing video benchmark focuses on static, general visual understanding tasks, without evaluating whether models can acquire knowledge dynamically.
Approach: They propose a multi-modal, multi-discipline, multitrack benchmark that evaluates Large Multimodal Models’ ability to acquire knowledge from college-level, educational videos.
Outcome: The proposed benchmark reveals a substantial gap between human learners and current Large Multimodal Models (LMMs) and focuses on improving their learning efficiency.
An Industry Evaluation of Embedding-based Entity Alignment (2020.coling-industry)

Copied to clipboard

Challenge: Knowledge graphs (KGs) are increasingly important in various applications such as question answering and search engines.
Approach: They propose to use a supervised learning environment with unbiased seed mappings for training and validation to evaluate alignment methods in an industrial context.
Outcome: The proposed methods are evaluated in an industrial context and are compared with DBpedia and Wikidata benchmarks.
MolTC: Towards Molecular Relational Modeling In Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Molecular Relational Learning (MRL) is a promising way to understand interactions between molecular pairs.
Approach: They propose a novel LLM-based multi-modal framework for molecular interaction modeling following Chain-of-Thought (CoT) theory which integrates graphical information of two molecules in pair.
Outcome: The proposed framework integrates graphical information of two molecules in pair.
HiDe-LLaVA: Hierarchical Decoupling for Continual Instruction Tuning of Multimodal Large Language Model (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to improve instructionfollowing performance of MLLMs often trade off memory efficiency for performance gains, compromising overall efficiency.
Approach: They propose a task-specific expansion and task-general fusion framework based on variations in Centered Kernel Alignment (CKA) similarity across different model layers when trained on diverse datasets.
Outcome: The proposed framework improves performance compared to existing benchmarks.
RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks focus on character-centric approach and fail to reflect real-world applications.
Approach: RMTBench is a user-centric bilingual role-playing benchmark featuring 80 diverse characters and over 8,000 dialogue rounds.
Outcome: RMTBench features 80 diverse characters and over 8,000 dialogue rounds.
Flipping Knowledge Distillation: Leveraging Small Models’ Expertise to Enhance LLMs in Text Matching (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable capabilities in acquiring diverse knowledge, making them highly effective across a wide range of tasks.
Approach: They propose a flipped knowledge distillation paradigm where LLM learns from SLM . they propose to reinterpret LLMs as encoder-decoder models using LoRA .
Outcome: The proposed model has been deployed in an online application environment and validated on financial and healthcare benchmarks and real-world applications.
DialCoT Meets PPO: Decomposing and Exploring Reasoning Paths in Smaller Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Chain-of-Thought prompting has improved the reasoning capabilities of Large Language Models (LLMs) but it is ineffective or detrimental to the performance on reasoning tasks in Smaller Language Model (SLMs) with less than 10 billion parameters.
Approach: They propose a Dialogue-guided Chain-of-Thought method to improve the reasoning capabilities of Large Language Models (LLMs) by generating intermediate reasoning steps in a dialogue format to guide the model to the final answer.
Outcome: The proposed method can achieve significant performance gains over state-of-the-art competitors on four arithmetic reasoning datasets.
OntoEA: Ontology-guided Entity Alignment via Joint Knowledge Graph Embedding (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods for aligning knowledge graph entities ignore the ontology which contains critical meta information such as classes and membership relationships with entities.
Approach: They propose an ontology-guided method where KGs and ontologies are jointly embedded.
Outcome: Extensive experiments on seven public and industrial benchmarks show the ontology-guided method performs well and is cost-effective.
An Empirical Exploration of Local Ordering Pre-training for Structured Prediction (2020.findings-emnlp)

Copied to clipboard

Challenge: Recent studies have shown that pre-training contextualized encoders with language model objectives is effective for structured prediction.
Approach: They propose a semi-supervised method for pre-training contextualized encoders with language model objectives.
Outcome: The proposed method is effective on three typical structured prediction tasks in four languages.
Act-Adaptive Margin: Dynamically Calibrating Reward Models for Subjective Ambiguity (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to reward modeling in reinforcement learning tasks are limited when dealing with ambiguous preferences.
Approach: They propose to use AAM to dynamically calibrate preference margins using the Bradley-Terry model's internal parameter knowledge to improve reward modeling in subjective tasks.
Outcome: The proposed approach improves reward modeling by dynamically calibrating preference margins using the model’s internal parameter knowledge.
ReLM: Leveraging Language Models for Enhanced Chemical Reaction Prediction (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for predicting chemical reactions are limited by insufficient training data and inability to utilize textual information.
Approach: They propose a framework that leverages chemical knowledge encoded in language models to assist GNNs, thereby enhancing the accuracy of real-world chemical reaction predictions.
Outcome: The proposed framework improves state-of-the-art GNN-based methods across chemical reaction datasets especially in out-of distribution settings.
EmoHarbor: Evaluating Personalized Emotional Support by Simulating the User’s Internal World (2026.acl-long)

Copied to clipboard

Challenge: EmoHarbor is an evaluation framework that rewards generic empathetic responses but fails to assess whether the support is genuinely personalized to users’ unique psychological profiles and contextual needs.
Approach: They propose an automated evaluation framework that adopts a User-as-a-Judge paradigm by simulating the user's inner world.
Outcome: The proposed framework decomposes users' internal processes into three specialized roles and defines 10 evaluation dimensions of personalized support quality.
DuetSim: Building User Simulator with Dual Large Language Models for Task-Oriented Dialogues (2024.lrec-main)

Copied to clipboard

Challenge: User Simulators are used to train task-oriented dialogue systems . traditional training paradigms rely on human-engineered agendas resulting in generated responses that lack diversity and spontaneity.
Approach: They propose a framework that leverages large language models to generate diverse responses . they use two LLMs to generate and verify responses, which are preferred by users .
Outcome: The proposed framework produces responses that exhibit diversity and are preferred by human users.
Are Missing Links Predictable? An Inferential Benchmark for Knowledge Graph Completion (2021.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for Knowledge Graph Completion (KGC) are unsatisfactory .
Approach: They propose to use rule-guided train/test generation instead of conventional random split to ensure that each testing sample is predictable with supportive data in the training set.
Outcome: The proposed model improves on existing benchmarks in inferential ability, assumptions, and patterns.
HuatuoGPT, Towards Taming Language Model to Be a Doctor (2023.findings-emnlp)

Copied to clipboard

Challenge: Experimental results show that the distilled language model outperforms its teacher model (ChatGPT) in most cases.
Approach: They propose a Large Language Model (LLM) that leverages both distilled data from **ChatGPT** and real-world data from**doctors** in the supervised fine-tuning stage.
Outcome: The proposed model outperforms the teacher model in most cases by using additional real-world data and RLMF to align the language model with the merits of both sources.
Knowledge Graph Enhanced Neural Machine Translation via Multi-task Learning on Sub-entity Granularity (2020.coling-main)

Copied to clipboard

Challenge: Existing methods to integrate knowledge graph (KG) with neural machine translation (NMT) have two problems: knowledge under-utilization and granularity mismatch.
Approach: They propose a multi-task learning method on sub-entity granularity to combine machine translation and knowledge reasoning tasks.
Outcome: The proposed method significantly outperforms baseline models on translation tasks and handling the entities.
GRIL: Knowledge Graph Retrieval-Integrated Learning with Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing graph RAGs decouple retrieval and reasoning processes, preventing adaptability . existing graph Raggings depend heavily on ground-truth entities, which are often unavailable in open-domain settings.
Approach: They propose a graph retriever that is trained end-to-end with large-scale graphs . structure and semantic features are encoded via soft tokens and the verbalized graph .
Outcome: The proposed approach improves the performance of large-scale graph retrieval models by grounding it with external knowledge.
Entity-level Factual Consistency of Abstractive Text Summarization (2021.eacl-main)

Copied to clipboard

Challenge: Existing models exhibit entity hallucination, generating names of entities that are not present in the source document.
Approach: They propose to use entity-level factual consistency to improve model quality . they propose to filter the training data to reduce entity hallucination problem .
Outcome: The proposed model can reduce the entity hallucination problem by filtering the training data.
CLAIM: Mitigating Multilingual Object Hallucination in Large Vision-Language Models with Cross-Lingual Attention Intervention (2025.acl-long)

Copied to clipboard

Challenge: Large Vision-Language Models (LVLMs) have impressive multimodal abilities but remain prone to multilingual object hallucination.
Approach: They propose a cross-lingual attention intervention method to mitigate multilingual object hallucination in LVLMs by aligning attention patterns.
Outcome: The proposed method improves 13.56% (up to 30%) on the POPE and 21.75% on the hallucination subsets across languages.
Adaptive Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models require a balance between efficiency and performance.
Approach: They propose a low-rank compression technique that reduces non-essential parameters by decomposing weight matrices into products of two low-ranked matrici.
Outcome: The proposed method outperforms existing pruning and low-rank compression techniques in maintaining model performance at the same compression ratio.
When Is Thinking Enough? Early Exit via Sufficiency Assessment for Efficient Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to early exit reasoning often rely on handcrafted or empirical indicators that are unreliable and impractical.
Approach: They propose a framework that allows LRMs to assess the sufficiency of its chain-of-thought and determine the optimal point for early exit.
Outcome: The proposed framework reduces reasoning length by 28.9%–34.9% with minimal performance loss, effectively mitigating overthinking.
DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation (2020.acl-demos)

Copied to clipboard

Challenge: DIALOGPT is a large, tunable neural conversational response generation model . trained on 147M conversation-like exchanges extracted from Reddit comment chains .
Approach: They present a large, tunable neural conversational response generation model, DIALOGPT . the model is trained on 147M conversation-like exchanges extracted from Reddit comment chains .
Outcome: The proposed model can generate more relevant, contentful and context-consistent responses than baseline systems.
PromptSculptor: Multi-Agent Based Text-to-Image Prompt Optimization (2025.emnlp-demos)

Copied to clipboard

Challenge: PromptSculptor automates the iterative prompt optimization process for Text-to-Image models . previous work focused on generating detailed, high-quality prompts based on user feedback .
Approach: They propose a framework that decomposes a task into four specialized agents . they use Chain-of-Thought reasoning to transform a short, vague user prompt into a comprehensive, refined prompt.
Outcome: The proposed framework significantly improves output quality and reduces iterations needed for user satisfaction.
Image Corruption-Inspired Membership Inference Attacks against Large Vision-Language Models (2026.eacl-long)

Copied to clipboard

Challenge: Large vision-language models (LVLMs) are trained on large-scale datasets, which can pose privacy risks if training images contain sensitive information.
Approach: They propose to detect whether a target image is used to train LVLMs by using image-text pairs and single-modality content to detect image-related data.
Outcome: The proposed methods detect whether a target image is used to train the LVLM on large-scale datasets.
Active Prompting with Chain-of-Thought for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Existing methods to annotate large language models rely on a fixed set of human-annotated exemplars, which are not always the most effective for different tasks.
Approach: They propose a method to adapt large language models to different tasks with task-specific example prompts (annotated with human-designed CoT reasoning) they introduce several metrics to characterize uncertainty so as to select the most uncertain questions for annotation.
Outcome: The proposed method significantly improves performance on eight complex reasoning tasks.
LegalGraphRAG: Multi-Agent Graph Retrieval-Augmented Generation for Reliable Legal Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Graph-based Retrieval-Augmented Generation (GraphRAG) is a new approach to document retrieval, but it is not suitable for legal reasoning.
Approach: They propose a framework for reliable legal reasoning that structures knowledge as relational graphs and uses a multi-agent system to verify validity.
Outcome: The proposed framework outperforms existing GraphRAG models in accurate and trustworthy legal analysis.
MADS: Multi-Agent Dialogue Simulation for Diverse Persuasion Data Generation (2025.emnlp-industry)

Copied to clipboard

Challenge: Recent studies show that LLM-based agents exhibit superior moral and emotional language performance compared to humans, raising expectations for their deployment in persuasive tasks.
Approach: They propose a framework for generating persuasive multi-turn dialogues via agent self-play using user agents designed to simulate diverse persona-driven behaviors, a Dialog Agent executing task-oriented persuasion strategies and an Optimization Agent evaluating and refining dialogue outcomes.
Outcome: The proposed framework significantly improved the persuasion capacity of small LLMs, increasing the organic traffic conversion rate by 22.4% (from 1.83% to 2.24%) .
From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignment (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) show great potential for expressing empathy, but often deliver generic responses that fail to address users’ specific needs.
Approach: They propose a self-evolution framework to help LLMs improve their responses to better align with users’ implicit preferences concerning personality, emotional state, and specific context.
Outcome: The proposed model significantly improves the model's performance in emotional support, reducing unhelpful responses and minimizing discrepancies between user preferences and model outputs.
Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space (2020.emnlp-main)

Copied to clipboard

Challenge: Existing models for language understanding and understanding can be trained to provide contextualized representations of words based on text data.
Approach: They propose a large-scale language VAE model Optimus that is pre-trained on large text corpus and fine-tuned for various language generation and understanding tasks.
Outcome: The proposed model achieves new state-of-the-art on VAE language modeling benchmarks.
Plum: Prompt Learning using Metaheuristics (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in prompt learning have led to a need for general prompt optimization methods.
Approach: They propose a branch of discrete non-convex optimization methods with over 100 options as a promising approach to prompt learning.
Outcome: The proposed methods can be used to discover more human-understandable prompts that were previously unknown in reasoning and image generation tasks.
Reasoning with Language Model Prompting: A Survey (2023.acl-long)

Copied to clipboard

Challenge: Reasoning is an essential ability for complex problem-solving and can provide back-end support for various real-world applications.
Approach: They present cutting-edge research on reasoning with language model prompting and provide systematic resources to help beginners.
Outcome: The proposed approaches have not been systematically reviewed and analyzed.
EssayJudge: A Multi-Granular Benchmark for Assessing Automated Essay Scoring Capabilities of Multimodal Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Automated Essay Scoring (AES) systems face three major challenges: reliance on handcrafted features that limit generalizability, difficulty in capturing fine-grained traits like coherence and argumentation, and inability to handle multimodal contexts.
Approach: They propose a multimodal benchmark to evaluate AES capabilities across lexical-, sentence-, and discourse-level traits without manual feature engineering.
Outcome: The proposed system can evaluate AES capabilities across lexical-, sentence-, and discourse-level traits without manual feature engineering.
Lost in the Source Language: How Large Language Models Evaluate the Quality of Machine Translation (2024.findings-acl)

Copied to clipboard

Challenge: Recent studies have shown that Large Language Models (LLMs) can be used as translation evaluators.
Approach: They propose to use both coarse-grained and fine-grounded prompts to discern the utility of source versus reference data in machine translation evaluation tasks.
Outcome: The proposed model can be used to evaluate translations in multiple languages.
Training Language Model to Critique for Better Refinement (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have remarkable evaluation and critique capabilities, providing insightful feedback and identifying flaws in various tasks.
Approach: They propose a framework to train critic models using refinement signals to generate feedback loops where critiques guide the model in refining its responses.
Outcome: The proposed framework outperforms traditional methods and open-source models in terms of critique quality and refinement outcomes.
RexUIE: A Recursive Method with Explicit Schema Instructor for Universal Information Extraction (2023.findings-emnlp)

Copied to clipboard

Challenge: Named Entity Recognition (NER) and Relation Extraction (RE) models have limited success when extracting general schemas such as quadruples and quintuples.
Approach: They propose a formal formulation that covers almost all extraction schemas and a Recursive Method with Explicit Schema Instructor for UIE.
Outcome: The proposed method shows strong performance under full-shot and few-shot settings and achieves state-of-the-art results on the tasks of extracting complex schemas.
Benchmarking Diverse-Modal Entity Linking with Generative Models (2023.findings-acl)

Copied to clipboard

Challenge: Existing models for diverse-mode entity linking (EL) work well on per modality configurations, but it is more challenging to design a unified model for diverse modality.
Approach: They propose a generative diverse-modal model that integrates text, image and table . they propose combining a multimodal encoder-decoder paradigm with a fine-tuning GDMM .
Outcome: The proposed model outperforms state-of-the-art models by 8.51 F1 on average for diverse-modal EL.
Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods address few-shot intent detection tasks from two perspectives: data augmentation and task-adaptive training with pre-trained models.
Approach: They propose a few-shot intent detection schema using contrastive pre-training and fine-tuning.
Outcome: The proposed method achieves state-of-the-art performance on three challenging intent detection datasets under 5-shot and 10-shot settings.
Don’t Trust ChatGPT when your Question is not in English: A Study of Multilingual Abilities and Types of LLMs (2023.emnlp-main)

Copied to clipboard

Challenge: Existing studies have shown that large language models can perform a wide variety of language tasks when presented in English.
Approach: They propose a method to evaluate the multilingual capabilities of large language models using a prompt back-translation method to find out how LLMs acquire their multilingual abilities.
Outcome: The proposed method shows that large language models can transfer learned knowledge across different languages, but struggle to provide accurate results in translation-variant tasks.
START: Self-taught Reasoner with Tools (2025.emnlp-main)

Copied to clipboard

Challenge: Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in complex reasoning through long chain-of-thought, yet they struggle with precise computations and algorithmic operations.
Approach: They propose a training-free approach that activates LRMs’ latent tool-use capabilities through artificial hints and a framework that enables models to learn effective tool utilization through diverse hint patterns and rejection-based data synthesis.
Outcome: Experiments show that START significantly improves state-of-the-art LRMs across challenging benchmarks, including competition-level mathematics (AMC23: 95.0%, AIME24: 75.6%) and graduate-level science questions (GPQA: 64.6%).
Code Generation From Flowcharts with Texts: A Benchmark Dataset and An Approach (2022.findings-emnlp)

Copied to clipboard

Challenge: Currently, researchers focus on generating codes from requirement documents.
Approach: They propose to generate source code from flowcharts with texts instead of directly translating requirements into codes.
Outcome: The proposed model improves on the baselines by transforming flowcharts into pseudo-code . the proposed model is based on 320 flowchartes with their corresponding source codes .
Improved Pseudo Data for Machine Translation Quality Estimation with Constrained Beam Search (2023.emnlp-main)

Copied to clipboard

Challenge: evaluating the quality of machine translation outputs becomes increasingly essential with the rapid development of machine language (MT).
Approach: They propose to generate pseudo data using the MT model with constrained beam search (CBSQE) they propose to preserve the reference parts with high MT probabilities as correct translations .
Outcome: The proposed model outperforms strong baselines in both supervised and unsupervised settings.
UICOMPASS: UI Map Guided Mobile Task Automation via Adaptive Action Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Mobile task automation is an emerging technology that leverages AI to automatically execute routine tasks by users’ commands on mobile devices like Android.
Approach: They propose a UI Map-guided LLM-based approach to automate mobile tasks using static analysis and LLMs.
Outcome: The proposed approach achieves a 15.87% higher task execution success rate than SOTA approaches even when only APK is available.
Decoding Time Series with LLMs: A Multi-Agent Framework for Cross-Domain Annotation (2026.findings-eacl)

Copied to clipboard

Challenge: Time series data is ubiquitous across various domains, including manufacturing, finance, and healthcare.
Approach: They propose a multi-agent system to generate general and domain-specific annotations for time series data.
Outcome: The proposed system outperforms existing methods on synthetic and real-world datasets.
Distillation with Explanations from Large Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Large language models (LLMs) like ChatGPT and GPT-4 have made remarkable progress in various NLP tasks while also providing explanations alongside their answers.
Approach: They propose to use Large language models (LLMs) to generate more accurate answers and corresponding free-text explanations by combining ground truth labels and answers-explanations generated by LLMs.
Outcome: The proposed method achieves improved predictive performance and generates explanations that exhibit greater alignment with the model’s task outputs.
Improving Low-resource Question Answering by Augmenting Question Information (2023.findings-emnlp)

Copied to clipboard

Challenge: Low-resource questions pose a significant challenge within the field of Question-Answering (QA) tasks.
Approach: They propose a method that leverages large models' internal knowledge to enhance the quality of augmented data by Prompt Answer, Question Generation, and Question Filter.
Outcome: The proposed method outperforms existing augmentation strategies on high-resource QA tasks like SQUAD1.1 and TriviaQA.
Stephanie: Step-by-Step Dialogues for Mimicking Human Interactions in Social Conversations (2025.findings-naacl)

Copied to clipboard

Challenge: a new paradigm for dialogue systems is being developed to mimic human interactions . the current single-step dialogue paradigm lacks the depth and fluidity of human interactions.
Approach: They propose a step-by-step dialogue paradigm that mimics human interactions . they use a dataset to fine-tune existing language models .
Outcome: The proposed system mimics the dynamic nature of human conversations . it is compared with existing paradigms and will be released later this year .
Margin-aware Unsupervised Domain Adaptation for Cross-lingual Text Labeling (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to learn a model from labeled data are expensive or prohibitive.
Approach: They propose an unsupervised domain adaptation algorithm that leverages labeled data in a source domain to learn a well-performing model in . they use the Margin Disparity Discrepancy algorithm to optimize the margin loss on the source domain.
Outcome: The proposed approach improves on a recent theoretical work on cross-lingual document classification and NER by a large margin.
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population (2022.emnlp-demos)

Copied to clipboard

Challenge: Existing knowledge extraction tools are not complete due to emerging entities and relations in real-world applications.
Approach: They propose an open-source knowledge extraction toolkit DeepKE that supports low-resource, document-level and multimodal scenarios in the knowledge base population.
Outcome: The proposed toolkit supports low-resource, document-level and multimodal scenarios in the knowledge base population.
ReSel: N-ary Relation Extraction from Scientific Text and Tables by Learning to Retrieve and Select (2022.emnlp-main)

Copied to clipboard

Challenge: Our proposed method extracts N-ary relation tuples from scientific articles.
Approach: They propose a method that decomposes the task into two stages . they propose modal query and modal entity selection . their results show that ReSel outperforms state-of-the-art baselines significantly .
Outcome: The proposed method outperforms state-of-the-art baselines on three scientific information extraction datasets.
XFormParser: A Simple and Effective Multimodal Multilingual Semi-structured Form Parser (2025.coling-main)

Copied to clipboard

Challenge: Document AI parsing semi-structured image form is a key information extraction task.
Approach: They propose a multimodal and multilingual semi-structured FORM PARSER which integrates SER and relation extraction into a unified framework.
Outcome: The proposed framework achieves up to 1.79% improvement on RE tasks in multilingual and zero-shot settings.
SweetieChat: A Strategy-Enhanced Role-playing Framework for Diverse Scenarios Handling Emotional Support Agent (2025.coling-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated promising potential in providing empathetic support during interactions, but their responses are often verbose or overly formulaic, failing to adequately address the diverse emotional support needs of real-world scenarios.
Approach: They propose a strategy-enhanced role-playing framework that emulates real-world interactions and a dataset that is used to develop an emotional support agent.
Outcome: The proposed framework emulates real-world interactions and promotes a broader range of dialogues and Emotional Support Agent training.
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications.
Approach: They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions.
Outcome: The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions.
FAER: Benchmarking VLMs for Failure-Aware Embodied Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Visual-language models (VLMs) are the core component of embodied agents in perceiving the environment and making decisions.
Approach: They propose a failure-aware benchmark to evaluate the performance of visual language models (VLMs) in long-horizon tasks.
Outcome: The proposed benchmark evaluates the performance of 16 widely utilized VLMs and 4 LLMs for FAER tasks.
Beyond Surface-Level Patterns: An Essence-Driven Defense Framework Against Jailbreak Attacks in LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods focus on surface-level patterns, overlooking the deeper attack essences.
Approach: They propose an Essence-Driven Defense Framework Against Jailbreak Attacks in Aligned Large Language Models that extracts the "attack essence" from a diverse set of known attack instances and stores it in an offline vector database.
Outcome: The proposed framework outperforms existing methods by reducing the Attack Success Rate by at least 20%, underscoring its superior robustness against jailbreak attacks.
RobustQA: Benchmarking the Robustness of Domain Adaptation for Open-Domain Question Answering (2023.findings-acl)

Copied to clipboard

Challenge: Existing ODQA datasets consist mainly of Wikipedia corpus, and are insufficient to study models’ generalizability across diverse domains.
Approach: They propose a benchmark to evaluate ODQA's domain robustness using Wikipedia corpus . they annotate QA pairs in retrieval datasets with rigorous quality control .
Outcome: The proposed benchmark improves model performance on annotated QA pairs in retrieval datasets with rigorous quality control.
AutoPRM: Automating Procedural Supervision for Multi-Step Reasoning via Controllable Question Decomposition (2024.naacl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have shown promise in multi-step reasoning tasks, yet relying on extensive manual labeling to provide procedural feedback remains a significant impediment.
Approach: They propose a self-supervised framework that decomposes complex problems into manageable subquestions with a controllable granularity switch and sequentially applies reinforcement learning to iteratively improve the subquest solver.
Outcome: The proposed framework improves performance on mathematical and commonsense reasoning tasks over SOTA.
Paying More Attention to Source Context: Mitigating Unfaithful Translations from Large Language Model (2024.findings-acl)

Copied to clipboard

Challenge: Large language models lack explicit alignment between source and target contexts, leading to unfaithful translations.
Approach: They propose three learning strategies to encourage LLMs to pay more attention to source context . they use a dataset to test the effectiveness of their model across multiple language pairs .
Outcome: The proposed model reduces hallucinatory translation and improves fidelity across multiple languages.
DPN-LE: Dual Personality Neuron Localization and Editing for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Current methods for editing personality traits in large language models can change personalities but reduce performance.
Approach: They propose a novel paradigm for personality editing that locates and edits LLM neurons and enables competitive personality control at inference time.
Outcome: Experiments on LLaMA-3-8B-Instruct and Qwen2.5-7B-instruct show that the proposed approach can improve performance and improve performance.
MMAU: A Holistic Benchmark of Agent Capabilities Across Diverse Domains (2025.findings-naacl)

Copied to clipboard

Challenge: Existing benchmarks focus on specific application scenarios, emphasizing task completion but failing to dissect the underlying skills that drive these outcomes.
Approach: They propose a Massive Multitask Agent Understanding benchmark that evaluates LLMs across five domains and offline tasks.
Outcome: The Massive Multitask Agent Understanding (MMAU) benchmark evaluates models across five domains including Tool-use, Directed Acyclic Graph (DAG) QA, Data Science and Machine Learning coding, Contest-level programming and Mathematics.
SWE-QA-Pro: A Representative Benchmark and Scalable Training Recipe for Repository-Level Code Understanding (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for agentic repository-level code understanding overlook long tail topics and rely on memorized knowledge.
Approach: They propose a repository-level agentic code understanding benchmark that uses long-tail repositories with executable environments to enforce topical balance.
Outcome: Empirically, a Qwen3-8B model trained with the proposed benchmark outperforms GPT-4o by 2.3 points.
Text Detoxification: Data Efficiency, Semantic Preservation and Model Generalization (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for detoxification of text often rely on manually annotated data . xiangli: "detoxification of texts is a powerful way to remove toxic content"
Approach: They propose a reinforcement learning framework that optimizes detoxification and semantic preservation without annotating large amounts of data.
Outcome: The proposed method overcomes major limitations and surpasses humanannotated references across multiple benchmarks.
MCGA: A Multi-task Classical Chinese Literary Genre Audio Corpus (2026.findings-acl)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) have advanced Chinese Classical Studies (CCS) but the audio dimension of CCS remains underexplored due to a lack of high-quality, domain-specific audio corpora.
Approach: They propose a 119-hour audio corpus comprising 22,000 audio samples to bridge this gap . it encompasses a diverse range of literary genres across six tasks .
Outcome: The proposed corpus encompasses a diverse range of literary genres across six tasks: Automatic Speech Recognition (ASR), Speech-to-Text Translation (S2TT), Speech Emotion Captioning (SEC), Spoken Question Answering ( SQA), Speech Understanding (SU), and Speech Reasoning (SR).
Towards Realistic Low-resource Relation Extraction: A Benchmark with Empirical Baseline Study (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to extract relational facts from text are limited in their ability to learn from limited labeled data.
Approach: They propose to use prompt-based methods with few-shot labeled data to evaluate performance . data augmentation technologies and self-training are also proposed to generate more labeles in-domain data.
Outcome: The proposed methods perform well in low-resource settings with 8 relation extraction datasets.
Omni-I2C: A Holistic Benchmark for High-Fidelity Image-to-Code Generation (2026.acl-long)

Copied to clipboard

Challenge: a benchmark is designed to evaluate the capability of Large Multimodal Models (LMMs) in converting complex, structured digital graphics into executable code.
Approach: They propose a benchmark to evaluate the capability of Large Multimodal Models to convert digital graphics into executable code.
Outcome: The proposed benchmark exposes the performance gap among leading LMMs . the benchmark features 1130 meticulously curated samples .
MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in multimodal large language models have led to progress in tackling complex reasoning tasks that combine textual and visual information.
Approach: They introduce a robust version of the Massive Multi-discipline Multimodal Understanding and Reasoning (MMMU) benchmark.
Outcome: The proposed model performs lower on MMMU-Pro than on the previous benchmark, ranging from 16.8% to 26.9%.
Huatuo-26M, a Large-scale Chinese Medical QA Dataset (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models are a powerful tool for medical research, but the data is a bottleneck.
Approach: They propose to use the largest ever medical Question Answering dataset with 26 Million QA pairs as a fine-tuning data for training large language models.
Outcome: The proposed dataset demonstrates that it can be used to train large language models and improves zero-shot performance on other datasets.
Open Set Relation Extraction via Unknown-Aware Training (2023.acl-long)

Copied to clipboard

Challenge: Existing supervised relation extraction methods can still misclassify unknown relations into known relations due to the lack of supervision signals.
Approach: They propose a method that regularizes the model by dynamically synthesizing negative instances that can provide the missing supervision signals.
Outcome: The proposed method achieves SOTA unknown relation detection without compromising the classification of known relations.
FusionFlow: Enabling Deep Structural Exploration for Automated Agentic Workflow Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing workflow generation methods rely on incremental refinement or tree-based search over a single evolving workflow.
Approach: They propose a framework centered on workflow fusion that synthesizes multiple independently evolved workflows and allows exploration of deeper regions of the workflow space within a finite budget.
Outcome: Experiments show that FusionFlow outperforms existing workflow generation methods on six reasoning benchmarks.
A Query-Response Framework for Whole-Page Complex-Layout Document Image Translation with Relevant Regional Concentration (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for document image translation rely on the vanilla encoder-decoder paradigm . a novel dynamic aggregation mechanism is designed to enhance the text semantics in query features toward translation.
Approach: They propose a Query-Response DIT framework that reformulates the DIT task into a parallel response/translation process of multiple queries.
Outcome: The proposed framework improves translation quality on four translation directions on three benchmarks.
MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria (2025.naacl-long)

Copied to clipboard

Challenge: Existing evaluation methodologies for multimodal large language models are limited in evaluating objective queries without considering real-world user experiences.
Approach: They propose to evaluate multimodal large language models with per-sample criteria using potent MLLM as the judge.
Outcome: The proposed evaluation paradigm shows that it can be used to evaluate multimodal large language models with per-sample criteria.
Multi-Modal Entities Matter: Benchmarking Multi-Modal Entity Alignment (2025.coling-main)

Copied to clipboard

Challenge: Existing MMEA datasets consider multi-modal data as attributes of textual entities, neglecting correlations between the multi-modal data.
Approach: They propose a multi-modal entity alignment dataset that models multi-dimensional data as textual entities in the MMKG.
Outcome: The proposed dataset can learn the structural information of entities by considering both intra-modal and cross-modal relations and infer the similarity of different types of entity pairs.
Looking Beyond Label Noise: Shifted Label Distribution Matters in Distantly Supervised Relation Extraction (D19-1)

Copied to clipboard

Challenge: Existing studies on DS-based relation extraction (RE) methods focus on handling label noise, but other factors may have been overlooked.
Approach: They propose a method to automatically adjust DS-RE models to a shifted label distribution problem . they find this problem exists in real-world DS datasets and can be overcome .
Outcome: The proposed method achieves consistent performance gains on DS-trained models with an up to 23% relative F1 improvement, which verifies their assumptions.
Improved Policy Optimization for Mixture-of-Experts Models: Importance Sampling and Rewarding from an Expert-Centric Perspective (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to reinforcement learning (RL) suffer from training instability . existing approaches often ignore token-specific discrepancies in expert assignments .
Approach: They propose to introduce expert-level importance sampling to reduce complexity of RL . they propose to leverage expert-centric granularity to ensure a rigorous alignment between reward signals and policy updates.
Outcome: The proposed method outperforms strong baselines across reasoning tasks.
Learning Contextualized Knowledge Structures for Commonsense Reasoning (2021.findings-acl)

Copied to clipboard

Challenge: Recent knowledge graph (KG) augmented models have achieved notable success on commonsense reasoning tasks.
Approach: They propose a KG-augmented model that contextualizes extracted and generated knowledge by reasoning over both within a single graph structure.
Outcome: The proposed model outperforms existing models on four commonsense reasoning benchmarks and a user study on edge validness and helpfulness.
Exploring All-In-One Knowledge Distillation Framework for Neural Machine Translation (2023.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge distillation methods only obtain one lightweight student each time . this could be resource-intensive and resulting in multiple students not being optimally utilized .
Approach: They propose a knowledge distillation framework which generates multiple satisfactory students at once.
Outcome: The proposed framework generates multiple satisfactory students at once.
Filter-And-Refine: A MLLM Based Cascade System for Industrial-Scale Video Content Moderation (2025.acl-industry)

Copied to clipboard

Challenge: Effective content moderation is essential for video platforms to safeguard user experience and uphold community standards.
Approach: They propose a method to transform a generative MLLM into a multimodal classifier using minimal discriminative training data.
Outcome: The proposed method improves F1 score by 66.50% over traditional classifiers while requiring only 2% of the fine-tuning data.
Single-to-mix Modality Alignment with Multimodal Large Language Model for Document Image Machine Translation (2025.acl-long)

Copied to clipboard

Challenge: Document Image Machine Translation (DIMT) faces generalization challenges due to limited training data and the complex interplay between visual and textual information.
Approach: They propose a single-to-mix Modality alignment framework leveraging Multimodal Large Language Models (MLLMs) this framework aligns an imageonly encoder with multimodal representations of an MLLM pre-trained on large-scale document image datasets.
Outcome: The proposed framework improves translation quality in cross-domain generalization and challenging document image scenarios.
DUAL-REFLECT: Enhancing Large Language Models for Reflective Translation through Dual Learning Feedback Mechanisms (2024.acl-short)

Copied to clipboard

Challenge: Existing self-reflection methods lack effective feedback information, limiting the translation performance of large language models (LLMs).
Approach: They propose a framework that leverages the dual learning of translation tasks to provide effective feedback, thereby enhancing the models’ self-reflective abilities and improving translation performance.
Outcome: The proposed framework improves the models’ self-reflective abilities and improves translation accuracy and eliminating ambiguities across translation tasks.
Exploring Continual Learning for Code Generation Models (2023.acl-short)

Copied to clipboard

Challenge: Large-scale code generation models such as Copilot and CodeT5 are expensive to train and re-train.
Approach: They propose a benchmark for Continual Learning (CL) that covers a wide range of tasks with different input and output programming languages.
Outcome: The proposed method improves on Prompt Pooling with Teacher Forcing, which suffers catastrophic forgetting due to stark distribution shifts in coding tasks.
Document Image Machine Translation with Dynamic Multi-pre-trained Models Assembling (2024.naacl-long)

Copied to clipboard

Challenge: Existing TIMT tasks focus on text-line-level images.
Approach: They propose to extend the existing TIMT task and introduce a new framework to translate a source document image to markdown-formatted target translation.
Outcome: The proposed task aims to translate a source document image with long context and complex layout structure to markdown-formatted target translation.
Learning “O” Helps for Learning More: Handling the Unlabeled Entity Problem for Class-incremental NER (2023.acl-long)

Copied to clipboard

Challenge: Existing Named Entity Recognition systems are typically trained on a large-scale dataset with predefined entity classes, then deployed for entity recognition on the test data without further adaptation or refinement.
Approach: They propose a representation learning method that adaptively detects entity clusters in "O" and two effective distance-based relabeling strategies for better learning the old classes.
Outcome: The proposed method achieves 10.62% improvement over the baseline methods.
Enhancing the General Agent Capabilities of Low-Paramter LLMs through Tuning and Multi-Branch Reasoning (2024.findings-naacl)

Copied to clipboard

Challenge: Open-source pre-trained Large Language Models exhibit strong language understanding and generation capabilities, making them highly successful in a variety of tasks.
Approach: They propose a method to construct agent-specific data using GPT-4 and supervised fine-tuning . they find that supervised tunning can significantly reduce hallucination outputs and formatting errors in agent tasks .
Outcome: The proposed method improves on five agent tasks of AgentBench.
COUGH: A Challenge Dataset and Models for COVID-19 FAQ Retrieval (2021.emnlp-main)

Copied to clipboard

Challenge: 16K FAQ items scraped from 55 credible websites . 32 human-annotated FAQ items for each query.
Approach: They present a large, challenging dataset for FAQ retrieval for COVID-19 . they use a FAQ bank, Query Bank and Relevance Set to evaluate the dataset .
Outcome: The proposed model achieves 48.8 under P@5 and is compared with other datasets.
FaD-VLP: Fashion Vision-and-Language Pre-training towards Unified Retrieval and Captioning (2022.emnlp-main)

Copied to clipboard

Challenge: Prior work on multimodal fashion tasks has been limited by the data in individual benchmarks or has leveraged generic vision-and-language pre-training but have not taken advantage of the characteristics of fashion data.
Approach: They propose a fashion-specific pre-training framework based on weakly-supervised triplets constructed from fashion image-text pairs.
Outcome: The proposed framework is based on weakly-supervised triplets constructed from fashion image-text pairs and is competitive on a diverse set of fashion tasks.
Dialogue Response Ranking Training with Large-Scale Human Feedback Data (2020.emnlp-main)

Copied to clipboard

Challenge: Existing open-domain dialog models can minimize the perplexity of target human responses . however, some human responses are more engaging than others, spawning more followup interactions .
Approach: They train open-domain dialog models to minimize perplexity of target human responses . they use social media feedback data to train models to predict engaging dialog turns .
Outcome: The proposed model outperforms existing models on 133M human feedback pairs . it also outperformed the conventional dialog perplexity baseline model .
CSDS: A Fine-Grained Chinese Dataset for Customer Service Dialogue Summarization (2021.emnlp-main)

Copied to clipboard

Challenge: Existing summarization methods are prone to generate redundant and incoherent summaries, causing the performance to be worse.
Approach: They propose a Chinese dataset for Customer Service Dialogue Summarization (CSDS) that provides role-oriented summaries to acquire different speakers' viewpoints.
Outcome: The proposed dataset improves the abstractive summaries in two aspects . it also provides role-oriented summary to acquire different speakers’ viewpoints .
AutoAlign: Get Your LLM Aligned with Minimal Annotations (2025.acl-demo)

Copied to clipboard

Challenge: Automated Alignment (ALM) is a set of algorithms designed to align Large Language Models (LLMs) with human intentions and values while minimizing manual intervention.
Approach: They propose an open-source toolkit that integrates mainstream automated algorithms through a consistent interface and an accessible workflow supporting one-click execution for prompt synthesis and automatic alignment signal construction.
Outcome: The proposed framework enables easy reproduction of existing results through extensive benchmarks and facilitates the development of novel approaches via modular components.
STAF: Pushing the Boundaries of Test-Time Adaptation towards Practical Noise Scenarios (2024.lrec-main)

Copied to clipboard

Challenge: Pre-trained language models have demonstrated superior performance on NLP tasks . however, when the training domain and testing domain are taken from different distributions, the deployed model often violates this assumption.
Approach: They propose a Stable Test-time Adaptation Framework to stabilize the adaptation process.
Outcome: The proposed framework boosts model robustness to noise distribution shifts while minimizing error accumulation and catastrophic forgetting.
Retrospex: Language Agent Meets Offline Reinforcement Learning Critic (2024.emnlp-main)

Copied to clipboard

Challenge: Existing LLM agent frameworks do not fully utilize past experiences for improvement.
Approach: They propose a LLM-based agent framework called Retrospex that analyzes past experiences in depth to improve existing agent frameworks.
Outcome: The proposed framework analyzes past experiences in ScienceWorld, ALFWorld and Webshop environments, demonstrating its advantages over baselines.
Exploring Chain of Thought Style Prompting for Text-to-SQL (2023.emnlp-main)

Copied to clipboard

Challenge: In-context learning with large language models (LLMs) has recently caught increasing attention due to its superior few-shot performance on various tasks.
Approach: They propose a new chain of thought prompting method that enhances LLMs’ reasoning ability through chain of thinking prompting, including the original chain-of-thought prompting and least-to-most prompting.
Outcome: The proposed method brings 5.2 and 6.5 point absolute gains on the Spider development set and the Spider Realistic set, respectively, compared to the standard prompting method without reasoning steps; 2.4 and 1.5 point absolute gain, versus the least-to-most prompting.
WebQuality: A Large-scale Multi-modal Web Page Quality Assessment Dataset with Multiple Scoring Dimensions (2025.naacl-long)

Copied to clipboard

Challenge: Existing studies on web page quality assessment neglect the aspect of web page content.
Approach: They propose a Chinese dataset for web page quality assessment . the dataset includes over 65,000 detailed an-notations spanning four sub-dimensions .
Outcome: The proposed dataset includes over 65,000 detailed an-notations spanning four sub-dimensions and incorporates elements such as HTML+CSS, text, and visual screenshot.
Don’t Be Misled by Style: A Style-Adaptive Reranker for Capturing Effective Knowledge in Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing rerankers are mainly trained on well-edited texts, but stylistic features can be misled by reranked models.
Approach: They propose a style-augmented multi-task framework that prioritizes effective knowledge over stylistic perturbations by using an LLM to derive passage-level supervision on whether a passage helps or harms answer correctness.
Outcome: Extensive experiments show that SARK improves generation performance across multiple LLMs under mixed-style conditions.
Temporal Knowledge Question Answering via Abstract Reasoning Induction (2024.acl-long)

Copied to clipboard

Challenge: a new method to enhance temporal knowledge reasoning in large language models addresses this challenge . Abstract Reasoning Induction (ARI) framework provides factual knowledge support to LLMs .
Approach: They propose an abstract reasoning induction framework which divides temporal reasoning into two phases: Knowledge agnostic and Knowledge-based.
Outcome: The proposed method achieves significant gains on two temporal QA datasets.
Multi-level Relevance Document Identifier Learning for Generative Retrieval (2025.acl-long)

Copied to clipboard

Challenge: Existing methods generate DocIDs based on textual content, which may result in weak semantic connections for similar documents due to variations in expression.
Approach: They propose a new retrieval paradigm that generates unique document identifiers . they propose to use queries as a bridge to connect documents with varying relevance levels .
Outcome: The proposed approach outperforms existing methods on multilingual e-commerce search datasets.
Supporting Clustering with Contrastive Learning (2021.naacl-main)

Copied to clipboard

Challenge: Unsupervised clustering aims at discovering the semantic categories of data according to some distance measured in the representation space, but different categories overlap with each other at the beginning of the learning process.
Approach: They propose a framework to leverage contrastive learning to promote better separation between different categories by optimizing a clustering objective defined in the representation space.
Outcome: The proposed framework improves state-of-the-art accuracy and normalized mutual information on short text clustering and combines top-down and bottom-up instance discrimination to achieve better distances.
CMB: A Comprehensive Medical Benchmark in Chinese (2024.naacl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) provide a great breakthrough in medicine, says a new study . existing studies on LLMs leverage subjective evaluation, but evaluation in medicine is professional .
Approach: They propose a localized medical benchmark in Chinese rooted in native Chinese . they propose to use traditional Chinese medicine to evaluate large-scale LLMs .
Outcome: a new benchmark is developed to evaluate large-scale LLMs in china . the proposed model is rooted in the native Chinese linguistic and cultural framework .
Gradient-Attention Guided Dual-Masking Synergetic Framework for Robust Text-based Person Retrieval (2025.emnlp-main)

Copied to clipboard

Challenge: a large-scale visionlanguage pre-training framework is limited by the scarcity of large-sized annotated vision-language data . noise-resistant data construction pipeline is needed to filter and caption web-sourced images . noisy text tokens can be a problem for fine-grained representation learning .
Approach: They develop a noise-resistant data construction pipeline that leverages in-context learning capabilities of MLLMs to automatically filter and caption web-sourced images.
Outcome: The proposed framework improves cross-modal alignment by masking noisy textual tokens based on the gradient-attention similarity score.
Improving the Adversarial Robustness of NLP Models by Information Bottleneck (2022.findings-acl)

Copied to clipboard

Challenge: Existing studies have shown that adversarial examples can be directly attributed to the presence of non-robust features.
Approach: They propose to capture task-specific robust features while eliminating non-robust ones . they show that models can achieve significant improvement in robust accuracy .
Outcome: The proposed method outperforms all defense methods on SST-2, AGNEWS and IMDB datasets while achieving no performance drop.
OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have significantly enhanced the generative capabilities for various NLP tasks, but they still suffer from hallucinations due to their exclusive reliance on parametric knowledge.
Approach: They propose a framework that integrates retrieval tokens generated autoregressively into a single LLM to handle both tasks simultaneously in a unified forward pass.
Outcome: The proposed framework bridges the traditionally separate training approaches for generation and retrieval by incorporating retrieval tokens generated autoregressively.
Can VLMs Actually See and Read? A Survey on Modality Collapse in Vision-Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Vision-language models integrate textual and visual information, enabling them to process visual inputs and generate predictions.
Approach: They review work on modality collapse analysis to provide insights into the reason for this unintended behavior and review probing studies for fine-grained vision-language understanding.
Outcome: The proposed models can achieve competitive performance in vision-language tasks despite relying heavily on textual information and ignoring visual information.
Rotation Control Unlearning: Quantifying and Controlling Continuous Unlearning for LLM with The Cognitive Rotation Space (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to remove undesirable data from Large Language Models suffer from cumulative catastrophic utility loss under continuous unlearning requests.
Approach: They propose a method that leverages the rotational salience weight of RCU to quantify and control the unlearning degree in the continuous unlearning process.
Outcome: The proposed method achieves SOTA performance without a retained dataset.
Boosting LLM’s Molecular Structure Elucidation with Knowledge Enhanced Tree Search Reasoning (2025.acl-long)

Copied to clipboard

Challenge: Molecular structure elucidation involves deducing a molecule’s structure from various types of spectral data, which is crucial in chemical experimental analysis.
Approach: They propose a Knowledge-enhanced reasoning framework for Molecular Structure Elucidation that leverages Monte Carlo Tree Search for test-time scaling as a plugin to extend the LLMs’ coverage of the chemical structure space.
Outcome: The proposed framework significantly improves on both GPT-4o-mini and GPT4o, and a specialized molecule-spectrum scorer improves performance.
Perovskite-LLM: Knowledge-Enhanced Large Language Models for Perovskite Solar Cell Research (2025.findings-emnlp)

Copied to clipboard

Challenge: a rapid advancement of perovskite solar cells has led to an exponential growth in research publications.
Approach: They propose a knowledge-enhanced system for perovskite solar cells that integrates three key components.
Outcome: The proposed system outperforms existing models in domain-specific knowledge retrieval and scientific reasoning tasks.
Automatic Evaluation of Attribution by Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Generative large language models (LLMs) incorporate external references to generate and support claims. however, evaluating the attribution remains an open problem.
Approach: They investigate automatic evaluation of attribution given by large language models . they define different types of attributed errors and then explore two approaches .
Outcome: The proposed methods highlight promising signals and challenges.
FARSS: Fisher-Optimized Adaptive Low-Rank and Singular-Vector Selection for Knowledge-Preserving Fine-Tuning (2026.findings-acl)

Copied to clipboard

Challenge: Low-rank adaptation methods for large language models have limitations in preserving world knowledge and limiting updates to preserve world knowledge.
Approach: They propose a Fisher-optimized adaptive low Rank and Singular-VectorSelection framework for knowledge-preserving fine-tuning that allows efficient and task-sensitive updates.
Outcome: The proposed framework outperforms existing methods for knowledge-preserving fine-tuning.
NesTools: A Dataset for Evaluating Nested Tool Learning Abilities of Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Existing benchmarks on nested tool learning are lacking relevant data instances.
Approach: They propose a method to construct large-scale nested tool calls with different nesting structures using a large-quality dataset.
Outcome: The proposed method can be used to evaluate the nested tool learning abilities of large language models (LLMs) in real-world applications.
Other Roles Matter! Enhancing Role-Oriented Dialogue Summarization via Role Interactions (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for role-oriented dialogue summarization ignore information from other roles, resulting in omitted information.
Approach: They propose a novel method that uses cross attention and decoder self-attention interactions to acquire other roles' critical information.
Outcome: The proposed method significantly outperforms baselines on two public role-oriented dialogue summarization datasets.
Noise Learning for Text Classification: A Benchmark (2022.coling-1)

Copied to clipboard

Challenge: Existing noise learning methods for text classification are underdeveloped . authors propose a noise learning benchmark for text classification .
Approach: They propose to use four state-of-the-art methods of noise learning from the image domain to classify text.
Outcome: The proposed benchmark of noise learning for text classification is based on four methods and five noise modes.
Improving Factual Consistency of Abstractive Summarization via Question Answering (2021.acl-long)

Copied to clipboard

Challenge: Recent studies show that about 30% of summaries generated by neural text summarization suffer from fact fabrication.
Approach: They propose an automatic evaluation metric to measure factual consistency and a learning algorithm that maximizes the metric during model training.
Outcome: The proposed method improves factual consistency and overall quality of summarization models.
Exploring Better Text Image Translation with Multimodal Codebook (2023.acl-long)

Copied to clipboard

Challenge: Current studies on text image translation face bottlenecks due to lack of a publicly available dataset and poor optical character recognition.
Approach: They propose a text image translation model with a multimodal codebook and an OCR dataset for Chinese-English translation.
Outcome: The proposed model can associate the image with relevant texts, providing useful supplementary information for translation.
Doc-V*: Coarse-to-Fine Interactive Visual Reasoning for Multi-Page Document VQA (2026.acl-long)

Copied to clipboard

Challenge: Existing OCR-free approaches to document visual question answering are brittle and passive.
Approach: They propose an OCR-free agentic framework that casts multi-page DocVQA as sequential evidence aggregation.
Outcome: The proposed framework outperforms open-source and proprietary models in five benchmarks and improves out-of-domain performance by 47.9% over baseline.
InstructProtein: Aligning Human and Protein Language via Knowledge Instruction (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are a promising new approach to understanding biological sequences such as proteins.
Approach: They propose an LLM that can generate protein sequences in human and protein languages by pre-training an Lm on protein and natural language corpora and supervised instruction tuning to facilitate alignment.
Outcome: The proposed model outperforms state-of-the-art LLMs on protein-text generation tasks by a large margin.
SPUQ: Perturbation-Based Uncertainty Quantification for Large Language Models (2024.eacl-long)

Copied to clipboard

Challenge: Large language models have a tendency to make confidently wrong predictions, highlighting the need for uncertainty quantification (UQ) . previous studies focused on aleatoric uncertainty, but the full spectrum of uncertainties, including epistemic, remains inadequately explored.
Approach: They propose a method to quantify uncertainty in large language models (LLMs) they use a set of perturbations and an aggregation module to generalize the method.
Outcome: The proposed method improves model uncertainty calibration and reduces expected calibration error by 50% on average.
Neural Coreference Resolution with Deep Biaffine Attention by Joint Mention Detection and Mention Clustering (P18-2)

Copied to clipboard

Challenge: Existing methods for identifying and clustering mentions in text are complex and require heuristics to solve.
Approach: They propose to use a biaffine attention model to get antecedent scores for each possible mention and optimize mention detection and mention clustering accuracy given the mention cluster labels.
Outcome: The proposed model achieves the state-of-the-art performance on the CoNLL-2012 shared task English test set.
QueryAgent: A Reliable and Efficient Reasoning Framework with Environmental Feedback based Self-Correction (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for semantic parsing fail when hallucinations are encountered . QueryAgent solves a question step-by-step and performs stepwise self-correction .
Approach: They propose a framework that solves a query step-by-step and performs stepwise self-correction.
Outcome: The proposed framework outperforms existing methods on GrailQA and GraphQ by 5.7 and 15.0 points.
Improving MLLM’s Document Image Machine Translation via Synchronously Self-reviewing Its OCR Proficiency (2025.findings-acl)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) have shown strong performance in document image tasks, especially Optical Character Recognition (OCR). However, they struggle with Document Image Machine Translation (DIMT), which requires handling both cross-modal and cross-lingual challenges.
Approach: They propose a novel fine-tuning paradigm that allows the model to generate OCR text before producing translation text, which allows it to leverage its strong monolingual OCR ability while learning to translate text across languages.
Outcome: The proposed model can leverage its strong monolingual OCR ability while learning to translate text across languages.
Complicate Then Simplify: A Novel Way to Explore Pre-trained Models for Text Classification (2022.coling-1)

Copied to clipboard

Challenge: Existing frameworks for text classification employing pre-trained models are constrained by the difficulty of the task.
Approach: They propose a framework which implements a two-stage training strategy to fully exploit the knowledge in pre-trained models.
Outcome: The proposed framework outperforms state-of-the-art classification models on six text classification corpora.
AceGPT, Localizing Large Language Models in Arabic (2024.naacl-long)

Copied to clipboard

Challenge: Significant concerns emerge when addressing cultural sensitivity and local values.
Approach: They propose a localized Large Language Model (LLM) specifically for Arabic, a language imbued with unique cultural characteristics inadequately addressed by current mainstream models.
Outcome: The proposed model sets the state-of-the-art standard for open Arabic LLMs across various benchmarks.
Theorem-Validated Reverse Chain-of-Thought Problem Generation for Geometric Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for generating geometric reasoning data through Chain-of-Thought (CoT) frameworks face three fundamental limitations: 1) lack of high-quality annotations and domain-specific expertise to ensure theorem-grounded diagrams. 2) lack of a coherent model; 3) lack of coherent model.
Approach: They propose a two-stage Theorem-Validated Reverse Chain-of-Thought Reasoning Synthesis framework that synthesizes theorematic diagrams with structured descriptions and properties.
Outcome: The proposed framework expands theorem-type coverage, corrects misunderstandings, and enhances geometric reasoning.
SKIntern: Internalizing Symbolic Knowledge for Distilling Better CoT Capabilities into Small Language Models (2025.coling-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have high computational costs and privacy concerns due to their high computational expenses and data privacy.
Approach: They propose a method that empowers SLMs to internalize symbolic knowledge and few-shot examples gradually through a progressive fine-tuning process.
Outcome: The proposed approach outperforms state-of-the-art baselines by over 5% while reducing inference costs by up to 4 across a wide range of SLMs in both in-domain (ID) and out-of domain (OOD) tasks.
ContraCLM: Contrastive Learning For Causal Language Model (2023.acl-long)

Copied to clipboard

Challenge: Existing studies show that causal language models lack expressiveness due to poor discrimination ability.
Approach: They propose a contrastive learning framework that enhances discrimination of representations and bridges the gap with encoder-only models.
Outcome: The proposed framework improves discrimination and source code generation capabilities on a variety of downstream tasks.
Noise Robust Named Entity Understanding for Voice Assistants (2021.naacl-industry)

Copied to clipboard

Challenge: Named Entity Recognition and Entity Linking are challenging for voice assistants . utterances are relatively short, so there is not much context to help disambiguate .
Approach: They propose a Named Entity Understanding system that combines NER and EL in a joint reranking module.
Outcome: The proposed framework improves NER accuracy by up to 3.13% and EL accuracy by 3.6% in F1 score . it also leads to better accuracies in other natural language understanding tasks .
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems (2020.acl-demos)

Copied to clipboard

Challenge: ConvLab-2 inherits Convlab's framework but integrates more powerful dialogue models and supports more datasets.
Approach: They present ConvLab-2, an open-source toolkit that enables researchers to build task-oriented dialogue systems with state-of-the-art models and perform an end-to-end evaluation.
Outcome: The new tool inherits ConvLab's framework and extends it by integrating many recently proposed state-of-the-art dialogue models.
Bridging the Gap Between BabelNet and HowNet: Unsupervised Sense Alignment and Sememe Prediction (2023.eacl-main)

Copied to clipboard

Challenge: Sememes are the minimum semantic units of natural languages, but their use is limited by a lack of available sememe knowledge bases.
Approach: They propose to use sense alignment to connect BabelNet with HowNet by relaxing constraints until a complete alignment is achieved.
Outcome: The proposed method improves on previous supervised methods by 12% . it is based on interpretable propagation of sememe information between lexical resources .
Layer-wise Model Pruning based on Mutual Information (2021.emnlp-main)

Copied to clipboard

Challenge: In spite of impressive results of neural networks, the huge model size has hindered their applications in cases where computation and memory resources are limited.
Approach: They propose a method for layer-wise pruning using mutual information based feature selection in SVMs and logistic regression.
Outcome: The proposed pruning strategy offers greater speedup and higher performance than weight-based pruning methods.
A Two-Step Approach for Implicit Event Argument Detection (2020.acl-main)

Copied to clipboard

Challenge: et al., 2015) only consider local arguments in the same sentence of the event trigger.
Approach: They propose to decompose the implicit event argument detection task into two sub-problems . they propose to use argument head-word detection and head-to-span expansion to reduce the number of candidates.
Outcome: The proposed model achieves better performance than a strong sequence labeling baseline.
Structuring Latent Spaces for Stylized Response Generation (D19-1)

Copied to clipboard

Challenge: Existing methods for generating responses in a targeted style are limited by the lack of parallel data.
Approach: They propose a method that bridges conversation modeling and non-parallel style transfer by sharing a structured latent space.
Outcome: The proposed system generates responses of the targeted style and outperforms baselines without sacrificing appropriateness.
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora (2022.naacl-main)

Copied to clipboard

Challenge: Pretrained language models are typically learned over a large, static corpus and fine-tuned for various downstream tasks.
Approach: They propose to continuously update a pretrained language model to adapt to emerging data and to keep track of the model's performance.
Outcome: The proposed model can adapt to new corpora while retaining knowledge in earlier domains.
Takin-VC: Expressive Zero-Shot Voice Conversion via Adaptive Hybrid Content Encoding and Enhanced Timbre Modeling (2025.acl-long)

Copied to clipboard

Challenge: Expressive zero-shot voice conversion (VC) aims to modify source timbre to match unseen speaker . existing zero- shot VC systems struggle to reproduce paralinguistic information in highly expressive speech .
Approach: They propose a framework for expressive zero-shot voice conversion that uses hybrid content encoding and memory-augmented context-aware timbre modeling.
Outcome: The proposed framework surpasses state-of-the-art VC systems in speech naturalness, speaker similarity, and speaker similarness.
Universal Prompt Optimizer for Safe Text-to-Image Generation (2024.naacl-long)

Copied to clipboard

Challenge: Existing studies based on image checker, model fine-tuning and embedding blocking are impractical in real-world applications.
Approach: They propose a novel reward function measuring toxicity and text alignment of generated images and train the optimizer through Proximal Policy Optimization.
Outcome: The proposed model reduces the likelihood of various models in generating inappropriate images, with no significant impact on text alignment.
Field Embedding: A Unified Grain-Based Framework for Word Representation (2021.naacl-main)

Copied to clipboard

Challenge: Current methods focus on learning word embeddings while linguistic information is discarded after the learning.
Approach: They propose a framework field embedding to jointly learn word and grain embedds by incorporating morphological, phonetic, and syntactical linguistic fields.
Outcome: The proposed framework integrates morphological, phonetic, and syntactical linguistic fields to learn word embeddings and grain embedds.
Beyond Superficial Tests: Adversarial Refinement for Reliable Property-Based Testing (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable proficiency in code generation, yet their application to Property-Based Testing (PBT) remains fraught with a superficiality gap.
Approach: They propose an agentic framework that hardens software properties through Adversarial Refinement.
Outcome: a new framework hardens software properties through Adversarial Refinement that detects and fixes bugs in top-tier libraries.
Incorporating a Local Translation Mechanism into Non-autoregressive Translation (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods to capture local dependencies among output tokens are not efficient, causing errors of repeated translation.
Approach: They propose a local autoregressive translation mechanism that predicts a short sequence of tokens for each target decoding position instead of one token.
Outcome: Empirical results show that the proposed method achieves comparable or better performance with fewer decoding iterations, bringing a 2.5x speedup.
FormNetV2: Multimodal Graph Contrastive Learning for Form Document Information Extraction (2023.acl-long)

Copied to clipboard

Challenge: Existing approaches that extend the mask language modeling to other modalities require careful multi-task tuning, complex reconstruction target designs, or additional pre-training data.
Approach: They propose a centralized multimodal graph contrastive learning strategy to unify self-supervised pre-training for all modalities in one loss.
Outcome: The proposed model achieves state-of-the-art performance on FUNSD, CORD, SROIE and Payment benchmarks with a more compact model size.
DLM: A Decoupled Learning Model for Long-tailed Polyphone Disambiguation in Mandarin (2024.naacl-long)

Copied to clipboard

Challenge: Grapheme-to-phoneme conversion datasets suffer from the long-tail problem . context learning for polyphonic characters often stems from a single dimension .
Approach: They propose a model for long-tailed polyphone disambiguation in Mandarin that decouples representation and classification learnings.
Outcome: The proposed model can decouple representation and classification learnings . it achieves transition learning of context from local to global .
Faster and Better LLMs via Latency-Aware Test-Time Scaling (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing research has overlooked the efficiency of TTS from a latency-sensitive perspective.
Approach: They propose two approaches to achieve latency-optimal TTS by branch-wise parallelism and sequence-wise parallelism.
Outcome: The proposed approach achieves latency-optimal TTS for large models . branch-wise parallelism and sequence-wise parallelism are key approaches .
Sentence Similarity Based on Contexts (2022.tacl-1)

Copied to clipboard

Challenge: Existing methods to measure sentence similarity face limited dataset size and training-test gap . existing methods lack large-scale labeled datasets with labeles that are labor-intensive and expensive .
Approach: They propose a framework that measures sentence similarity by comparing probabilities of generating two sentences given the same context.
Outcome: The proposed framework achieves significant performance boosts over baselines under supervised and unsupervised settings.
From Chaotic OCR Words to Coherent Document: A Fine-to-Coarse Zoom-Out Network for Complex-Layout Document Image Translation (2025.coling-main)

Copied to clipboard

Challenge: Document Image Translation (DIT) aims to translate documents in images from one language to another.
Approach: They propose a novel end-to-end network called Zoom-out DIT to improve document translation by combining word positioning, sentence recognition and document organization.
Outcome: The proposed network improves word positioning, sentence recognition and document organization, and improves translation quality.
KQA Pro: A Dataset with Explicit Compositional Programs for Complex Question Answering over Knowledge Base (2022.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for Complex KBQA lack compositional reasoning capabilities . Existing methods for Complex questions are poor in diversity or scale .
Approach: They propose a compositional programming language to represent the reasoning process of complex questions.
Outcome: The proposed dataset includes around 120K diverse natural language questions . it provides a compositional and interpretable programming language to represent the reasoning process of complex questions based on the proposed model .
Pairwise Supervised Contrastive Learning of Sentence Representations (2021.emnlp-main)

Copied to clipboard

Challenge: Recent efforts to improve sentence representation learning have a common weakness . siamese or triplet loss only learns from individual sentence pairs or tripletes .
Approach: They propose a discrimination-based approach to bridge entailment and contradiction understanding with categorical concept encoding.
Outcome: The proposed method outperforms the state-of-the-art method on downstream tasks . it improves 10%–13% on clustering tasks and 5%–6% on STS tasks compared with the previous method .
TableLlama: Towards Open Large Generalist Models for Tables (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods for interpreting, augmenting, and querying semi-structured tables require pretraining on tables or special model architecture design.
Approach: They construct a dataset with a variety of tables and tasks for instruction tuning and evaluating LLMs.
Outcome: The proposed model achieves comparable or better performance on 7 out of 8 in-domain tasks compared with the base model on 6 out-of-domain datasets.
EFSA: Towards Event-Level Financial Sentiment Analysis (2024.acl-long)

Copied to clipboard

Challenge: a large-scale Chinese dataset contains 12,160 news articles and 13,725 quintuples . a four-hop Chain-of-Thought LLM-based approach is devised for this task .
Approach: They propose to extend financial sentiment analysis to event-level since events usually serve as the subject of the sentiment in financial text.
Outcome: The proposed method can reach the current state-of-the-art on a large-scale Chinese dataset.
AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation (2023.acl-long)

Copied to clipboard

Challenge: Existing models for speech-to-speech translation suffer from distinct degradation in noisy environments and fail to translate visual speech.
Approach: They propose a text-based audio-visual speech-to-speech translation model that integrates visual information with audio-only data to improve system robustness.
Outcome: The proposed model outperforms models trained on audio-only corpus in two languages . it also improves with low-resource audio-visual data, compared with baselines .
CLLE: A Benchmark for Continual Language Learning Evaluation in Multilingual Machine Translation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks for Continual Language Learning (CLL) are limited due to the complexity of the task and the lack of unified benchmarks.
Approach: They propose a Continual Language Learning Evaluation benchmark CLLE in multilingual translation.
Outcome: The proposed method is effective when compared with other strong benchmarks.
Posterior-regularized REINFORCE for Instance Selection in Distant Supervision (N19-1)

Copied to clipboard

Challenge: Existing methods to train unbiased methods such as REINFORCE take time to train.
Approach: They propose to use posterior regularization to integrate domain-specific rules in instance selection using REINFORCE to improve the performance of the relation classifier trained on cleaned distant supervision datasets.
Outcome: The proposed method improves the performance of the relation classifier trained on cleaned distant supervision dataset as well as the efficiency of the REINFORCE training.
AdaNSP: Uncertainty-driven Adaptive Decoding in Neural Semantic Parsing (P19-1)

Copied to clipboard

Challenge: Semantic parsing (SP) maps a natural language utterance into a formal language . standard Seq2Seq models ignore underlying grammars and may give ill-formed results.
Approach: They propose an end-to-end model for semantic parsing that transduces a natural language sentence to the formal semantic representation.
Outcome: The proposed model outperforms the state-of-the-art models and does not need expertise like predefined grammar or sketches in the meantime.
Beyond Itinerary Planning—A Real-World Benchmark for Multi-Turn and Tool-Using Travel Tasks (2026.acl-long)

Copied to clipboard

Challenge: Existing studies on LLM performance on travel planning have shown that existing settings are limited due to limited domain coverage, insufficient modeling of users’ implicit preferences in multi-turn conversations, and a lack of evaluation of agents’ capability boundaries.
Approach: They propose a benchmark to evaluate LLMs' planning and tool-use abilities in real-world settings by collecting user queries, user preferences, and tools from real scenarios.
Outcome: The proposed benchmark evaluates agents' capabilities in real-world settings and shows that even advanced models exhibit imbalanced performance across different capabilities.
Knowledge Mechanisms in Large Language Models: A Survey and Perspective (2024.findings-emnlp)

Copied to clipboard

Challenge: Using large language models, we can understand knowledge mechanisms in LLMs for learning, storage, utilization, and evolution.
Approach: They propose to analyze knowledge mechanisms in Large Language Models (LLMs) they examine utilization, evolution, and the potential dark knowledge (hypothesis) they hope to help understand knowledge in LLMs and provide insights for future research .
Outcome: The proposed model can be used to analyze the evolution of parametric knowledge in LLMs.
FaithfulRAG: Fact-Level Conflict Modeling for Context-Faithful Retrieval-Augmented Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing faithful RAG approaches enforce strict context adherence, but they forcibly suppress the model’s parametric knowledge, which undermines the model's internal knowledge structure and increases the risk of misinterpreting the context.
Approach: They propose a framework that resolves knowledge conflicts by explicitly modeling discrepancies between the model’s parametric knowledge and retrieved context.
Outcome: The proposed framework outperforms state-of-the-art methods in knowledge conflict cases and identifies conflicting knowledge at the fact level and designs a self-thinking process.
MemPO: Self-Memory Policy Optimization for Long-Horizon Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for long-horizon agents introduce the external memory module and look up the relevant information from the stored memory, which prevents the model from proactively managing its memory content and aligning with the agent’s overarching task objectives.
Approach: They propose an algorithm which enables agents to autonomously manage their memory during interaction with environment and selectively retain crucial information.
Outcome: Extensive experiments show that the proposed algorithm achieves absolute F1 score gains of 25.98 over the base model and 7.1 over the previous SOTA baseline while preserving task performance.
M2RC-EVAL: Massively Multilingual Repository-level Code Completion Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Existing repository-level code completion benchmarks focus on a limited number of languages . existing benchmarks report overall average scores of different languages ignoring fine-grained abilities .
Approach: They propose to use repository-level code completion benchmarks to evaluate general code intelligence abilities across languages for existing code Large Language Models.
Outcome: The proposed benchmarks improve the code completion abilities of existing LLMs by using two types of annotations on the parsed syntax tree.
A Divide-And-Conquer Approach for Multi-label Multi-hop Relation Detection in Knowledge Base Question Answering (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for relation detection only detect one path to obtain the answer without considering other correct paths.
Approach: They propose a divide-and-conquer approach for multi-label multi-hop relation detection . they propose 'path sampling mechanism' to generate diverse relation paths .
Outcome: The proposed approach outperforms other competitive approaches on the FreebaseQA benchmark dataset.
RIMRULE: Improving Tool-Using Language Agents via MDL-Guided Rule Learning (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) struggle to use tools reliably in domain-specific settings.
Approach: They propose a neuro-symbolic approach to adapt large language models to task-specific tools . they propose reusable rules that are distilled from failure traces and injected into the prompt .
Outcome: Experiments show that the proposed approach outperforms prompting-based adaptation methods and complements finetuning.
Are LLMs Rational Investors? A Study on the Financial Bias in LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies on biases within specific domains, such as finance, remain limited.
Approach: They propose a framework to detect, detect, analyze and mitigate financial biases in large language models.
Outcome: The proposed framework reduces bias by 68% for the most biased model, according to key metrics.
LIME: Less Is More for MLLM Evaluation (2025.findings-acl)

Copied to clipboard

Challenge: Existing MLLM benchmarks and unified evaluation frameworks cannot accurately and efficiently reflect the ability of MLMLs.
Approach: They propose a semi-automated benchmark curated using a pipeline that filters out uninformative samples and eliminates answer leakage by focusing on tasks that require image-based understanding.
Outcome: The proposed benchmark reduces the number of samples by 76% and evaluation time by 77% while it can more effectively distinguish different models’ abilities.
Evaluating Instructively Generated Statement by Large Language Models for Directional Event Causality Identification (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on identifying existence of causality between two event mentions, but the direction of causalities is crucial for understanding the causal relation.
Approach: They propose to instruct a GLM to generate causality statements and identify directional event causality by evaluating the generated statements.
Outcome: The proposed method significantly outperforms state-of-the-art methods even with fewer training data.
Unified Hallucination Detection for Multimodal Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: despite significant strides in multimodal tasks, MLLMs are plagued by the critical issue of hallucination.
Approach: They propose a meta-evaluation benchmark to facilitate evaluation of advancements in hallucination detection methods.
Outcome: The proposed framework validates hallucinations robustly and provides strategic insights . MHaluBench is a meta-evaluation benchmark designed to facilitate evaluation .
Gradient-Adaptive Policy Optimization: Towards Multi-Objective Alignment of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Reinforcement learning from human feedback (RLHF) has emerged as a powerful technique for aligning large language models (LLMs) with human preferences.
Approach: They propose a novel algorithm that uses multiple-gradient descent to optimize LLMs with diverse preferences to maximize trade-offs between objectives.
Outcome: The proposed approach incorporates user preferences across different objectives and achieves Pareto solutions that better align with the user’s specific needs.
ConvLab: Multi-Domain End-to-End Dialog System Platform (P19-3)

Copied to clipboard

Challenge: ConvLab is an open-source multi-domain end-to-end dialog system platform . it allows researchers to quickly set up experiments with reusable components and compare a large set of different approaches in common environments.
Approach: They propose to use an open-source multi-domain end-to-end dialog system platform to train and evaluate dialog bots in common environments.
Outcome: The proposed system enables researchers to quickly set up experiments with reusable components and compare a large set of different approaches in common environments.
Benchmarking LLMs for Translating Classical Chinese Poetry: Evaluating Adequacy, Fluency, and Elegance (2025.emnlp-main)

Copied to clipboard

Challenge: Existing large language models fall short of translating culturally significant content . existing models fall behind in achieving such translations, authors say .
Approach: They propose a suitable benchmark for translating classical Chinese poetry into English . they propose RAT, a retrieval-augmented machine translation method that enhances the translation process .
Outcome: The proposed method improves translation quality in terms of adequate, fluent, and elegant translations.
Why Prompt Design Matters and Works: A Complexity Analysis of Prompt Search Space in LLMs (2025.acl-long)

Copied to clipboard

Challenge: Chain-of-Thought (CoT) prompting has emerged as a practical workaround, but most CoT-based methods rely on a single generic prompt like “think step by step” with no task-specific adaptation.
Approach: They propose a theoretical framework that explains why some prompts succeed while others fail by using a generic generic prompt like "think step by step" they show that prompts function as selectors, extracting specific task-relevant information from the model's full hidden state during CoT reasoning.
Outcome: The proposed framework explains why some prompts succeed while others fail.
Jointly Optimizing Diversity and Relevance in Neural Response Generation (N19-1)

Copied to clipboard

Challenge: Recent neural conversation models often generate bland and generic responses . however, the improvement often comes at the cost of decreased relevance .
Approach: They propose a spacefusion model to jointly optimize diversity and relevance that fuses the latent space of a sequence-to-sequence model and that of an autoencoder model by leveraging novel regularization terms.
Outcome: The proposed model improves diversity and relevance compared to baselines in both diversity and diversity.
Generate then Select: Open-ended Visual Question Answering Guided by World Knowledge (2023.findings-acl)

Copied to clipboard

Challenge: Open-ended Visual Question Answering (VQA) requires models to reason over visual and natural language inputs using world knowledge.
Approach: They propose a new VQA pipeline that deploys a generate-then-select strategy guided by world knowledge for the first time.
Outcome: The proposed pipeline expands the knowledge coverage from in-domain training data by 4.1% on OK-VQA, without additional computation cost.
G3R: A Graph-Guided Generate-and-Rerank Framework for Complex and Cross-domain Text-to-SQL Generation (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches to complex and cross-domain Text-to-SQL generation lack domain knowledge . domain knowledge is not incorporated to enhance their ability to generalise to unseen databases.
Approach: They propose a framework called G3R for complex and cross-domain Text-to-SQL generation . they propose re-ranking SQL queries based on domain knowledge and a graph-guided SQL generator .
Outcome: The proposed framework achieves state-of-the-art results on the Spider and Spider-DK benchmarks.
OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement (2024.findings-acl)

Copied to clipboard

Challenge: OpenCodeInterpreter-33B provides a high level of performance for code generation, executing, and iterative refinement.
Approach: They propose a family of open-source code systems for generating, executing, and iteratively refining code.
Outcome: The OpenCodeInterpreter-33B performs well on humanEval, MBPP, and EvalPlus benchmarks.
The More, The Better? A Critical Study of Multimodal Context in Radiology Report Summarization (2025.findings-emnlp)

Copied to clipboard

Challenge: Current multimodal summarization models often fail to utilize radiology images in summarizing Findings section.
Approach: They conduct a thorough analysis to determine whether current multimodal summarization models can utilize radiology images in summarizing Findings section.
Outcome: The Impression section plays a crucial role in communication between radiologists and physicians.
TF-Mamba: Text-enhanced Fusion Mamba with Missing Modalities for Robust Multimodal Sentiment Analysis (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing Transformer-based methods with missing modalities are difficult to use and have quadratic complexity.
Approach: They propose a text-enhanced Fusion Mamba framework for robust MSA with missing modalities . a Text-aware Modality Enhancement module aligns and enriches non-text modality while reconstructing missing text semantics.
Outcome: The proposed method is efficient under missing modalities and can be used in long-range modeling and multimodal fusion scenarios.
Joint Chinese Word Segmentation and Part-of-speech Tagging via Two-way Attentions of Auto-analyzed Knowledge (2020.acl-main)

Copied to clipboard

Challenge: Chinese word segmentation and part-of-speech tagging are important fundamental tasks in natural language processing.
Approach: They propose a neural model for Chinese word segmentation and part-of-speech tagging . they incorporate context features and syntactic knowledge for each input character .
Outcome: The proposed model can learn and benefit from existing tools, but its quality may be poor.
PanoramaRAG: Enabling Consistent Global Topic Awareness in Graph-Based RAG (2026.findings-acl)

Copied to clipboard

Challenge: Existing graph-based methods for enhancing Large Language Models (LLMs) with external knowledge are focusing on local relationships, resulting in suboptimal performance for tasks that require global context.
Approach: They propose a "panorama"-guided paradigm that integrates a light yet comprehensive "panoramic" of the corpus to guide all stages of the retrieval process.
Outcome: The proposed paradigm performs well across five datasets and a variety of tasks.
Enhancing Cross Text-Molecule Learning by Self-Augmentation (2024.findings-acl)

Copied to clipboard

Challenge: Existing datasets are limited due to the difficulty of collecting precise molecule-description pairs. Existing approaches to enhance large language models include a data augmentation framework and a new dataset called SAPubChem-41.
Approach: They propose a framework that interweaves model fine-tuning and data augmentation to overcome the scarcity of high-quality labeled data.
Outcome: The proposed framework interweaves model fine-tuning and data augmentation to overcome the scarcity of high-quality labeled data.
Event-Centric Query Expansion in Web Search (2023.acl-industry)

Copied to clipboard

Challenge: Existing studies rely on long-term search log mining to improve search experience . EQE system is a novel event retrieval framework that can select the best expansion from a significant amount of potential events quickly and accurately.
Approach: They propose a QE system that uses a four-stage event retrieval framework . they collect news headlines and then refine a dual-tower semantic model to serve as an encoder .
Outcome: The proposed system can select the best expansion from a significant amount of potential events quickly and accurately.
Improving HowNet-Based Chinese Word Sense Disambiguation with Translations (2022.findings-emnlp)

Copied to clipboard

Challenge: Prior work on unsupervised WSD has leveraged lexical knowledge bases, such as WordNet and BabelNet, but these have proven to be less effective for Chinese.
Approach: They propose a system which combines contextual information from a pretrained neural language model with bilingual information obtained via machine translation and sense translation information from HowNet.
Outcome: The proposed system achieves a state-of-the-art for unsupervised Chinese WSD.
Neuron-Level Sequential Editing for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing model editing methods focus on single-round editing and often face significant challenges in sequential model editing.
Approach: They propose a model editing method that optimizes the target layer’s hidden states using the model’s original weights to prevent model failure.
Outcome: The proposed method outperforms existing model editing methods and is available on the open-source platform 4open.science.
Fuzzy Reasoning Chain (FRC): An Innovative Reasoning Framework from Fuzziness to Clarity (2025.findings-emnlp)

Copied to clipboard

Challenge: ambiguity, polysemy, or uncertainty remain significant challenges in natural language processing.
Approach: They introduce a framework that integrates LLM semantic priors with continuous fuzzy membership degrees to create an explicit interaction between probability-based reasoning and fuzzy membership reasoning.
Outcome: The proposed framework integrates semantic priors with continuous fuzzy membership degrees . it allows ambiguous inputs to be gradually transformed into clear and interpretable decisions .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations