Papers by Xiang Zhou

98 papers
What Can We Learn from Collective Human Opinions on Natural Language Inference Data? (2020.emnlp-main)

Copied to clipboard

Challenge: Despite the subjective nature of many NLU evaluations, little attention has been paid to the distribution of human opinions.
Approach: They use a dataset with 464,500 annotations to study Collective HumAn OpinionS . they argue that models lack the ability to recover the distribution over human labels .
Outcome: The proposed dataset examines the distribution of human opinions in NLU evaluation datasets.
Can Sequence-to-Sequence Transformers Naturally Understand Sequential Instructions? (2023.starsem-1)

Copied to clipboard

Challenge: Using a limited annotation budget, we can greatly improve the performance on intermediate steps with a drop in final-step performance.
Approach: They propose to use a pre-supervised sequence-to-sequence transformer to provide training signals on intermediate steps with zero gold supervision instead of only final-step supervision to improve performance.
Outcome: The proposed model significantly improves on intermediate steps with a drop in final-step performance on one subtask, but also shows decreased performance on another subtask.
Modality Matching Matters: Calibrating Language Distances for Cross-Lingual Transfer in URIEL+ (2026.eacl-srw)

Copied to clipboard

Challenge: Existing linguistic knowledge bases such as URIEL+ lack a principled method for aggregating these signals into a single, comprehensive score.
Approach: They propose a framework for type-matched language distances that unifies these signals into a robust, task-agnostic composite distance.
Outcome: The proposed representations improve transfer performance when the distance type is relevant to the task, while yielding gains in most tasks.
Text Embedding as Treatment: A Meta Causal Approach for Robust Sentiment Classification (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for sentiment classification use binary treatment of words . Existing approaches limit generalizability to novel words and low-frequency words if there is a word in a sentence that is not treated .
Approach: They propose a meta-causal approach that uses a single training task to identify causal words for arbitrary words.
Outcome: The proposed method reduces the spurious correlation between word treatment and sentiment classification by removing words with low treatment effects from a pre-trained language model.
Annotations Are Not All You Need: A Cross-modal Knowledge Transfer Network for Unsupervised Temporal Sentence Grounding (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing work on temporal sentence grounding rely on expensive video-query paired annotations . despite this, there are no ground-truth annotations in the current work .
Approach: They propose to use paired video-query and segment boundary annotations to generate temporal sentence grounding without training.
Outcome: The proposed model outperforms existing unsupervised methods and beats supervised ones on two challenging datasets.
Reflect, Not Reflex: Inference-Based Common Ground Improves Dialogue Response Quality (2022.emnlp-main)

Copied to clipboard

Challenge: Currently, human communication models fail to explicitly model common ground (CG) . less than half of the responses in current data is rated as high quality .
Approach: They propose a dataset that annotates dialogues with explicit CG and solicits 9k diverse responses each following one common ground.
Outcome: The proposed dataset annotates dialogues with explicit CG and solicits 9k diverse responses each following one common ground.
SGA-MCTS: Decoupling Planning from Execution via Training-Free Atomic Experience Retrieval (2026.findings-acl)

Copied to clipboard

Challenge: a new framework casts LLM planning as non-parametric retrieval, but high latency of inference-time search and supervised fine-tuning are limitations.
Approach: They propose a framework that casts LLM planning as non-parametric retrieval . they leverage Monte Carlo Tree Search to explore the solution space .
Outcome: Empirical results show that SGA-MCTS can match the performance of SOTA systems without task-specific fine-tuning.
Don’t Half-listen: Capturing Key-part Information in Continual Instruction Tuning (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to improve instruction tuning for large language models may cause catastrophic forgetting (CF) CF is a problem where previously learned abilities are degraded .
Approach: They propose a continual instruction tuning method that uses key-part information gain to replay data and refine training objective.
Outcome: The proposed method achieves superior performance on both seen and held-out tasks.
Probing Commonsense Explanation in Dialogue Response Generation (2021.findings-emnlp)

Copied to clipboard

Challenge: Currently, response generation (RG) models do not understand human communication intents.
Approach: They propose to examine commonsense reasoning implicitly to determine whether RG models produce coherent responses in conversations.
Outcome: The proposed probing settings show that RG models fail to capture the logical relations between commonsense explanations and responses and fine-tuning on in-domain data do not lead to understanding of CSR for RG.
I Cast Detect Thoughts: Learning to Converse and Guide with Intents and Theory-of-Mind in Dungeons and Dragons (2023.acl-long)

Copied to clipboard

Challenge: Existing dialogue agents, while able to produce human-like responses, often do not model goal-driven and grounded language interactions.
Approach: They propose to decompose and model teacher-student natural language interactions into (1) the DM’s intent to guide players toward a given goal; (2) the dm’s guidance utterance to the players expressing this intent; (3) a theory-of-mind model that anticipates the players’ reaction to the guidance one turn into the future.
Outcome: The proposed task is based on a goal-driven and grounded environment with a teacher-student interaction model and theory-of-mind model.
Towards Building a Robust Toxicity Predictor (2023.acl-industry)

Copied to clipboard

Challenge: Recent studies have focused on robustness of toxicity language predictors, but this is problematic for real-world toxicity detection.
Approach: They propose a novel adversarial attack that exploits greedy search strategies to fool toxic text classifiers.
Outcome: The proposed attack can detect weaker toxicity language detectors even against unseen attacks.
Synergizing Stylometrics with Semantics: Dual-Path Framework for LLM Detection and Attribution (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for identifying MGTs rely on statistical likelihood or deep embeddings.
Approach: They propose a framework that extracts model-specific stylistic fingerprints across lexical, syntactic, and structural dimensions.
Outcome: The proposed framework achieves a Macro-F1 score of 95.6% on the Wikipedia dataset.
The Curse of Performance Instability in Analysis Datasets: Consequences, Source, and Suggestions (2020.emnlp-main)

Copied to clipboard

Challenge: Neural network models have significantly pushed forward performance on natural language processing benchmarks with the development of largescale language model pre-training.
Approach: They find that models on natural language inference and reading comprehension are unstable . they propose to use a model-selection routine to analyze the model's instability .
Outcome: The proposed models can perform poorly on two language-related tasks, the authors show . they also show that the model selection routine is unstable, and that it is not reliable .
Towards Robust Neural Machine Translation with Iterative Scheduled Data-Switch Training (2022.coling-1)

Copied to clipboard

Challenge: Existing methods on robust neural machine translation (NMT) construct adversarial examples by injecting noise into authentic examples and indiscriminately exploit two types of examples.
Approach: They propose an iterative scheduled data-switch training framework to mitigate this problem by injecting noise into authentic examples and indiscriminately exploiting two types of examples.
Outcome: The proposed model outperforms several competitive benchmarks on four translation benchmarks.
DrAgent: Empowering Large Language Models as Medical Agents for Multi-hop Medical Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: commercial LLMs can be difficult to use in real-world clinical decision-making . a lightweight LLM can be used to collaborate with diverse clinical tools .
Approach: They propose a lightweight LLM that can be used to build medical LLMs as agents . they use recursive curriculum learning to optimize the LLM in an easy-to-hard progression .
Outcome: The proposed approach outperforms human experts in medical examinations on diverse datasets.
PRISM: Probabilistic Reward Model with Inherent Structural Modeling (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluators compress diverse human judgments into a single scalar, leading to brittle alignment and reward hacking.
Approach: They propose a Gaussian-based reinterpretation of reward evaluation as a conditional distribution and a mixture of Gaussians to capture conflicting preference dimensions.
Outcome: The proposed model outperforms scalar baselines in accuracy and generalization.
Visual In-Context Learning for Large Vision-Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve the performance of Large Visual Language Models (LVLMs) are limited by cross-modal interactions and representation disparities.
Approach: They propose a Visual In-Context Learning method that retrieves images via a 'Retrieval & Rerank' paradigm and summarises images with task intent and task-specific visual parsing to compose language-based demonstrations that reduce token count.
Outcome: The proposed method reduces token count and alleviates cross-modal interaction problem on visual reasoning datasets.
I2E: From Image Pixels to Actionable Interactive Environments for Text-Guided Image Editing (2026.acl-long)

Copied to clipboard

Challenge: Existing text-guided image editing methods rely on end-to-end pixel-level inpainting paradigm . existing models lack such intermediate representations and Reasoning-then-action process .
Approach: They propose a "Decompose-then-Action" paradigm that revisits image editing as an actionable interaction process within a structured environment.
Outcome: The proposed paradigm outperforms existing methods in compositional editing tasks.
Masked Part-Of-Speech Model: Does Modeling Long Context Help Unsupervised POS-tagging? (2022.naacl-main)

Copied to clipboard

Challenge: Recent Part-Of-Speech (POS) induction models assume certain independence assumptions that do not hold in real languages.
Approach: They propose a Masked Part-of-Speech Model (MPoSM) that can model arbitrary tag dependency and perform POS induction through the objective of masked POS reconstruction.
Outcome: The proposed model can model arbitrary tag dependency and perform POS induction through the objective of masked POS reconstruction.
LaMP-Val: Large Language Models Empower Personalized Valuation in Auction (2025.findings-emnlp)

Copied to clipboard

Challenge: Currently, most research focuses on the bidding algorithms used within auction mechanisms.
Approach: They propose a personalized valuation framework that integrates Large Language Models to incorporate personalized semantic preference into users valuation process.
Outcome: The proposed framework incorporates Large Language Models to incorporate personalized semantic preference into users valuation process.
Title2Event: Benchmarking Open Event Extraction with a Large-scale Chinese Title Dataset (2022.emnlp-main)

Copied to clipboard

Challenge: Existing EE datasets define fixed event types and design specific schemas for each of them, failing to cover diverse events emerging from the online text.
Approach: They propose to use a sentence-level dataset to benchmark Open Event Extraction without restricting event types.
Outcome: The proposed dataset contains more than 42,000 news titles in 34 topics collected from Chinese web pages.
CommonGen: A Constrained Text Generation Challenge for Generative Commonsense Reasoning (2020.findings-emnlp)

Copied to clipboard

Challenge: Recent studies show that pre-trained language models perform well on commonsense-reasoning benchmark datasets, but building machines with commonsence to compose plausible sentences remains challenging.
Approach: They propose a constrained text generation task for generative commonsense reasoning that generates a coherent sentence using common concepts.
Outcome: The proposed task generates a coherent sentence describing an everyday scenario using common concepts over 35k concept-sets.
FinKario: Event-Enhanced Automated Construction of Financial Knowledge Graph (2026.acl-long)

Copied to clipboard

Challenge: Equity research reports are crucial resources for investors, but lack professional analysis and the rapid evolution of market events outpaces their update cycles.
Approach: They propose an event-Enhanced automated construction of financial knowledge graph (FinKario) that automatically integrates real-time company fundamentals and market events through prompt-driven extraction guided by professional institutional templates.
Outcome: The proposed model outperforms financial LLMs by 18.81% and institutional strategies by 17.85% on average in backtesting.
Learning Dialogue Representations from Consecutive Utterances (2022.naacl-main)

Copied to clipboard

Challenge: Dialogue Sentence Embedding (DSE) is a self-supervised contrastive learning method that learns effective dialogue representations suitable for a wide range of dialogue-oriented tasks.
Approach: They propose a self-supervised contrastive learning method that learns dialogue representations suitable for a wide range of dialogue tasks.
Outcome: The proposed method outperforms baselines on five dialogue tasks on a few-shot and zero-shot datasets.
The Mystery of In-Context Learning: A Comprehensive Survey on Interpretation and Analysis (2024.emnlp-main)

Copied to clipboard

Challenge: In-context learning (ICL) is a capability that enables large language models to excel in proficiency through demonstration examples.
Approach: They present a survey on the interpretation and analysis of in-context learning . they focus on theoretical and empirical perspectives on the concept .
Outcome: The proposed model can perform tasks with minimal examples without re-training and has demonstrated proficiency across various tasks with a minimal set of task-oriented examples.
Xiaomingbot: A Multilingual Robot News Reporter (2020.acl-demos)

Copied to clipboard

Challenge: Xiaomingbot is a multilingual and multimodal software robot with four capabilities: news generation, news translation, news reading and avatar animation.
Approach: They propose to build a multilingual and multimodal software robot with four inte- gal capabilities: news generation, news translation, news reading and avatar animation.
Outcome: The proposed system generates Chinese news, then reads it in multiple languages and generates an animated avatar reading it.
BoolQuestions: Does Dense Retrieval Understand Boolean Logic in Language? (2024.findings-emnlp)

Copied to clipboard

Challenge: Dense retrieval systems focus on optimizing text embedding space while overlooking Boolean logic in language.
Approach: They propose a task to investigate whether retrieval systems can comprehend Boolean logic in language.
Outcome: The proposed method is based on a benchmark dataset covering complex queries containing basic Boolean logic and corresponding annotated passages.
Robust Preference Optimization via Dynamic Target Margins (2025.findings-acl)

Copied to clipboard

Challenge: Direct Preference Optimization (DPO) is an efficient method for ensuring safety and reliability in practical applications.
Approach: They propose a dynamic target margin preference optimization algorithm that adjusts reward margins at the pairwise level.
Outcome: The proposed method achieves an average 4.4% improvement over baselines, setting new benchmarks for state-of-the-art performance.
From Graph to Word Bag: Introducing Domain Knowledge to Confusing Charge Prediction (2024.lrec-main)

Copied to clipboard

Challenge: Existing charge prediction methods have shown impressive performance, but they face significant challenges when dealing with confusing charges, such as Snatch and Robbery.
Approach: They propose a novel approach which introduces domain knowledge regarding constituent elements to guide the model in making judgments on confusing charges, much like a judge’s reasoning process.
Outcome: The proposed approach maintains exceptional performance in imbalanced label distributions.
Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model (2023.findings-acl)

Copied to clipboard

Challenge: Pretrained language models have achieved remarkable success in various natural language processing tasks.
Approach: They propose to use end-task knowledge to select a tiny subset of pretraining corpus to influence performance.
Outcome: The proposed model outperforms pretrained models on eight datasets covering four domains with 0.45% of the data and a three-orders-of-magnitude lower computational cost.
LayoutDIT: Layout-Aware End-to-End Document Image Translation with Multi-Step Conductive Decoder (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods struggle to capture the visual layout in complex document images.
Approach: They propose to integrate layout knowledge into document image translation by using a layout-aware encoder and a multi-step conductive decoder to achieve the translation step by step.
Outcome: The proposed model outperforms state-of-the-art methods with better parameter efficiency.
Coarse-to-fine Few-shot Learning for Named Entity Recognition (2023.findings-acl)

Copied to clipboard

Challenge: Existing few-shot NER solutions do not consider sub-class discrimination and various granularity of new classes during coarse training.
Approach: They propose a method that uses a cluster-based prototype loss to learn group-wise discriminative representations of coarse-grained classes and a mixture prototype loss for learning the representations.
Outcome: The proposed method shows superior performance over baseline methods on in-domain and cross-domain settings with various target granularity.
RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks focus on character-centric approach and fail to reflect real-world applications.
Approach: RMTBench is a user-centric bilingual role-playing benchmark featuring 80 diverse characters and over 8,000 dialogue rounds.
Outcome: RMTBench features 80 diverse characters and over 8,000 dialogue rounds.
Data Factors for Better Compositional Generalization (2023.emnlp-main)

Copied to clipboard

Challenge: Recent diagnostic datasets on compositional generalization expose severe problems . state-of-the-art models trained on larger and more general datasets show better generalization ability .
Approach: They conduct an empirical analysis by training Transformer models on a variety of training sets with different data factors including dataset scale, pattern complexity, example difficulty, etc.
Outcome: The proposed model training on larger datasets improves on compositional generalization tasks.
From Implicit Graph Encoding to Explicit Evidence: A Training-Free LLM Framework for Temporal Knowledge Graph Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing Large Language Models (LLMs) struggle with implicit modality alignment and suboptimal graph linearization.
Approach: They propose a training-free, test-time adaptive framework that reframes TKG prediction as explicit evidence-driven reasoning.
Outcome: ExE-LLM outperforms fully trained graph neural networks on four benchmarks . it achieves SOTA performance in inductive settings, significantly outperforming fully trained neural networks .
MixTEA: Semi-supervised Entity Alignment with Mixture Teaching (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to learn informative entity embeddings are insufficient for semi-supervised entity alignment.
Approach: They propose a semi-supervised method which guides the model learning with an end-to-end mixture teaching of manually labeled mappings and probabilistic pseudo mappings.
Outcome: The proposed method is superior to existing methods on benchmark datasets and further analyses.
Towards Robustifying NLI Models Against Lexical Dataset Biases (2020.acl-main)

Copied to clipboard

Challenge: Recent studies show that deep learning models exploit dataset biases without deep understanding of the language semantics.
Approach: They propose two methods to debiase models against lexical dataset biases . they use contradiction-word bias and word-overlapping bias as examples .
Outcome: The proposed method removes label bias at embedding level, while the other uses a bag-of-words sub-model to capture features likely to exploit the bias.
Hidden Biases in Unreliable News Detection Datasets (2021.eacl-main)

Copied to clipboard

Challenge: Recent studies show that automatic unreliable news detection models only use the article itself without resorting to fact-checking mechanisms.
Approach: They propose to use a simple model as a difficulty/bias probe instead of a complex one . they observe a significant drop in accuracy for all models tested in a clean split .
Outcome: The proposed model can achieve good performance by memorizing site-label mapping instead of modeling the real task.
Every Token Counts: Generalizing 16M Ultra-Long Context in Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: a recent study explores efficient ultra-long context modeling.
Approach: They propose to use Hierarchical Sparse Attention to achieve efficient ultra-long context modeling.
Outcome: The proposed model performs comparable to full-attention baselines on in-domain and out-of-domain tasks.
Knowledge Graph Enhanced Neural Machine Translation via Multi-task Learning on Sub-entity Granularity (2020.coling-main)

Copied to clipboard

Challenge: Existing methods to integrate knowledge graph (KG) with neural machine translation (NMT) have two problems: knowledge under-utilization and granularity mismatch.
Approach: They propose a multi-task learning method on sub-entity granularity to combine machine translation and knowledge reasoning tasks.
Outcome: The proposed method significantly outperforms baseline models on translation tasks and handling the entities.
A Knowledge-driven Generative Model for Multi-implication Chinese Medical Procedure Entity Normalization (2020.emnlp-main)

Copied to clipboard

Challenge: Medical entity normalization (NEN) is a task that links medical mentions to entities in knowledge bases.
Approach: They propose a sequence generative framework to generate Chinese medical procedure entity normalization by constraint decoding and category-based model refining.
Outcome: The proposed model improves on baselines especially in the case of multi-implication Chinese medical procedures.
Training-Free Adaptive Speculative Decoding via Linguistic Priors (2026.findings-acl)

Copied to clipboard

Challenge: Speculative decoding (SPD) is a promising technique to accelerate Large Language Models (LLMs). current approaches neglect the inherent heterogeneity of natural language and fail to distinguish between semantically-rich content and structurally-predictable syntax.
Approach: They propose a training-free framework that leverages linguistic priors to enable adaptive drafting and verification.
Outcome: The proposed framework significantly accelerates inference without additional training.
EssayJudge: A Multi-Granular Benchmark for Assessing Automated Essay Scoring Capabilities of Multimodal Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Automated Essay Scoring (AES) systems face three major challenges: reliance on handcrafted features that limit generalizability, difficulty in capturing fine-grained traits like coherence and argumentation, and inability to handle multimodal contexts.
Approach: They propose a multimodal benchmark to evaluate AES capabilities across lexical-, sentence-, and discourse-level traits without manual feature engineering.
Outcome: The proposed system can evaluate AES capabilities across lexical-, sentence-, and discourse-level traits without manual feature engineering.
Multimodal Document-level Triple Extraction via Dynamic Graph Enhancement and Relation-Aware Reflection (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for extracting structured triples knowledge from multimodal documents face limitations in simultaneously processing long textual content and multiple associated images for triple extraction.
Approach: They propose a multimodal document-level triple extraction framework that integrates multimodal text and visual content into a large language model and injects the global information and external knowledge into the model.
Outcome: The proposed framework outperforms the state-of-the-art methods and fills the gap in multimodal document extraction.
RexUIE: A Recursive Method with Explicit Schema Instructor for Universal Information Extraction (2023.findings-emnlp)

Copied to clipboard

Challenge: Named Entity Recognition (NER) and Relation Extraction (RE) models have limited success when extracting general schemas such as quadruples and quintuples.
Approach: They propose a formal formulation that covers almost all extraction schemas and a Recursive Method with Explicit Schema Instructor for UIE.
Outcome: The proposed method shows strong performance under full-shot and few-shot settings and achieves state-of-the-art results on the tasks of extracting complex schemas.
Code Generation From Flowcharts with Texts: A Benchmark Dataset and An Approach (2022.findings-emnlp)

Copied to clipboard

Challenge: Currently, researchers focus on generating codes from requirement documents.
Approach: They propose to generate source code from flowcharts with texts instead of directly translating requirements into codes.
Outcome: The proposed model improves on the baselines by transforming flowcharts into pseudo-code . the proposed model is based on 320 flowchartes with their corresponding source codes .
UICOMPASS: UI Map Guided Mobile Task Automation via Adaptive Action Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Mobile task automation is an emerging technology that leverages AI to automatically execute routine tasks by users’ commands on mobile devices like Android.
Approach: They propose a UI Map-guided LLM-based approach to automate mobile tasks using static analysis and LLMs.
Outcome: The proposed approach achieves a 15.87% higher task execution success rate than SOTA approaches even when only APK is available.
XFormParser: A Simple and Effective Multimodal Multilingual Semi-structured Form Parser (2025.coling-main)

Copied to clipboard

Challenge: Document AI parsing semi-structured image form is a key information extraction task.
Approach: They propose a multimodal and multilingual semi-structured FORM PARSER which integrates SER and relation extraction into a unified framework.
Outcome: The proposed framework achieves up to 1.79% improvement on RE tasks in multilingual and zero-shot settings.
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications.
Approach: They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions.
Outcome: The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions.
Distributed NLI: Learning to Predict Human Opinion Distributions for Language Reasoning (2022.findings-acl)

Copied to clipboard

Challenge: Using distributed NLI, we show that models can capture human judgement distribution more effectively than the softmax baseline.
Approach: They propose a new NLU task to predict the distribution of human judgements . they propose Monte Carlo, Deep Ensemble, Re-Calibration and Distribution Distillation methods to capture human judgement distributions.
Outcome: The proposed methods perform better than the softmax baseline, but the results are still far below the estimated human upper-bound.
SWE-QA-Pro: A Representative Benchmark and Scalable Training Recipe for Repository-Level Code Understanding (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for agentic repository-level code understanding overlook long tail topics and rely on memorized knowledge.
Approach: They propose a repository-level agentic code understanding benchmark that uses long-tail repositories with executable environments to enforce topical balance.
Outcome: Empirically, a Qwen3-8B model trained with the proposed benchmark outperforms GPT-4o by 2.3 points.
Relying on the Unreliable: The Impact of Language Models’ Reluctance to Express Uncertainty (2024.acl-long)

Copied to clipboard

Challenge: a pivotal aspect of fostering reliable human-AI interactions lies in the apt communication of model confidences.
Approach: They examine how LMs incorporate confidence in responses via natural language . they also examine how downstream users behave in response to LM-articulated uncertainties .
Outcome: The proposed model overconfidences are high in LMs, and humans are biased against uncertainty-rich texts.
Omni-I2C: A Holistic Benchmark for High-Fidelity Image-to-Code Generation (2026.acl-long)

Copied to clipboard

Challenge: a benchmark is designed to evaluate the capability of Large Multimodal Models (LMMs) in converting complex, structured digital graphics into executable code.
Approach: They propose a benchmark to evaluate the capability of Large Multimodal Models to convert digital graphics into executable code.
Outcome: The proposed benchmark exposes the performance gap among leading LMMs . the benchmark features 1130 meticulously curated samples .
Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generation (2022.acl-long)

Copied to clipboard

Challenge: Current neural response generation models generate responses directly, omitting unstated implicit knowledge.
Approach: They propose a generative approach to externalize implicit commonsense knowledge and use it to generate responses.
Outcome: Empirical results show that TBS models outperform end-to-end RG models on most automatic metrics and generate more informative, specific, and commonsense-following responses.
Lawyers are Dishonest? Quantifying Representational Harms in Commonsense Knowledge Resources (2021.emnlp-main)

Copied to clipboard

Challenge: Commonsense knowledge bases are mostly human-generated and reflect societal biases . a filtering-based approach can reduce the issues in both resources and models but leads to a performance drop .
Approach: They propose a filtering-based approach to mitigating representational harms in ConceptNet and GenericsKB . they propose filtered-based approaches can reduce issues in both resources and models but leads to performance drop .
Outcome: The proposed approach reduces issues in resources and models but leads to performance drop . the paper proposes a filtering-based approach that reduces biases but leaves room for future work .
A Query-Response Framework for Whole-Page Complex-Layout Document Image Translation with Relevant Regional Concentration (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for document image translation rely on the vanilla encoder-decoder paradigm . a novel dynamic aggregation mechanism is designed to enhance the text semantics in query features toward translation.
Approach: They propose a Query-Response DIT framework that reformulates the DIT task into a parallel response/translation process of multiple queries.
Outcome: The proposed framework improves translation quality on four translation directions on three benchmarks.
MuggleMath: Assessing the Impact of Query and Response Augmentation on Math Reasoning (2024.acl-long)

Copied to clipboard

Challenge: In math reasoning with large language models, fine-tuning data augmentation by query evolution and diverse reasoning paths is empirically verified effective.
Approach: They propose to fine-tune data augmentation by query evolution and diverse reasoning paths.
Outcome: The proposed model achieves new state-of-the-art on GSM8K and MATH.
Skill Discovery for Software Scripting Automation via Offline Simulations with LLMs (2026.findings-eacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) can generate code from natural language queries, but runtime code generation is limited due to unverified code, security risks, longer response times, and higher computational costs.
Approach: They propose an offline simulation framework to curate a software-specific skillset by exploiting large language models and publicly available scripting guides.
Outcome: The proposed framework significantly improves automation success rates, reduces response time, and saves runtime token costs compared to traditional runtime code generation.
ELI-Why: Evaluating the Pedagogical Utility of Language Model Explanations (2025.findings-acl)

Copied to clipboard

Challenge: Language models are widely used in education, yet their ability to tailor responses to learners with varied informational needs and knowledge backgrounds remains under-explored.
Approach: They conduct two extensive human studies to assess the utility of language model-generated explanatory answers (explanations) on a benchmark of 13.4K "Why" questions.
Outcome: The proposed model explanations match learners' educational backgrounds only 50% of the time, compared to 79% for lay explanations.
Single-to-mix Modality Alignment with Multimodal Large Language Model for Document Image Machine Translation (2025.acl-long)

Copied to clipboard

Challenge: Document Image Machine Translation (DIMT) faces generalization challenges due to limited training data and the complex interplay between visual and textual information.
Approach: They propose a single-to-mix Modality alignment framework leveraging Multimodal Large Language Models (MLLMs) this framework aligns an imageonly encoder with multimodal representations of an MLLM pre-trained on large-scale document image datasets.
Outcome: The proposed framework improves translation quality in cross-domain generalization and challenging document image scenarios.
Self-Steering Optimization: Autonomous Preference Optimization for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Prior research focused on developing data generation methods, while insufficient attention has been paid to quality control mechanisms and often produces inaccurate and unhelpful data.
Approach: They propose an algorithm that automatically generates high-quality preference data, eliminating manual annotation requirements.
Outcome: The proposed algorithm outperforms baselines in human preference alignment and reward optimization.
Document Image Machine Translation with Dynamic Multi-pre-trained Models Assembling (2024.naacl-long)

Copied to clipboard

Challenge: Existing TIMT tasks focus on text-line-level images.
Approach: They propose to extend the existing TIMT task and introduce a new framework to translate a source document image to markdown-formatted target translation.
Outcome: The proposed task aims to translate a source document image with long context and complex layout structure to markdown-formatted target translation.
Learning “O” Helps for Learning More: Handling the Unlabeled Entity Problem for Class-incremental NER (2023.acl-long)

Copied to clipboard

Challenge: Existing Named Entity Recognition systems are typically trained on a large-scale dataset with predefined entity classes, then deployed for entity recognition on the test data without further adaptation or refinement.
Approach: They propose a representation learning method that adaptively detects entity clusters in "O" and two effective distance-based relabeling strategies for better learning the old classes.
Outcome: The proposed method achieves 10.62% improvement over the baseline methods.
MMAD:Multi-modal Movie Audio Description (2024.lrec-main)

Copied to clipboard

Challenge: Current methods of creating accessible movies rely on manual work, resulting in high costs and limited scalability.
Approach: They propose a multi-modal movie audio description pipeline that generates narrations of information that is not accessible through unimodal hearing in movies.
Outcome: The proposed pipeline surpasses existing baselines in performance on widely used datasets.
Mitigating Spurious Correlations via Counterfactual Contrastive Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to distinguish causally related words from spurious correlations are limited by the number of causally correlated words in a sentence.
Approach: They propose to use probabilistic probability of necessity and probability of sufficiency to identify causal relationships rather than spurious correlations between words and class labels.
Outcome: The proposed method is based on a contrastive learning approach name CPNS and is validated on public datasets.
Enhancing the General Agent Capabilities of Low-Paramter LLMs through Tuning and Multi-Branch Reasoning (2024.findings-naacl)

Copied to clipboard

Challenge: Open-source pre-trained Large Language Models exhibit strong language understanding and generation capabilities, making them highly successful in a variety of tasks.
Approach: They propose a method to construct agent-specific data using GPT-4 and supervised fine-tuning . they find that supervised tunning can significantly reduce hallucination outputs and formatting errors in agent tasks .
Outcome: The proposed method improves on five agent tasks of AgentBench.
LLM Inductive Reasoning Through Multi-Agent Enhanced Monte Carlo Tree Search (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for enhancing inductive reasoning of large language models often lack explicit optimization guidance and effective error correction.
Approach: They propose a plug-and-play test-time framework that integrates multi-agent coordination with Monte Carlo Tree Search to improve inductive reasoning.
Outcome: The proposed framework outperforms existing methods on four benchmarks and shows consistent improvements on QWQ-32B and Deepseek-V3 .
CSDS: A Fine-Grained Chinese Dataset for Customer Service Dialogue Summarization (2021.emnlp-main)

Copied to clipboard

Challenge: Existing summarization methods are prone to generate redundant and incoherent summaries, causing the performance to be worse.
Approach: They propose a Chinese dataset for Customer Service Dialogue Summarization (CSDS) that provides role-oriented summaries to acquire different speakers' viewpoints.
Outcome: The proposed dataset improves the abstractive summaries in two aspects . it also provides role-oriented summary to acquire different speakers’ viewpoints .
WebQuality: A Large-scale Multi-modal Web Page Quality Assessment Dataset with Multiple Scoring Dimensions (2025.naacl-long)

Copied to clipboard

Challenge: Existing studies on web page quality assessment neglect the aspect of web page content.
Approach: They propose a Chinese dataset for web page quality assessment . the dataset includes over 65,000 detailed an-notations spanning four sub-dimensions .
Outcome: The proposed dataset includes over 65,000 detailed an-notations spanning four sub-dimensions and incorporates elements such as HTML+CSS, text, and visual screenshot.
Impromptu Cybercrime Euphemism Detection (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for detecting euphemisms are ineffective in impromptu euphorism detection . Existing approaches for e-mail detection are limited to word-level ephemismals .
Approach: They propose a framework for impromptu euphemism detection that integrates context augmentation and multi-round iterative training to better predict the actual meaning of a masked token.
Outcome: The proposed framework improves 76-fold over the previous state-of-the-art euphemism detector.
Improving the Adversarial Robustness of NLP Models by Information Bottleneck (2022.findings-acl)

Copied to clipboard

Challenge: Existing studies have shown that adversarial examples can be directly attributed to the presence of non-robust features.
Approach: They propose to capture task-specific robust features while eliminating non-robust ones . they show that models can achieve significant improvement in robust accuracy .
Outcome: The proposed method outperforms all defense methods on SST-2, AGNEWS and IMDB datasets while achieving no performance drop.
OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have significantly enhanced the generative capabilities for various NLP tasks, but they still suffer from hallucinations due to their exclusive reliance on parametric knowledge.
Approach: They propose a framework that integrates retrieval tokens generated autoregressively into a single LLM to handle both tasks simultaneously in a unified forward pass.
Outcome: The proposed framework bridges the traditionally separate training approaches for generation and retrieval by incorporating retrieval tokens generated autoregressively.
HMEAE: Hierarchical Modular Event Argument Extraction (D19-1)

Copied to clipboard

Challenge: Existing event extraction methods classify each argument role independently, ignoring conceptual correlations between different argument roles.
Approach: They propose a Hierarchical Modular Event Argument Extraction model to provide inductive bias from the concept hierarchy of event argument roles.
Outcome: The proposed model outperforms existing methods on real-world datasets and shows that it leverages useful knowledge from the concept hierarchy.
Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings (2024.acl-long)

Copied to clipboard

Challenge: Empirically, we show SQ-Transformer achieves stronger compositional generalization than the vanilla Transformer on low-complexity datasets.
Approach: They propose a Transformer that explicitly encourages systematicity in the embeddings and attention layers even with low-complexity data.
Outcome: Empirically, the proposed model achieves stronger compositional generalization than the vanilla Transformer on low-complexity datasets.
Towards Robust Temporal Activity Localization Learning with Noisy Labels (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for temporal activity localization are expensive and difficult to satisfy due to subjective labeling.
Approach: They propose a new TAL setting where a TAL model should be robust to mixed training data with noisy moment boundaries.
Outcome: The proposed method is significantly more robust to noisy training data than existing methods.
Other Roles Matter! Enhancing Role-Oriented Dialogue Summarization via Role Interactions (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for role-oriented dialogue summarization ignore information from other roles, resulting in omitted information.
Approach: They propose a novel method that uses cross attention and decoder self-attention interactions to acquire other roles' critical information.
Outcome: The proposed method significantly outperforms baselines on two public role-oriented dialogue summarization datasets.
Improving MLLM’s Document Image Machine Translation via Synchronously Self-reviewing Its OCR Proficiency (2025.findings-acl)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) have shown strong performance in document image tasks, especially Optical Character Recognition (OCR). However, they struggle with Document Image Machine Translation (DIMT), which requires handling both cross-modal and cross-lingual challenges.
Approach: They propose a novel fine-tuning paradigm that allows the model to generate OCR text before producing translation text, which allows it to leverage its strong monolingual OCR ability while learning to translate text across languages.
Outcome: The proposed model can leverage its strong monolingual OCR ability while learning to translate text across languages.
Complicate Then Simplify: A Novel Way to Explore Pre-trained Models for Text Classification (2022.coling-1)

Copied to clipboard

Challenge: Existing frameworks for text classification employing pre-trained models are constrained by the difficulty of the task.
Approach: They propose a framework which implements a two-stage training strategy to fully exploit the knowledge in pre-trained models.
Outcome: The proposed framework outperforms state-of-the-art classification models on six text classification corpora.
Legal Judgment Prediction based on Knowledge-enhanced Multi-Task and Multi-Label Text Classification (2025.naacl-long)

Copied to clipboard

Challenge: Legal judgment prediction (LJP) is an essential task for legal AI, aiming at predicting judgments based on the facts of a case.
Approach: They propose a knowledge-enhanced approach that incorporates 'label-level knowledge' to enhance the representation of case facts for each task and 'task-level' knowledge to improve synergy.
Outcome: The proposed method is effective in comparison to state-of-the-art (SOTA) baselines.
Noise Robust Named Entity Understanding for Voice Assistants (2021.naacl-industry)

Copied to clipboard

Challenge: Named Entity Recognition and Entity Linking are challenging for voice assistants . utterances are relatively short, so there is not much context to help disambiguate .
Approach: They propose a Named Entity Understanding system that combines NER and EL in a joint reranking module.
Outcome: The proposed framework improves NER accuracy by up to 3.13% and EL accuracy by 3.6% in F1 score . it also leads to better accuracies in other natural language understanding tasks .
CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for expressive text-to-speech only implicitly learn prosody with masked token reconstruction tasks.
Approach: They propose a cross-modal contrastive pre-training framework that learns from prosody variance of the same text token under different contexts.
Outcome: The proposed framework can learn from prosody variance of a text token under different contexts.
Takin-VC: Expressive Zero-Shot Voice Conversion via Adaptive Hybrid Content Encoding and Enhanced Timbre Modeling (2025.acl-long)

Copied to clipboard

Challenge: Expressive zero-shot voice conversion (VC) aims to modify source timbre to match unseen speaker . existing zero- shot VC systems struggle to reproduce paralinguistic information in highly expressive speech .
Approach: They propose a framework for expressive zero-shot voice conversion that uses hybrid content encoding and memory-augmented context-aware timbre modeling.
Outcome: The proposed framework surpasses state-of-the-art VC systems in speech naturalness, speaker similarity, and speaker similarness.
ReCEval: Evaluating Reasoning Chains via Correctness and Informativeness (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods focus on whether the reasoning chain leads to the correct conclusion, but this view may confound reasoning quality with other spurious shortcuts to predict the answer.
Approach: They propose a framework that evaluates reasoning chains via two key properties: (1) correctness, i.e., each step makes a valid inference based on information contained within the step, preceding steps, and input context, and (2) informativeness, respectively.
Outcome: The proposed framework evaluates reasoning chains via two key properties: (1) correctness, i.e., each step makes a valid inference based on information contained within the step, preceding steps, and input context, and (2) informativeness, which is helpful towards deriving the generated answer.
From Chaotic OCR Words to Coherent Document: A Fine-to-Coarse Zoom-Out Network for Complex-Layout Document Image Translation (2025.coling-main)

Copied to clipboard

Challenge: Document Image Translation (DIT) aims to translate documents in images from one language to another.
Approach: They propose a novel end-to-end network called Zoom-out DIT to improve document translation by combining word positioning, sentence recognition and document organization.
Outcome: The proposed network improves word positioning, sentence recognition and document organization, and improves translation quality.
RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms (2021.emnlp-main)

Copied to clipboard

Challenge: Pre-trained language models have impressive performance on commonsense inference benchmarks, but their ability to make robust inferences is debated.
Approach: They propose a challenge that evaluates robust commonsense inference despite textual perturbations using commonsensical knowledge bases and probe PTLMs across two different evaluation settings.
Outcome: The proposed procedure evaluates robust commonsense inference despite textual perturbations using commonsensense knowledge bases and probe PTLMs across two evaluation settings.
AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation (2023.acl-long)

Copied to clipboard

Challenge: Existing models for speech-to-speech translation suffer from distinct degradation in noisy environments and fail to translate visual speech.
Approach: They propose a text-based audio-visual speech-to-speech translation model that integrates visual information with audio-only data to improve system robustness.
Outcome: The proposed model outperforms models trained on audio-only corpus in two languages . it also improves with low-resource audio-visual data, compared with baselines .
REL-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliance (2025.naacl-long)

Copied to clipboard

Challenge: Existing evaluations of large language models' ability to communicate uncertainty and knowledge limitations focus on the behaviors of their human interlocutors.
Approach: They propose an interaction-centered evaluation approach that quantifies whether and how humans rely on LLMs' responses.
Outcome: The proposed approach quantifies whether and how humans rely on LLMs' responses.
A Divide-And-Conquer Approach for Multi-label Multi-hop Relation Detection in Knowledge Base Question Answering (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for relation detection only detect one path to obtain the answer without considering other correct paths.
Approach: They propose a divide-and-conquer approach for multi-label multi-hop relation detection . they propose 'path sampling mechanism' to generate diverse relation paths .
Outcome: The proposed approach outperforms other competitive approaches on the FreebaseQA benchmark dataset.
ASDOT: Any-Shot Data-to-Text Generation with Pretrained Language Models (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to data-to-text generation require limited training examples . a data-based approach is based on a set of pre-trained language models with optional finetuning.
Approach: They propose a data-to-text generation task that makes use of any given (or no) examples.
Outcome: The proposed approach improves on baselines on a dataset with zero/few/full-shot settings.
Are LLMs Rational Investors? A Study on the Financial Bias in LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies on biases within specific domains, such as finance, remain limited.
Approach: They propose a framework to detect, detect, analyze and mitigate financial biases in large language models.
Outcome: The proposed framework reduces bias by 68% for the most biased model, according to key metrics.
Measure Children’s Mindreading Ability with Machine Reading (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing scoring models do not take the features of the stories and video clips into account when scoring, which will reduce the accuracy of the models.
Approach: They propose to leverage the features extracted from stories and videos related to the questions being asked during the children’s mindreading evaluation.
Outcome: The proposed framework agrees well with human experts on scores produced by the models.
R3-NL2GQL: A Model Coordination and Knowledge Graph Alignment Approach for NL2GQL (2024.findings-emnlp)

Copied to clipboard

Challenge: Adapting existing approaches for converting natural language to SQL encounters hurdles due to distinct nature of GQL compared to SQL.
Approach: They propose a method that integrates both small and large Foundation Models for ranking, rewriting, and refining tasks.
Outcome: The proposed approach integrates both small and large Foundation Models for ranking, rewriting, and refining tasks while capitalizing on the superior generalization and query generation prowess of larger models for the final transformation of natural language queries into GQL formats.
LexGenius: An Expert-Level Benchmark for Large Language Models in Legal General Intelligence (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for legal general intelligence (GI) are result-oriented and do not evaluate the legal intelligence of large language models (LLMs).
Approach: They propose a Chinese legal benchmark for evaluating legal GI in large language models . they use recent legal cases and exam questions to create multiple-choice questions .
Outcome: The proposed benchmarks lack a systematic evaluation of the legal intelligence of large language models (LLMs) the results show that even the best LLMs lagging behind human legal professionals.
SepSeq: A Training-Free Framework for Long Numerical Sequence Processing in LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing large-scale large-context models suffer from performance degradation when processing long numerical sequences.
Approach: They propose a framework to mitigate attention dispersion by strategically inserting separator tokens into the model to recalibrat attention to local segments while preserving global context.
Outcome: The proposed framework improves accuracy and reduces inference token consumption by 16.4% on 9 widely-adopted LLMs.
Mutual Exclusivity Training and Primitive Augmentation to Induce Compositionality (2022.emnlp-main)

Copied to clipboard

Challenge: Recent datasets expose the lack of systematic generalization ability in standard sequence-to-sequence models.
Approach: They propose two techniques to address the lack of systematic generalization ability in standard sequence-to-sequence models by mutual exclusivity training and prim2primX data augmentation.
Outcome: The proposed methods improve on two widely-used compositionality datasets.
G3R: A Graph-Guided Generate-and-Rerank Framework for Complex and Cross-domain Text-to-SQL Generation (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches to complex and cross-domain Text-to-SQL generation lack domain knowledge . domain knowledge is not incorporated to enhance their ability to generalise to unseen databases.
Approach: They propose a framework called G3R for complex and cross-domain Text-to-SQL generation . they propose re-ranking SQL queries based on domain knowledge and a graph-guided SQL generator .
Outcome: The proposed framework achieves state-of-the-art results on the Spider and Spider-DK benchmarks.
Event-Centric Query Expansion in Web Search (2023.acl-industry)

Copied to clipboard

Challenge: Existing studies rely on long-term search log mining to improve search experience . EQE system is a novel event retrieval framework that can select the best expansion from a significant amount of potential events quickly and accurately.
Approach: They propose a QE system that uses a four-stage event retrieval framework . they collect news headlines and then refine a dual-tower semantic model to serve as an encoder .
Outcome: The proposed system can select the best expansion from a significant amount of potential events quickly and accurately.
GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models (2023.eacl-main)

Copied to clipboard

Challenge: Recent work aimed to improve task performance of large language models by rewriting or tuning them manually, but manual rewrite is time-consuming and requires subjective interpretation.
Approach: They propose a gradient-free, edit-based search approach for improving task instructions for large language models.
Outcome: The proposed approach outperforms manual rewriting and purely example-based prompts while allowing for API-based tuning.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations