Papers by Xiang Yu

92 papers
Noise-robust Cross-modal Interactive Learning with Text2Image Mask for Multi-modal Neural Machine Translation (2022.coling-1)

Copied to clipboard

Challenge: Existing studies on multi-modal neural machine translation focus on visual information, but text and image may not match exactly, and visual noise is often ignored.
Approach: They propose a noise-robust multi-modal interactive fusion approach with cross-modal relation-aware mask mechanism for MNMT.
Outcome: The proposed model achieves state-of-the-art scores in all En-De, En-Fr and En-Cs translation tasks.
Annotations Are Not All You Need: A Cross-modal Knowledge Transfer Network for Unsupervised Temporal Sentence Grounding (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing work on temporal sentence grounding rely on expensive video-query paired annotations . despite this, there are no ground-truth annotations in the current work .
Approach: They propose to use paired video-query and segment boundary annotations to generate temporal sentence grounding without training.
Outcome: The proposed model outperforms existing unsupervised methods and beats supervised ones on two challenging datasets.
Doc-React: Multi-page Heterogeneous Document Question-answering (2025.acl-short)

Copied to clipboard

Challenge: Existing methods for integrating information across multiple modalities are suboptimal for multi-page, multimodal documents.
Approach: They propose an adaptive iterative framework that balances information gain and uncertainty reduction at each step.
Outcome: The proposed framework captures relevant multimodal content and achieves strong performance on complex QA tasks.
ReasonBERT: Pre-trained to Reason with Distant Supervision (2021.emnlp-main)

Copied to clipboard

Challenge: Existing pre-training methods only harvest learning signals from local contexts of naturally occurring texts . ReasonBert provides a method for reasoning over long-range relations and multiple, possibly hybrid contexts.
Approach: They propose a method that augments language models with the ability to reason over long-range relations and multiple, possibly hybrid contexts.
Outcome: The proposed method significantly improves sample efficiency over strong baselines.
Explainable Chain-of-Thought Reasoning: An Empirical Analysis on State-Aware Reasoning Dynamics (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in chain-of-thought prompting have demonstrated the ability of large language models to perform multi-step reasoning.
Approach: They propose a framework to analyze latent dynamics of CoT trajectories for interpretability . they segment generated CoT into discrete reasoning steps and abstract each step into a spectral embedding based on token-level Gram matrices .
Outcome: The proposed framework segments generated CoT steps into discrete reasoning steps, abstracts each step into a spectral embedding based on token-level Gram matrices, and clusters these embeddements into semantically meaningful latent states.
I2E: From Image Pixels to Actionable Interactive Environments for Text-Guided Image Editing (2026.acl-long)

Copied to clipboard

Challenge: Existing text-guided image editing methods rely on end-to-end pixel-level inpainting paradigm . existing models lack such intermediate representations and Reasoning-then-action process .
Approach: They propose a "Decompose-then-Action" paradigm that revisits image editing as an actionable interaction process within a structured environment.
Outcome: The proposed paradigm outperforms existing methods in compositional editing tasks.
SafeSteer: A Decoding-level Defense Mechanism for Multimodal Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing defense methods rely on fine-tuning or inefficient post-hoc interventions, limiting their ability to address novel attacks.
Approach: They propose a decoding-level defense mechanism that employs a lightweight discriminator to iteratively steer the decoding process toward safety.
Outcome: The proposed method improves safety performance by up to 33.40% without fine-tuning on multiple MLLMs.
C-MORE: Pretraining to Answer Open-Domain Questions by Consulting Millions of References (2022.acl-short)

Copied to clipboard

Challenge: Existing approaches to pretrain open-domain question answering systems lack task-specific annotations.
Approach: They propose to pretrain a two-stage open-domain question answering system with strong transfer capabilities by using a dictionary and a large-scale corpus.
Outcome: The proposed approach leads to 2%-10% gains in top-20 accuracy and improves with reader.
Title2Event: Benchmarking Open Event Extraction with a Large-scale Chinese Title Dataset (2022.emnlp-main)

Copied to clipboard

Challenge: Existing EE datasets define fixed event types and design specific schemas for each of them, failing to cover diverse events emerging from the online text.
Approach: They propose to use a sentence-level dataset to benchmark Open Event Extraction without restricting event types.
Outcome: The proposed dataset contains more than 42,000 news titles in 34 topics collected from Chinese web pages.
CLiMP: A Benchmark for Chinese Language Model Evaluation (2021.eacl-main)

Copied to clipboard

Challenge: Linguistically informed analyses of language models (LMs) contribute to understanding and improvement of such models.
Approach: They introduce a corpus of Chinese linguistic minimal pairs (CLiMP) to investigate what knowledge Chinese LMs acquire.
Outcome: The proposed corpus of Chinese linguistic minimal pairs (CLiMP) covers 9 major Chinese linguist phenomena.
Benchmarking and Improving Large Vision-Language Models for Fundamental Visual Graph Understanding and Reasoning (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for enhancing understanding and reasoning abilities in graphbased tasks focus on specific graph types or tasks, posing challenges in designing versatile systems suitable for various tasks and graphs across diverse domains.
Approach: They propose a structure-aware fine-tuning framework to enhance LVLMs with structure learning abilities through three self-supervised learning tasks.
Outcome: Extensive evaluations on 14 LVLMs reveal that LVLs are weak in basic graph understanding and reasoning tasks, particularly those concerning relational or structurally complex information.
PrinciplismQA: A Philosophy-Grounded Approach to Assessing LLM-Human Clinical Medical Ethics Alignment (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks lack systematic approaches to integrate philosophical frameworks and expert validation for ethical reasoning assessment.
Approach: They propose a philosophy-grounded approach to assess medical ethics alignment . PrinciplismQA comprises 3,648 expert-validated questions spanning knowledge assessment and clinical reasoning .
Outcome: PrinciplismQA provides a philosophy-grounded approach to assessing medical ethics alignment.
Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysis (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to review scientific papers are limited by their content or quality . SEA is a framework for automated scientific review, but its contents are generic or partial.
Approach: They propose a framework for automated scientific review using large language models . they propose to use a standardized review dataset to fine-tune an LLM to generate high-quality reviews.
Outcome: The proposed framework can generate high-quality reviews from standardized datasets and improves on the existing feedback mechanisms.
Self-Supervised Prompt Optimization (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing prompt optimization methods rely heavily on external references such as ground truth or by humans, limiting their applicability in real-world scenarios where such data is unavailable or costly to obtain.
Approach: They propose a cost-efficient framework that discovers effective prompts for both closed and open-ended tasks without external reference.
Outcome: The proposed framework outperforms state-of-the-art prompt optimization methods with significantly lower costs and fewer samples.
Rethinking the Evaluation of In-Context Learning for LLMs (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies evaluate In-context learning methods based on task performance . however, this evaluation protocol overlooks the significant cost associated with the demonstration configuration process .
Approach: They propose a two-dimensional evaluation paradigm that considers both configuration costs and task performance.
Outcome: The proposed evaluation paradigm can be applied to any ICL method as a plugin.
Gradient-guided Attention Map Editing: Towards Efficient Contextual Hallucination Mitigation (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) often experience “contextual hallucination” where they prioritize self-generated content over input context, leading to a disregard for pertinent details.
Approach: They propose a method that dynamically adjusts attention maps to enhance contextual relevance by using a trained classifier to identify attention maps likely to induce hallucinations.
Outcome: The proposed approach reduces hallucinations across open-source models on summarization and open-book QA tasks.
Controllable Contrastive Generation for Multilingual Biomedical Entity Linking (2023.emnlp-main)

Copied to clipboard

Challenge: Multilingual biomedical entity linking (MBEL) aims to map language-specific mentions in biomedically text to standardized concepts in a multilingual knowledge base (KB).
Approach: They propose a prompt-based controllable contrastive generation framework for MBEL which summarizes multidimensional information of the UMLS concept mentioned in biomedical text into a natural sentence following a predefined template.
Outcome: The proposed framework matches against UMLS concepts in as many languages and types as possible, thus facilitating cross-information disambiguation.
KidsArtBench: Multi-Dimensional Children’s Art Evaluation with Attribute-Aware MLLMs (2026.eacl-long)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) show impressive capabilities across visual–language tasks, but their capacity to evaluate artistic expression remains limited.
Approach: They propose an attribute-specific multi-LoRA approach where each attribute corresponds to a distinct evaluation dimension in the scoring rubric.
Outcome: The proposed approach increases correlation from 0.468 to 0.653 on Qwen2.5-VL-7B, with the largest gains on perceptual dimensions and narrowed gaps on higher-order attributes.
LayoutDIT: Layout-Aware End-to-End Document Image Translation with Multi-Step Conductive Decoder (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods struggle to capture the visual layout in complex document images.
Approach: They propose to integrate layout knowledge into document image translation by using a layout-aware encoder and a multi-step conductive decoder to achieve the translation step by step.
Outcome: The proposed model outperforms state-of-the-art methods with better parameter efficiency.
From Selection to Generation: A Survey of LLM-based Active Learning (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have been used for selection and training of data for active learning.
Approach: They propose an intuitive taxonomy that categorizes LLM-based active learning techniques and discuss the transformative roles they can play in the active learning loop.
Outcome: The proposed model can generate entirely new data instances and provide more cost-effective annotations with fewer labeled data instances.
RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks focus on character-centric approach and fail to reflect real-world applications.
Approach: RMTBench is a user-centric bilingual role-playing benchmark featuring 80 diverse characters and over 8,000 dialogue rounds.
Outcome: RMTBench features 80 diverse characters and over 8,000 dialogue rounds.
Reasoning-Enhanced Domain-Adaptive Pretraining of Multimodal Large Language Models for Short Video Content Governance (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing approaches to identifying inappropriate content require extensive human-labeled data and lack cross-issue generalization.
Approach: They propose a reasoning-enhanced multimodal large language model (MLLM) pretraining paradigm for unified inappropriate content detection.
Outcome: The proposed model improves the MLLM's performance in both zero-shot and supervised fine-tuning settings and shows strong generalization capabilities to emergent, previously unseen issues.
NOVA: An Iterative Planning Framework for Enhancing Scientific Innovation with Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to generate research ideas rely on retrieval or prompt engineering to generate ideas.
Approach: They propose a method that uses iterative planning and search to boost creative potential of LLMs by integrating external knowledge with broader and deeper insights.
Outcome: The proposed method outperforms the current state-of-the-art in generating 2.5 times more top-rated ideas based on 170 seed papers in a Swiss Tournament evaluation.
HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworks (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches treat instruction-based text editing as a generic text generation problem. Existing methods either over-edit or fail to apply modifications consistently.
Approach: They propose a framework that processes each editing request to best align with it.
Outcome: The proposed framework achieves 9% improvement over the state-of-the-art model.
HuatuoGPT, Towards Taming Language Model to Be a Doctor (2023.findings-emnlp)

Copied to clipboard

Challenge: Experimental results show that the distilled language model outperforms its teacher model (ChatGPT) in most cases.
Approach: They propose a Large Language Model (LLM) that leverages both distilled data from **ChatGPT** and real-world data from**doctors** in the supervised fine-tuning stage.
Outcome: The proposed model outperforms the teacher model in most cases by using additional real-world data and RLMF to align the language model with the merits of both sources.
Knowledge Graph Enhanced Neural Machine Translation via Multi-task Learning on Sub-entity Granularity (2020.coling-main)

Copied to clipboard

Challenge: Existing methods to integrate knowledge graph (KG) with neural machine translation (NMT) have two problems: knowledge under-utilization and granularity mismatch.
Approach: They propose a multi-task learning method on sub-entity granularity to combine machine translation and knowledge reasoning tasks.
Outcome: The proposed method significantly outperforms baseline models on translation tasks and handling the entities.
MADS: Multi-Agent Dialogue Simulation for Diverse Persuasion Data Generation (2025.emnlp-industry)

Copied to clipboard

Challenge: Recent studies show that LLM-based agents exhibit superior moral and emotional language performance compared to humans, raising expectations for their deployment in persuasive tasks.
Approach: They propose a framework for generating persuasive multi-turn dialogues via agent self-play using user agents designed to simulate diverse persona-driven behaviors, a Dialog Agent executing task-oriented persuasion strategies and an Optimization Agent evaluating and refining dialogue outcomes.
Outcome: The proposed framework significantly improved the persuasion capacity of small LLMs, increasing the organic traffic conversion rate by 22.4% (from 1.83% to 2.24%) .
APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical Reasoning (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to improve logical reasoning skills require complex data processing.
Approach: They propose an adaptive pretraining approach to improve logical reasoning over text . they use a subset of Wikipedia sentences for pretraining and a sentence-level classification loss .
Outcome: The proposed model outperforms baselines on LogiQA and ReClor.
Beyond Chain-of-Thought: A Survey of Chain-of-X Paradigms for LLMs (2025.coling-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown impressive reasoning abilities when prompted with Chain-of-Thought (CoT).
Approach: They propose to categorize Chain-of-X methods by taxonomies of nodes, i.e., the X in CoX, and application tasks, and then categorise them by taxanomies and discuss potential future directions.
Outcome: The proposed methods are categorised by taxonomies of nodes, i.e., the X in CoX, and application tasks.
A Knowledge-driven Generative Model for Multi-implication Chinese Medical Procedure Entity Normalization (2020.emnlp-main)

Copied to clipboard

Challenge: Medical entity normalization (NEN) is a task that links medical mentions to entities in knowledge bases.
Approach: They propose a sequence generative framework to generate Chinese medical procedure entity normalization by constraint decoding and category-based model refining.
Outcome: The proposed model improves on baselines especially in the case of multi-implication Chinese medical procedures.
Training Language Model to Critique for Better Refinement (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have remarkable evaluation and critique capabilities, providing insightful feedback and identifying flaws in various tasks.
Approach: They propose a framework to train critic models using refinement signals to generate feedback loops where critiques guide the model in refining its responses.
Outcome: The proposed framework outperforms traditional methods and open-source models in terms of critique quality and refinement outcomes.
A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Models (2022.acl-long)

Copied to clipboard

Challenge: Recent few-shot learning models such as GPT3 are expensive and slow to deploy for real-world applications.
Approach: They propose a prompt-based low-resource learning method for VL tasks with a few examples . they pre-train a sequence-to-sequence transformer model with prefix and masked language modeling .
Outcome: The proposed method outperforms Frozen on vision-language tasks with prompt-based learning by 18.2% point.
Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods address few-shot intent detection tasks from two perspectives: data augmentation and task-adaptive training with pre-trained models.
Approach: They propose a few-shot intent detection schema using contrastive pre-training and fine-tuning.
Outcome: The proposed method achieves state-of-the-art performance on three challenging intent detection datasets under 5-shot and 10-shot settings.
Multilingual Generative Retrieval via Cross-lingual Semantic Compression (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for multilingual retrieval still face cross-lingual identifier misalignment and identifiere inflation.
Approach: They propose a framework that unifies semantically equivalent multilingual keywords into shared atoms to align semantics and compresses the identifier space.
Outcome: The proposed framework improves cross-lingual alignment and reduces redundancy.
START: Self-taught Reasoner with Tools (2025.emnlp-main)

Copied to clipboard

Challenge: Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in complex reasoning through long chain-of-thought, yet they struggle with precise computations and algorithmic operations.
Approach: They propose a training-free approach that activates LRMs’ latent tool-use capabilities through artificial hints and a framework that enables models to learn effective tool utilization through diverse hint patterns and rejection-based data synthesis.
Outcome: Experiments show that START significantly improves state-of-the-art LRMs across challenging benchmarks, including competition-level mathematics (AMC23: 95.0%, AIME24: 75.6%) and graduate-level science questions (GPQA: 64.6%).
Self Question-answering: Aspect-based Sentiment Analysis by Role Flipped Machine Reading Comprehension (2021.findings-emnlp)

Copied to clipboard

Challenge: unified Aspect-based Sentiment Analysis (ABSA) aims to couple aspect terms with their corresponding opinion terms, which might make it easier to predict sentiment polarities.
Approach: They propose a new paradigm to pair aspect terms with their corresponding opinion terms . they propose to use a machine learning paradigm to solve the unified ABSA task .
Outcome: The proposed framework can solve the ABSA task without any additional data annotation or transformation.
Improved Pseudo Data for Machine Translation Quality Estimation with Constrained Beam Search (2023.emnlp-main)

Copied to clipboard

Challenge: evaluating the quality of machine translation outputs becomes increasingly essential with the rapid development of machine language (MT).
Approach: They propose to generate pseudo data using the MT model with constrained beam search (CBSQE) they propose to preserve the reference parts with high MT probabilities as correct translations .
Outcome: The proposed model outperforms strong baselines in both supervised and unsupervised settings.
Interactive Key-Value Memory-augmented Attention for Image Paragraph Captioning (2020.coling-main)

Copied to clipboard

Challenge: Existing approaches to image paragraph captioning ignore the past alignment information, resulting in repetitive captioning and incomplete captioning.
Approach: They propose an Interactive key-value Memory-augmented Attention model for image paragraph captioning to keep track of attention history along with update-chain of decoder state.
Outcome: Extensive experiments on a benchmark dataset demonstrate the effectiveness of the proposed model.
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population (2022.emnlp-demos)

Copied to clipboard

Challenge: Existing knowledge extraction tools are not complete due to emerging entities and relations in real-world applications.
Approach: They propose an open-source knowledge extraction toolkit DeepKE that supports low-resource, document-level and multimodal scenarios in the knowledge base population.
Outcome: The proposed toolkit supports low-resource, document-level and multimodal scenarios in the knowledge base population.
ReSel: N-ary Relation Extraction from Scientific Text and Tables by Learning to Retrieve and Select (2022.emnlp-main)

Copied to clipboard

Challenge: Our proposed method extracts N-ary relation tuples from scientific articles.
Approach: They propose a method that decomposes the task into two stages . they propose modal query and modal entity selection . their results show that ReSel outperforms state-of-the-art baselines significantly .
Outcome: The proposed method outperforms state-of-the-art baselines on three scientific information extraction datasets.
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications.
Approach: They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions.
Outcome: The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions.
DPN-LE: Dual Personality Neuron Localization and Editing for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Current methods for editing personality traits in large language models can change personalities but reduce performance.
Approach: They propose a novel paradigm for personality editing that locates and edits LLM neurons and enables competitive personality control at inference time.
Outcome: Experiments on LLaMA-3-8B-Instruct and Qwen2.5-7B-instruct show that the proposed approach can improve performance and improve performance.
Text Detoxification: Data Efficiency, Semantic Preservation and Model Generalization (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for detoxification of text often rely on manually annotated data . xiangli: "detoxification of texts is a powerful way to remove toxic content"
Approach: They propose a reinforcement learning framework that optimizes detoxification and semantic preservation without annotating large amounts of data.
Outcome: The proposed method overcomes major limitations and surpasses humanannotated references across multiple benchmarks.
MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in multimodal large language models have led to progress in tackling complex reasoning tasks that combine textual and visual information.
Approach: They introduce a robust version of the Massive Multi-discipline Multimodal Understanding and Reasoning (MMMU) benchmark.
Outcome: The proposed model performs lower on MMMU-Pro than on the previous benchmark, ranging from 16.8% to 26.9%.
Low Resource Style Transfer via Domain Adaptive Meta Learning (2022.naacl-main)

Copied to clipboard

Challenge: Existing unsupervised text style transfer methods suffer from performance degradation when fine-tuning the model in new domains.
Approach: They propose a domain adaptive meta-learning approach with an adversarial style training approach for better content preservation and style transfer.
Outcome: The proposed approach generalizes well on unseen low-resource domains against ten strong baselines.
A Query-Response Framework for Whole-Page Complex-Layout Document Image Translation with Relevant Regional Concentration (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for document image translation rely on the vanilla encoder-decoder paradigm . a novel dynamic aggregation mechanism is designed to enhance the text semantics in query features toward translation.
Approach: They propose a Query-Response DIT framework that reformulates the DIT task into a parallel response/translation process of multiple queries.
Outcome: The proposed framework improves translation quality on four translation directions on three benchmarks.
How do autoregressive transformers solve full addition? (2025.emnlp-main)

Copied to clipboard

Challenge: Large pre-trained language models have demonstrated impressive capabilities, but there is still much to learn about how they operate.
Approach: They investigate the ability of the autoregressive transformer to perform basic addition operations by using causal analysis to find that a few different attention heads in the middle layers control the addition carry . they found that due to the lack of global focus on the sequence within these attention heads, the model struggles to handle long-sequence addition tasks.
Outcome: The model performs basic addition tasks, but it still faces challenges with length generalization.
Don’t Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environments (2023.acl-long)

Copied to clipboard

Challenge: Existing language models lack grounding to real-world environments . a missing piece is the connection between LMs and the environment .
Approach: They propose a generic framework for grounded language understanding that capitalizes on discriminative ability of LMs instead of their generative ability.
Outcome: The proposed framework capitalizes on discriminative ability of LMs instead of their generative ability.
Linking Knowledge to Care: Knowledge Graph-Augmented Medical Follow-Up Question Generation (2026.findings-eacl)

Copied to clipboard

Challenge: Existing large language models (LLMs) fail to identify information gaps across diverse symptoms.
Approach: They propose a Knowledge Graph-augmented LLM with active in-context learning to generate relevant and important follow-up questions.
Outcome: The proposed framework outperforms state-of-the-art methods by 5% - 8% on relevant benchmarks.
IPS: In-Prompt Process Supervision for Short Video Content Moderation (2026.acl-industry)

Copied to clipboard

Challenge: Multimodal large language models (MLLMs) capture semantics of short video content but fail to account for policy-specific details.
Approach: They propose a framework that integrates In-prompt Process Supervision into MLLMs . they propose sequential reasoning over ancillary questions during fine-tuning .
Outcome: IPS outperforms baseline MLLMs on public and proprietary benchmarks . replacing human-annotated ancillary labels with MLML-generated ones results in performance degradation.
Skill Discovery for Software Scripting Automation via Offline Simulations with LLMs (2026.findings-eacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) can generate code from natural language queries, but runtime code generation is limited due to unverified code, security risks, longer response times, and higher computational costs.
Approach: They propose an offline simulation framework to curate a software-specific skillset by exploiting large language models and publicly available scripting guides.
Outcome: The proposed framework significantly improves automation success rates, reduces response time, and saves runtime token costs compared to traditional runtime code generation.
Single-to-mix Modality Alignment with Multimodal Large Language Model for Document Image Machine Translation (2025.acl-long)

Copied to clipboard

Challenge: Document Image Machine Translation (DIMT) faces generalization challenges due to limited training data and the complex interplay between visual and textual information.
Approach: They propose a single-to-mix Modality alignment framework leveraging Multimodal Large Language Models (MLLMs) this framework aligns an imageonly encoder with multimodal representations of an MLLM pre-trained on large-scale document image datasets.
Outcome: The proposed framework improves translation quality in cross-domain generalization and challenging document image scenarios.
Knowledge-Augmented Methods for Natural Language Processing (2022.acl-tutorials)

Copied to clipboard

Challenge: Knowledge in natural language processing (NLP) is a rising trend especially after the advent of large scale pre-trained models.
Approach: This tutorial introduces the key steps in integrating knowledge into natural language processing (NLP) it introduces knowledge grounding from text, knowledge representation and fusing.
Outcome: This tutorial introduces the key steps in integrating knowledge into natural language processing including knowledge grounding from text, knowledge representation and fusing.
Self-Steering Optimization: Autonomous Preference Optimization for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Prior research focused on developing data generation methods, while insufficient attention has been paid to quality control mechanisms and often produces inaccurate and unhelpful data.
Approach: They propose an algorithm that automatically generates high-quality preference data, eliminating manual annotation requirements.
Outcome: The proposed algorithm outperforms baselines in human preference alignment and reward optimization.
The UIR Uncertainty Corpus for Chinese: Annotating Chinese Microblog Corpus for Uncertainty Identification from Social Media (L18-1)

Copied to clipboard

Challenge: Uncertainty identification is an important semantic processing task, critical to the quality of information in terms of factuality in many NLP techniques and applications.
Approach: They propose to annotate Chinese microblogs with an open uncertainty corpus . they propose to use contextual uncertain semantics rather than traditional cue-phrases to identify uncertainty .
Outcome: The proposed corpus can be used to identify uncertainty in social media texts.
Document Image Machine Translation with Dynamic Multi-pre-trained Models Assembling (2024.naacl-long)

Copied to clipboard

Challenge: Existing TIMT tasks focus on text-line-level images.
Approach: They propose to extend the existing TIMT task and introduce a new framework to translate a source document image to markdown-formatted target translation.
Outcome: The proposed task aims to translate a source document image with long context and complex layout structure to markdown-formatted target translation.
TaxoClass: Hierarchical Multi-Label Text Classification Using Only Class Names (2021.naacl-main)

Copied to clipboard

Challenge: Hierarchical multi-label text classification (HMTC) aims to assign each text document to a set of relevant classes from a taxonomy.
Approach: They propose to conduct HMTC based on only class surface names as supervision signals to mimic human experts.
Outcome: The proposed framework outperforms the best existing method by 25% on two challenging datasets.
Fast and Accurate Non-Projective Dependency Tree Linearization (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for decoding dependency trees are 10 times faster than current ones.
Approach: They propose a graph-based method to tackle a dependency tree linearization task . they propose to solve a Traveling Salesman Problem and combine the solution into a projective tree .
Outcome: The proposed method outperforms the state-of-the-art linearizer while being 10 times faster in training and decoding.
FaD-VLP: Fashion Vision-and-Language Pre-training towards Unified Retrieval and Captioning (2022.emnlp-main)

Copied to clipboard

Challenge: Prior work on multimodal fashion tasks has been limited by the data in individual benchmarks or has leveraged generic vision-and-language pre-training but have not taken advantage of the characteristics of fashion data.
Approach: They propose a fashion-specific pre-training framework based on weakly-supervised triplets constructed from fashion image-text pairs.
Outcome: The proposed framework is based on weakly-supervised triplets constructed from fashion image-text pairs and is competitive on a diverse set of fashion tasks.
CSDS: A Fine-Grained Chinese Dataset for Customer Service Dialogue Summarization (2021.emnlp-main)

Copied to clipboard

Challenge: Existing summarization methods are prone to generate redundant and incoherent summaries, causing the performance to be worse.
Approach: They propose a Chinese dataset for Customer Service Dialogue Summarization (CSDS) that provides role-oriented summaries to acquire different speakers' viewpoints.
Outcome: The proposed dataset improves the abstractive summaries in two aspects . it also provides role-oriented summary to acquire different speakers’ viewpoints .
STAF: Pushing the Boundaries of Test-Time Adaptation towards Practical Noise Scenarios (2024.lrec-main)

Copied to clipboard

Challenge: Pre-trained language models have demonstrated superior performance on NLP tasks . however, when the training domain and testing domain are taken from different distributions, the deployed model often violates this assumption.
Approach: They propose a Stable Test-time Adaptation Framework to stabilize the adaptation process.
Outcome: The proposed framework boosts model robustness to noise distribution shifts while minimizing error accumulation and catastrophic forgetting.
Making Better Use of Training Corpus: Retrieval-based Aspect Sentiment Triplet Extraction via Label Interpolation (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods to extract sentimental triplets are infeasible and counterproductive . aspect Sentiment Triplets Extraction (ASTE) task is an emerging sub-task of Aspect-based Sentimence Analysis .
Approach: They propose a retrieval-based approach to the Aspect Sentiment Triplet Extraction task . they retrieve semantic similar triplets from the training corpus and interpolate their label information .
Outcome: The proposed approach establishes a new state-of-the-art on the Aspect Sentiment Triplet Extraction task.
GRPO-Guided Modality Selection Enhanced LoRA-Tuned LLMs for Multimodal Emotion Recognition (2025.findings-emnlp)

Copied to clipboard

Challenge: Multimodal emotion recognition in conversation (MERC) aims to identify speakers’ emotional states by utilizing text, audio, and visual modalities.
Approach: They propose an adaptive modality selection framework for multimodal emotion recognition in conversation that integrates all available modalities into one .
Outcome: The proposed framework outperforms existing methods on multimodal dialogue datasets and is available at https://github.com/youflyaway/Modality-Selection-Enhanced-LoRA-Tuned-LLMs.
Retrieval-Augmented Few-shot Text Classification (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for retrieval-augmented text classification are successful in the few-shot scenario with limited retrieval space.
Approach: They propose to use EM-L and R-L to provide task-specific guidance to retrieval metric . they also propose to incorporate retrieved memory alongside parameters for better generalization .
Outcome: The proposed methods perform better on the few-shot scenario with limited retrieval space.
Symbolic Chain-of-Thought Distillation: Small Models Can Also “Think” Step-by-Step (2023.acl-long)

Copied to clipboard

Challenge: Symbolic Chain-of-thought Distillation (SCoTD) is a method to train a smaller student model on rationalizations sampled from a significantly larger teacher model.
Approach: They propose a method to train a smaller student model on rationalizations from a larger teacher model.
Outcome: The proposed method improves the performance of a student model in supervised and few-shot settings and especially for challenge sets.
Making Flexible Use of Subtasks: A Multiplex Interaction Network for Unified Aspect-based Sentiment Analysis (2021.findings-acl)

Copied to clipboard

Challenge: Existing studies aim to integrate multiple sub-tasks into a unified ABSA model but suffer from major disadvantages .
Approach: They propose a multi-task learning approach to make use of sub-tasks for a unified ABSA.
Outcome: The proposed model can work well when some sub-tasks are absent, and the interactive relations among subtasks not adequate.
Automatic Evaluation of Attribution by Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Generative large language models (LLMs) incorporate external references to generate and support claims. however, evaluating the attribution remains an open problem.
Approach: They investigate automatic evaluation of attribution given by large language models . they define different types of attributed errors and then explore two approaches .
Outcome: The proposed methods highlight promising signals and challenges.
CoMMIT: Coordinated Multimodal Instruction Tuning (2025.emnlp-main)

Copied to clipboard

Challenge: et al., 2024) show that multimodal instruction tuning is more effective than baselines.
Approach: They propose a multimodal balance coefficient that enables quantitative measurement of the balance of learning . they propose auxiliary regularization on the gradient to promote updating with larger step sizes .
Outcome: The proposed method is more effective than baselines in MLLM instruction tuning.
Towards Robust Temporal Activity Localization Learning with Noisy Labels (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for temporal activity localization are expensive and difficult to satisfy due to subjective labeling.
Approach: They propose a new TAL setting where a TAL model should be robust to mixed training data with noisy moment boundaries.
Outcome: The proposed method is significantly more robust to noisy training data than existing methods.
Other Roles Matter! Enhancing Role-Oriented Dialogue Summarization via Role Interactions (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for role-oriented dialogue summarization ignore information from other roles, resulting in omitted information.
Approach: They propose a novel method that uses cross attention and decoder self-attention interactions to acquire other roles' critical information.
Outcome: The proposed method significantly outperforms baselines on two public role-oriented dialogue summarization datasets.
Flexibly Utilize Memory for Long-Term Conversation via a Fragment-then-Compose Framework (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models extract useful information from conversation history to enhance the response in long-term conversations.
Approach: They propose a Fragment-then-Compose framework to optimize memory utilization for long-term open-domain conversation.
Outcome: The proposed framework can be used to extract useful information from conversation history . it can be adapted to different situations and improve response generation .
Exploring Better Text Image Translation with Multimodal Codebook (2023.acl-long)

Copied to clipboard

Challenge: Current studies on text image translation face bottlenecks due to lack of a publicly available dataset and poor optical character recognition.
Approach: They propose a text image translation model with a multimodal codebook and an OCR dataset for Chinese-English translation.
Outcome: The proposed model can associate the image with relevant texts, providing useful supplementary information for translation.
From Pixels to Policies: Reinforcing Spatial Reasoning in Language Models for Content-Aware Layout Design (2026.acl-industry)

Copied to clipboard

Challenge: LaySPA equips large language models (LLMs) with explicit and interpretable spatial reasoning for content-aware graphic layout design.
Approach: They propose a reinforcement learning framework that equips large language models (LLMs) with explicit spatial reasoning for content-aware graphic layout design.
Outcome: Experiments show that LaySPA outperforms larger LLMs in structural validity and visual quality while requiring fewer annotated samples.
Improving MLLM’s Document Image Machine Translation via Synchronously Self-reviewing Its OCR Proficiency (2025.findings-acl)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) have shown strong performance in document image tasks, especially Optical Character Recognition (OCR). However, they struggle with Document Image Machine Translation (DIMT), which requires handling both cross-modal and cross-lingual challenges.
Approach: They propose a novel fine-tuning paradigm that allows the model to generate OCR text before producing translation text, which allows it to leverage its strong monolingual OCR ability while learning to translate text across languages.
Outcome: The proposed model can leverage its strong monolingual OCR ability while learning to translate text across languages.
AceGPT, Localizing Large Language Models in Arabic (2024.naacl-long)

Copied to clipboard

Challenge: Significant concerns emerge when addressing cultural sensitivity and local values.
Approach: They propose a localized Large Language Model (LLM) specifically for Arabic, a language imbued with unique cultural characteristics inadequately addressed by current mainstream models.
Outcome: The proposed model sets the state-of-the-art standard for open Arabic LLMs across various benchmarks.
Theorem-Validated Reverse Chain-of-Thought Problem Generation for Geometric Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for generating geometric reasoning data through Chain-of-Thought (CoT) frameworks face three fundamental limitations: 1) lack of high-quality annotations and domain-specific expertise to ensure theorem-grounded diagrams. 2) lack of a coherent model; 3) lack of coherent model.
Approach: They propose a two-stage Theorem-Validated Reverse Chain-of-Thought Reasoning Synthesis framework that synthesizes theorematic diagrams with structured descriptions and properties.
Outcome: The proposed framework expands theorem-type coverage, corrects misunderstandings, and enhances geometric reasoning.
Takin-VC: Expressive Zero-Shot Voice Conversion via Adaptive Hybrid Content Encoding and Enhanced Timbre Modeling (2025.acl-long)

Copied to clipboard

Challenge: Expressive zero-shot voice conversion (VC) aims to modify source timbre to match unseen speaker . existing zero- shot VC systems struggle to reproduce paralinguistic information in highly expressive speech .
Approach: They propose a framework for expressive zero-shot voice conversion that uses hybrid content encoding and memory-augmented context-aware timbre modeling.
Outcome: The proposed framework surpasses state-of-the-art VC systems in speech naturalness, speaker similarity, and speaker similarness.
Faster and Better LLMs via Latency-Aware Test-Time Scaling (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing research has overlooked the efficiency of TTS from a latency-sensitive perspective.
Approach: They propose two approaches to achieve latency-optimal TTS by branch-wise parallelism and sequence-wise parallelism.
Outcome: The proposed approach achieves latency-optimal TTS for large models . branch-wise parallelism and sequence-wise parallelism are key approaches .
IMSurReal: IMS at the Surface Realization Shared Task 2019 (D19-63)

Copied to clipboard

Challenge: a system for shallow and deep completion is presented for the Surface Realization Shared Task 2019 . the system achieves state-of-the-art performance without using external data.
Approach: They propose a surface realization system that takes five steps without external data . they perform detailed error analysis revealing correlation between word order freedom and difficulty .
Outcome: The proposed system achieves state-of-the-art without external data . it achieves highest BLEU scores on tokenized text and human evaluation on four languages .
From Chaotic OCR Words to Coherent Document: A Fine-to-Coarse Zoom-Out Network for Complex-Layout Document Image Translation (2025.coling-main)

Copied to clipboard

Challenge: Document Image Translation (DIT) aims to translate documents in images from one language to another.
Approach: They propose a novel end-to-end network called Zoom-out DIT to improve document translation by combining word positioning, sentence recognition and document organization.
Outcome: The proposed network improves word positioning, sentence recognition and document organization, and improves translation quality.
DiffER: Diffusion Entity-Relation Modeling for Reversal Curse in Diffusion Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing large language models exhibit unidirectional behavior when processing bidirectional relationships . authors propose a solution to alleviate the reversal curse in Diffusion LLMs .
Approach: They propose a model that addresses the "reversal curse" of bidirectional behavior in large language models . they propose 'entity-aware training' and balanced data construction to alleviate asymmetry and missing relations .
Outcome: The proposed model alleviates the "reversal curse" in Diffusion LLMs . the proposed model employs whole-entity masking to mitigate entity fragmentation .
EFSA: Towards Event-Level Financial Sentiment Analysis (2024.acl-long)

Copied to clipboard

Challenge: a large-scale Chinese dataset contains 12,160 news articles and 13,725 quintuples . a four-hop Chain-of-Thought LLM-based approach is devised for this task .
Approach: They propose to extend financial sentiment analysis to event-level since events usually serve as the subject of the sentiment in financial text.
Outcome: The proposed method can reach the current state-of-the-art on a large-scale Chinese dataset.
DeCoT: Debiasing Chain-of-Thought for Knowledge-Intensive Tasks in Large Language Models via Causal Intervention (2024.acl-long)

Copied to clipboard

Challenge: In large language models, external knowledge is required to augment their internal knowledge through prompts, but this does not guarantee that LLMs can identify and use relevant information in the prompts to conduct chain-of-thought reasoning.
Approach: They propose a structural causal model to formally explain the internal knowledge bias of large language models (LLMs) they review the chain-of-thought (CoT) prompting from a causal perspective and find that biased information from pretrained models can impair LLMs’ reasoning abilities.
Outcome: The proposed model enables more accurate CoT reasoning and enhances LLM generation on knowledge-intensive tasks.
MemPO: Self-Memory Policy Optimization for Long-Horizon Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for long-horizon agents introduce the external memory module and look up the relevant information from the stored memory, which prevents the model from proactively managing its memory content and aligning with the agent’s overarching task objectives.
Approach: They propose an algorithm which enables agents to autonomously manage their memory during interaction with environment and selectively retain crucial information.
Outcome: Extensive experiments show that the proposed algorithm achieves absolute F1 score gains of 25.98 over the base model and 7.1 over the previous SOTA baseline while preserving task performance.
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering (2022.acl-long)

Copied to clipboard

Challenge: Open-Domain Question Answering (ODQA) models typically include a retrieving module and a reading module.
Approach: They propose a new open-domain question-answering framework that uses a knowledge-enhanced version of FiD to improve the approach.
Outcome: The proposed model improves on ODQA benchmark datasets with less than 40% computation cost.
Real-Valued Logics for Typological Universals: Framework and Application (2020.coling-main)

Copied to clipboard

Challenge: a framework for typological statements captures the truth value of a formula on a given data source.
Approach: They propose a framework which captures the empirical truth value of a formula on a given data source.
Outcome: The proposed framework can be used to express typological statements on multilingual treebanks with comparable annotation.
Are LLMs Rational Investors? A Study on the Financial Bias in LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies on biases within specific domains, such as finance, remain limited.
Approach: They propose a framework to detect, detect, analyze and mitigate financial biases in large language models.
Outcome: The proposed framework reduces bias by 68% for the most biased model, according to key metrics.
Ideology Takes Multiple Looks: A High-Quality Dataset for Multifaceted Ideology Detection (2023.emnlp-main)

Copied to clipboard

Challenge: Existing datasets for the ID task only label a text as ideologically left- or right-leaning as a whole, regardless whether the text containing one or more different issues.
Approach: They construct an ideological schema for a multifaceted ideology detection task using MITweet and an English Twitter dataset.
Outcome: The proposed task uses a MITweet dataset with 12,594 English Twitter posts, each annotated with a Relevance and an Ideology label for all twelve facets.
R3-NL2GQL: A Model Coordination and Knowledge Graph Alignment Approach for NL2GQL (2024.findings-emnlp)

Copied to clipboard

Challenge: Adapting existing approaches for converting natural language to SQL encounters hurdles due to distinct nature of GQL compared to SQL.
Approach: They propose a method that integrates both small and large Foundation Models for ranking, rewriting, and refining tasks.
Outcome: The proposed approach integrates both small and large Foundation Models for ranking, rewriting, and refining tasks while capitalizing on the superior generalization and query generation prowess of larger models for the final transformation of natural language queries into GQL formats.
SepSeq: A Training-Free Framework for Long Numerical Sequence Processing in LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing large-scale large-context models suffer from performance degradation when processing long numerical sequences.
Approach: They propose a framework to mitigate attention dispersion by strategically inserting separator tokens into the model to recalibrat attention to local segments while preserving global context.
Outcome: The proposed framework improves accuracy and reduces inference token consumption by 16.4% on 9 widely-adopted LLMs.
Can Large Language Models Act as Ensembler for Multi-GNNs? (2025.emnlp-main)

Copied to clipboard

Challenge: Existing graph neural networks lack the inherent semantic understanding capability of rich textual attributes, limiting their effectiveness in applications.
Approach: They propose a model that integrates multiple GNNs and LLMs to provide an ensemble for multi-GNNs.
Outcome: The proposed model outperforms existing models in terms of semantic understanding of graph structures and graph structures.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations