Papers by Yang Tian

87 papers
Rethinking Data Selection at Scale: Random Selection is Almost All You Need (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing data selection techniques are designed for small data pools, a study finds . filtering data by token length is an efficient method for improving results .
Approach: They use self-scoring methods that do not rely on external help to perform fine-tuning . they also find that filtering data by token length offers a stable and efficient method .
Outcome: The proposed methods outperform random selection on large datasets on large data pools.
Towards Modern Topic Models: A Survey of Taxonomies and Paradigm Shifts from Algorithm-Centric to LLM-Centered Topic Analysis (2026.findings-acl)

Copied to clipboard

Challenge: Topic modeling (TM) is a classic unsupervised learning task in the field of natural language processing.
Approach: They propose a new taxonomy that emphasizes the role of LLMs and the design of end-to-end workflows.
Outcome: The proposed taxonomy emphasizes the role of LLMs and the design of end-to-end workflows.
Static Models, Dynamic World: A Unified Perspective on Temporal Perception in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models are trained on static corpora but deployed in a dynamic world . a foundational tension remains between time and the ability to understand it .
Approach: They formalize temporal queries in an information-theoretic framework based on parametric reachability of temporal premises and answers.
Outcome: The proposed framework formalizes temporal queries in an information-theoretic framework based on parametric reachability of temporal premises and answers . the framework induces four temporal information regimes corresponding to internal reasoning, answer recency, premise anchoring, and genuine world indeterminacy .
CriticBench: Benchmarking LLMs for Critique-Correct Reasoning (2024.findings-acl)

Copied to clipboard

Challenge: CriticBench is a benchmark designed to assess LLMs’ abilities to critique and refine their reasoning across a variety of tasks.
Approach: They propose a benchmark to assess LLMs' ability to critique and correct reasoning across a variety of tasks.
Outcome: The proposed benchmark examines the performance of 17 large language models in generation, critique, and correction reasoning.
ReviewRL: Towards Automated Scientific Review with RL (2025.emnlp-main)

Copied to clipboard

Challenge: Existing automated review systems struggle with factual accuracy, rating consistency, and analytical depth.
Approach: They propose a framework for generating comprehensive and factually grounded scientific paper reviews using supervised fine-tuning and reinforcement learning.
Outcome: The proposed framework outperforms existing methods on ICLR 2025 papers.
Learning Personalized Alignment for Evaluating Open-ended Text Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Traditional evaluation metrics rely heavily on lexical similarity with human-written references, showing poor correlation with human judgments and failing to account for alignment with the diversity of human preferences.
Approach: They propose an interpretable evaluation framework that evaluates alignment with specific human preferences by providing detailed comments and fine-grained scoring.
Outcome: The proposed framework outperforms GPT-4 in Kendall correlation and accuracy with zero-shot reviewers.
Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have been used for general-purpose interfaces across multiple tasks and languages.
Approach: They propose to use large language models as a general-purpose interface across multiple tasks and languages.
Outcome: The proposed model performs better on 200K hours of 6-language data for voice generation applications.
ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Currently, tool-augmented large language models (LLMs) only achieve total scores of 45.3 and 37.0, respectively, on a scale of 100.
Approach: They propose a multi-level diagnostic process to assess the LLM's hallucinations through two perspectives: depth and breadth.
Outcome: The proposed diagnostic process assesses the hallucinations of large language models through two perspectives: depth and breadth.
SafeSteer: A Decoding-level Defense Mechanism for Multimodal Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing defense methods rely on fine-tuning or inefficient post-hoc interventions, limiting their ability to address novel attacks.
Approach: They propose a decoding-level defense mechanism that employs a lightweight discriminator to iteratively steer the decoding process toward safety.
Outcome: The proposed method improves safety performance by up to 33.40% without fine-tuning on multiple MLLMs.
Learning a Multi-Domain Curriculum for Neural Machine Translation (2020.acl-main)

Copied to clipboard

Challenge: Existing data selection methods do not work well for multiple domains . multiple aspects need to be considered for training a multi-domain model .
Approach: They propose a dynamic data selection method to multi-domain NMT that incorporates instance-level domain-relevance features and a curriculum to gradually focus on multi- domain relevant data batches.
Outcome: The proposed model outperforms no-curriculum training on multiple domains and reaches or outperformed individual performance.
Visual Evidence Prompting Mitigates Hallucinations in Large Vision-Language Models (2025.acl-long)

Copied to clipboard

Challenge: LVLMs have shown impressive progress by integrating visual perception with linguistic understanding to produce contextually grounded outputs.
Approach: They propose a visual evidence prompting method to mitigate hallucinations in large vision-language models by using small visual models to complement them.
Outcome: The proposed method reduces hallucinations by reducing false activation and enhancing correct ones.
ALDEN: Reinforcement Learning for Active Navigation and Evidence Gathering in Long Documents (2026.acl-long)

Copied to clipboard

Challenge: Visually rich documents (VRDs) combine text, tables, and figures within complex, semantically structured layouts.
Approach: They propose a multi-turn reinforcement learning framework that fine-tunes VLMs as interactive agents capable of actively navigating long, visually rich documents.
Outcome: The proposed framework achieves state-of-the-art on five long-document benchmarks.
An Iterative Emotion Interaction Network for Emotion Recognition in Conversations (2020.coling-main)

Copied to clipboard

Challenge: Emotion recognition in conversations (ERC) is a task that aims to recognize the emotion of each utterance in conversations.
Approach: They propose an iterative emotion interaction network which uses iterativly predicted emotion labels instead of gold emotion labels to explicitly model the emotion interaction.
Outcome: The proposed method retains state-of-the-art performance on two datasets and achieves high accuracy.
AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning (2025.emnlp-demos)

Copied to clipboard

Challenge: Large language model agents have enabled GUI-based automation, but their deployment is limited by noisy data, poor generalization, and lack of support for non-English GUIs.
Approach: They propose an 8B-parameter GUI agent built for robust and efficient on-device GUI interaction.
Outcome: The proposed GUI agent achieves promising performance on five public benchmarks and proposed Chinese benchmark CAGUI.
Multi-Agent Collaboration via Cross-Team Orchestration (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have significantly impacted various domains, especially through organized LLM-driven autonomous agents.
Approach: They propose a framework that enables orchestrated teams to jointly propose various task-oriented solutions and interact with their insights in a self-independence while cross-team collaboration environment for superior solutions generation.
Outcome: Experiments show that the framework can generate better software quality compared to state-of-the-art frameworks.
Amphista: Bi-directional Multi-head Decoding for Accelerating LLM Inference (2025.naacl-long)

Copied to clipboard

Challenge: Existing methods such as Medusa lack adequate information interaction between different drafting heads.
Approach: They propose an enhanced speculative decoding framework that builds upon Medusa and integrates a drafting block capable of parallel inference.
Outcome: The proposed framework outperforms Medusa in terms of head accuracy and latency.
Towards Database-Free Text-to-SQL Evaluation: A Graph-Based Metric for Functional Correctness (2025.coling-main)

Copied to clipboard

Challenge: Existing metrics for evaluating functional correctness of SQL queries are prone to false positives due to inadequately prepared test databases.
Approach: They propose a graph-based metric that uses a relational operator tree to extract rich semantic information from the logical execution plan of SQL queries and embed it into a diagram.
Outcome: The proposed method eliminates the need for extensive test database preparation and performs graph matching on unseen SQL queries.
FLAT-LLM: Fine-grained Low-rank Activation Space Transformation for Large Language Model Compression (2026.findings-eacl)

Copied to clipboard

Challenge: Low-rank decomposition methods suffer from accuracy degradation and expensive calibration procedures.
Approach: They propose a fast and accurate, training-free structural compression method based on fine-grained low-rank transformations in the activation space.
Outcome: The proposed method outperforms pruning baselines in generalization and downstream performance while delivering inference speedups.
TabularMath: Understanding Math Reasoning over Tables with Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Mathematical reasoning has long been a key benchmark for evaluating large language models.
Approach: They propose a framework that transforms math word problems into scalable tabular reasoning tasks.
Outcome: The proposed framework transforms math word problems into scalable and verified tabular reasoning tasks.
Path-enhanced Pre-trained Language Model for Knowledge Graph Completion (2025.findings-emnlp)

Copied to clipboard

Challenge: Pre-trained language models have achieved remarkable knowledge graph completion (KGC) success.
Approach: They propose a path-enhanced pre-trained language model-based knowledge graph completion method which uses multi-view generation to infer missing facts in triple-level and path-level simultaneously.
Outcome: The proposed method significantly improves the performance of the knowledge graph completion task.
CoRe-MMRAG: Cross-Source Knowledge Reconciliation for Multimodal RAG (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in Multimodal Large Language Models have significantly improved reasoning and generation tasks by leveraging joint vision-language representations.
Approach: They propose a framework that reconciles inconsistencies across knowledge sources . they use a four-stage pipeline to generate an internal response from parametric knowledge .
Outcome: Experiments on KB-VQA show that CoRe-MMRAG achieves performance gains of 5.6% and 9.3% over baseline methods.
A Framework of Knowledge Graph-Enhanced Large Language Model Based on Question Decomposition and Atomic Retrieval (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to enhance LLMs with knowledge graphs have limited results . knowledge graph question answering (KGQA) provides interpretable reasoning for large language models .
Approach: They propose a framework for KG-enhanced LLM based on question decomposition and atomic retrieval . they propose question decomposing tree as framework for LLM reasoning .
Outcome: The proposed framework outperforms existing reasoning-based baselines on KGQA datasets.
Multi-Hop Knowledge Editing via Critic-Guided Multi-Agent Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing knowledge editing methods rely on unidirectional, feed-forward pipelines . a minor retrieval error or logical mismatch at an early hop can become a silent failure .
Approach: They propose a framework for closed-loop post-edit reasoning that uses a Critic agent to verify coherence and step-wise correctness.
Outcome: Experiments on MQuAKE-2002 and MQuADE-hard show that CARE effectively mitigates error propagation . a minor retrieval error or logical mismatch at an early hop can become a silent failure .
Self-Improvement in Multimodal Large Language Models: A Survey (2025.findings-emnlp)

Copied to clipboard

Challenge: Using data and data, self-improvement for Large Language Models has improved model capabilities without significantly increasing costs.
Approach: This survey provides a comprehensive overview of self-improvement for Large Language Models . it includes commonly used evaluations and downstream applications .
Outcome: The authors provide a comprehensive overview of self-improvement in Multimodal LLMs.
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)

Copied to clipboard

Challenge: Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages .
Approach: They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models .
Outcome: The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English .
Measuring Bargaining Abilities of LLMs: A Benchmark and A Buyer-Enhancement Method (2024.findings-acl)

Copied to clipboard

Challenge: Using a novel approach, we can evaluate an agent’s bargaining abilities as an asymmetric incomplete information game.
Approach: They propose an approach that integrates a deterministic Offer Generator and an LLM Narrator to create natural language sentences for generated offers.
Outcome: The proposed approach improves the buyer’s deal rates from 26.67% to 88.88% and brings a ten times multiplication of profits on all baselines, even a model that has not been aligned.
SeCuRepair: Semantics-Aligned, Curriculum-Driven, and Reasoning-Enhanced Vulnerability Repair Framework (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for automating vulnerability repair suffer from syntactic overfitting . nvd published 49,230 Common Vulnerabilities and Exposures (CVE) records in 2025 alone .
Approach: They propose a semantic-aware reward framework that optimizes for code semantic equivalence rather than lexical mimicry.
Outcome: The proposed framework outperforms state-of-the-art frameworks on repository-level splits . it incorporates expert-aligned reasoning mechanism that grounds patch generation in structured diagnosis.
Interactive Key-Value Memory-augmented Attention for Image Paragraph Captioning (2020.coling-main)

Copied to clipboard

Challenge: Existing approaches to image paragraph captioning ignore the past alignment information, resulting in repetitive captioning and incomplete captioning.
Approach: They propose an Interactive key-value Memory-augmented Attention model for image paragraph captioning to keep track of attention history along with update-chain of decoder state.
Outcome: Extensive experiments on a benchmark dataset demonstrate the effectiveness of the proposed model.
Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perception (2026.acl-long)

Copied to clipboard

Challenge: naively fine-tuning an omni-model on speech recognition and external sound understanding tasks often degrades performance . Xie and Wu's framework, Speech-Hands, recasts the problem as an explicit self-reflection decision.
Approach: They propose a voice-agentic framework that learns one critical omni-understanding skill: trusting itself versus external audio perception.
Outcome: The proposed framework outperforms baseline models on the OpenASR leaderboard by 12.1% WER and high F1 on audio QA decisions.
Relation-Specific Attentions over Entity Mentions for Enhanced Document-Level Relation Extraction (2022.naacl-main)

Copied to clipboard

Challenge: Existing document-level relation extraction methods do not distinguish between mention-level features and entity-level feature . document-based methods are more challenging because of multiple mentions of entities.
Approach: They propose a method which selectively attentions different entity mentions with respect to candidate relations and performs relation-specific representations of entities.
Outcome: The proposed method improves relation-specific representations of entities on two benchmark datasets.
SpeechIQ: Speech-Agentic Intelligence Quotient Across Cognitive Levels in Voice Understanding by Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: SIQ quantifies voice understanding abilities and provides unified comparisons between cascaded methods and end-to-end models.
Approach: They propose a human cognition-inspired evaluation pipeline for voice understanding large language models (LLM_Voice) that quantifies voice understanding abilities and provides unified comparisons between cascaded methods and end-to-end models.
Outcome: The proposed framework quantifies voice understanding abilities and provides unified comparisons between cascaded methods and end-to-end models, identifies annotation errors in existing benchmarks, and detects hallucinations in LLM_Voice.
DPN-LE: Dual Personality Neuron Localization and Editing for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Current methods for editing personality traits in large language models can change personalities but reduce performance.
Approach: They propose a novel paradigm for personality editing that locates and edits LLM neurons and enables competitive personality control at inference time.
Outcome: Experiments on LLaMA-3-8B-Instruct and Qwen2.5-7B-instruct show that the proposed approach can improve performance and improve performance.
AutoBreach: Universal and Adaptive Jailbreaking with Efficient Wordplay-Guided Optimization via Multi-LLMs (2025.findings-naacl)

Copied to clipboard

Challenge: Existing jailbreak research exhibits limitations in universality, validity, and efficiency . Existing methods for jailbreaking LLMs have limited validity and effectiveness .
Approach: They propose a black-box approach that uses wordplay-guided mapping rule sampling to create universal adversarial prompts.
Outcome: The proposed method efficiently identifies security vulnerabilities across various LLMs, achieving an average success rate of over 80% with fewer than 10 queries.
Local Additivity Based Data Augmentation for Semi-supervised NER (2020.emnlp-main)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is one of the first stages in deep language understanding yet current NER models heavily rely on human-annotated data.
Approach: They propose a Local Additivity based Data Augmentation method for semi-supervised Named Entity Recognition (NER) that creates virtual samples by interpolating sequences close to each other.
Outcome: The proposed method improves both entity and context learning by adding to training data and extending it to semi-supervised setting.
R3 Prompting: Review, Rephrase and Resolve for Chain-of-Thought Reasoning in Large Language Models under Noisy Context (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies have evaluated LLMs under noise-free context but the dilemma for LLM to produce inaccurate results under noisy context has not been fully investigated.
Approach: They propose a new method for CoT reasoning using Chain-of-Thought prompting that interacts with LLMs to perform key sentence extraction, variable declaration and answer prediction.
Outcome: The proposed method outperforms existing CoT prompting methods on five reasoning tasks under noisy context.
Task-oriented Word Embedding for Text Classification (C18-1)

Copied to clipboard

Challenge: Existing word embeddings only consider contextual information, which is suboptimal when used in various tasks due to a lack of task-specific features.
Approach: They propose a task-oriented word embedding method that regularizes the distribution of words to enable a clear classification boundary.
Outcome: The proposed method outperforms the state-of-the-art methods on a text classification task.
The Medium Is Not the Message: Deconfounding Document Embeddings via Linear Concept Erasure (2025.emnlp-main)

Copied to clipboard

Challenge: Embedding-based similarity metrics can be influenced by content dimensions and spurious attributes like the text’s source or language.
Approach: They propose a debiasing algorithm that removes observed confounders from encoder representations and removes them from the encoder.
Outcome: The proposed method improves on out-of-distribution benchmarks and on benchmarks, but performance is not affected.
SCAN: Structured Capability Assessment and Navigation for LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing research has focused on approximating model rankings, but such benchmarks fail to provide users and developers with a comprehensive and fine-grained understanding of a specific model’s capabilities.
Approach: They propose a framework that enables detailed characterization of LLM capabilities through comprehensive and fine-grained evaluation.
Outcome: The proposed framework enables detailed characterization of large language models through comprehensive and fine-grained evaluation.
PUPPET: Neural-Symbolic Standardized Patients for Mental Health (2026.acl-long)

Copied to clipboard

Challenge: Existing LLM-based training approaches lack faithful responses to clinical errors and explainable feedback.
Approach: They propose a neural-symbolic virtual standardized patient governed by an OBSERVE-THINK-BEHAVE architecture that embeds LLM reasoning into a symbolic system where experts implant causal associations between intervention logic and patient mental states.
Outcome: The proposed model outperforms baselines in faithfulness and pedagogical value.
Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching (2022.findings-naacl)

Copied to clipboard

Challenge: Existing studies have shown that cross-lingual knowledge distillation can improve the performance of pre-trained models for cross-linguistic similarity matching tasks.
Approach: They propose a multi-stage distillation framework for constructing a small-size but high-performance cross-lingual model using contrastive learning, bottleneck, and parameter recurrent strategies.
Outcome: The proposed model can compress the size of XLM-R and MiniLM by more than 50% while the performance is only reduced by about 1%.
VCSearch: Bridging the Gap Between Well-Defined and Ill-Defined Problems in Mathematical Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies have improved the performance of Large language models on well-defined mathematical benchmarks, but they often overlook ill-defined problems.
Approach: They develop a large-scale benchmark that contains over 5,000 ill-defined mathematical problems.
Outcome: The proposed framework improves the accuracy of identifying unsolvable problems by at least 12% across different LLMs, thus achieving stronger robust mathematical reasoning ability.
TACO: Enhancing Multimodal In-context Learning via Task Mapping-Guided Sequence Configuration (2025.emnlp-main)

Copied to clipboard

Challenge: Multimodal in-context learning (ICL) is a key mechanism for harnessing the capabilities of large vision–language models.
Approach: They propose a transformer-based model with task-aware attention that dynamically configures ICL sequences.
Outcome: Experiments on five LVLMs and nine datasets show that TACO surpasses baselines across diverse ICL tasks.
NOTA: Multimodal Music Notation Understanding for Visual Large Language Model (2025.findings-naacl)

Copied to clipboard

Challenge: Existing general-domain visual language models lack ability of music notation understanding . Symbolic music is represented in two distinct forms: auditory music and symbolic music .
Approach: They propose to train a multimodal music notation model using a large-scale dataset . they use cross-modal alignment to train the model for music notations analysis .
Outcome: The proposed model improves on music understanding by training with a multimodal music notation model.
DivScene: Towards Open-Vocabulary Object Navigation with Large Vision Language Models in Diverse Scenes (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Vision-Language Models (LVLMs) have achieved significant progress in tasks like visual question answering and document understanding.
Approach: They introduce DivScene, a large-scale dataset with 4,614 houses across 81 scene types and 5,707 kinds of target objects.
Outcome: The proposed dataset provides a much greater diversity of target objects and scene types than existing datasets, enabling a comprehensive task evaluation.
TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) sometimes produce untruthful responses despite knowing the correct knowledge.
Approach: They propose an inference-time intervention method to activate the truthfulness of Large Language Models (LLMs) by editing the features within LLM’s internal representations that govern the truthful.
Outcome: The proposed method improves the truthfulness of 13 advanced LLMs by an average of 20% on TruthfulQA benchmark.
Truth-Aware Context Selection: Mitigating Hallucinations of Large Language Models Being Misled by Untruthful Contexts (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are easily misled by untruthful contexts provided by users or knowledge augmentation tools, leading to hallucinations.
Approach: They propose a lightweight method to adaptively recognize and mask untruthful context from the inputs and a new evaluation metric to further study the LLMs’ ability to accept truthful information and resist untrusted information.
Outcome: The proposed method can detect and mask untruthful context from the inputs and significantly improve the quality of LLMs’ responses when presented with misleading information.
Augmenting Reasoning Capabilities of LLMs with Graph Structures in Knowledge Base Question Answering (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent work uses Large Language Models (LLMs) for semantic parsing to address Knowledge Base Question Answering tasks.
Approach: They propose a framework that augments reasoning capabilities of LLMs with Graph Structures in Knowledge Base Question Answering to retrieve question-related graph structures.
Outcome: The proposed framework outperforms existing methods on GrailQA and WebQSP under the few-shot setting.
DYNTEXT: Semantic-Aware Dynamic Text Sanitization for Privacy-Preserving LLM Inference (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to protect privacy of sensitive data are differential privacy (DP) and DP is used to protect users from privacy leakage.
Approach: They propose an LDP-based Dynamic Text sanitization for privacy-preserving LLM inference that dynamically constructs semantic-aware adjacency lists of sensitive tokens to sample non-sensitive tokens for perturbation.
Outcome: The proposed model excels on three datasets.
Self-adaptive Context and Modal-interaction Modeling For Multimodal Emotion Recognition (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods to predict emotion label for a given utterance lack modeling of diverse dependency ranges and inconsistent treatment of contribution for various modalities.
Approach: They propose a multimodal emotion recognition in conversation task that uses context and multiple modalities to predict emotion label for a given utterance.
Outcome: The proposed method outperforms the state-of-the-art methods on three multimodal datasets.
Attention Optimization for Abstractive Document Summarization (D19-1)

Copied to clipboard

Challenge: Abstractive summarization models require attention to reproduce the most salient information.
Approach: They propose to use local and global variances to augment the vanilla attention model to reproduce the most salient information and avoid repetitions.
Outcome: The proposed attention refinement unit can reproduce the most salient information and avoid repetitions on CNN/Daily Mail dataset.
DaMSTF: Domain Adversarial Learning Enhanced Meta Self-Training for Domain Adaptation (2023.acl-long)

Copied to clipboard

Challenge: Existing approaches to domain adaptation only use reliable pseudo instances, i.e., pseudo instances with high prediction confidence, to retrain the model.
Approach: They propose a domain adversarial learning enhanced self-training framework that uses meta-learning to estimate the importance of each pseudo instance and a meta constructor to construct the meta-validation set.
Outcome: The proposed framework reduces label noise and preserves hard examples while maintaining accuracy.
GRACE: Gradient-guided Controllable Retrieval for Augmenting Attribute-based Text Generation (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for controlling the generation of pre-trained language models infuse domain bias into the generation process, making it difficult to generate out-of-domain texts.
Approach: They propose a retrieval-augmented generation framework that uses retrieval to generate fluent sentences with high attribute relevance.
Outcome: The proposed method can generate fluent sentences with high attribute relevance while keeping domain bias out of the model.
Red Teaming Large Reasoning Models (2026.acl-long)

Copied to clipboard

Challenge: Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, but they introduce safety and reliability risks, such as CoT-hijacking and prompt-induced inefficiencies.
Approach: They propose a unified benchmark to assess the trustworthiness of Large Reasoning Models.
Outcome: The proposed benchmark evaluates truthfulness, safety and efficiency on 26 models.
AscendKernelGen: LLM-Driven Kernel Generation for NPUs (2026.findings-acl)

Copied to clipboard

Challenge: Neural Processing Units (NPUs) are critical for AI infrastructure, but their development remains a bottleneck due to vendor-specific Domain-Specific Languages (DSLs).
Approach: They propose a framework for NPU kernel development that bridges the gap in hardware-specific coding . compiler success on complex Level-2 kernels improves from 0% to 95.5%, they say .
Outcome: The proposed framework bridges the gap in hardware-specific coding, showing a near-zero success rate on complex kernels.
V-Oracle: Making Progressive Reasoning in Deciphering Oracle Bones for You and Me (2025.acl-long)

Copied to clipboard

Challenge: Deciphering oracle bone scripts using AI technology is not an overnight task due to the evolution of written language over millennia.
Approach: They propose a framework that utilizes Large Multi-modal Models (LMMs) for interpreting Oracle Bone Script (OBS).
Outcome: The proposed framework provides quantitative analyses and superior deciphering capability.
Subgraph-Guided Executable Logical Form Generation for Knowledge Base Question Answering (2026.findings-acl)

Copied to clipboard

Challenge: Existing retrieval-augmented approaches focus on ignoring the structural information of the Knowledge Base (KB) and the question.
Approach: They propose a structure-aware subgraph retrieval stage that ranks candidate subgraphs by aligning them with the question’s structure, along with semantic relevance.
Outcome: Experiments on GrailQA, WebQSP, and GraphQuestions show that the proposed framework achieves state-of-the-art performance.
Causality-aware Concept Extraction based on Knowledge-guided Prompting (2023.acl-long)

Copied to clipboard

Challenge: Concepts in knowledge graphs (KGs) are far from complete in existing knowledge graph models.
Approach: They propose to equip a PLM-based extractor with a knowledge-guided prompt to alleviate concept bias by removing spurious co-occurrence correlations from existing knowledge.
Outcome: The proposed prompt can alleviate concept bias and improve the performance of existing models.
CAP: Controllable Alignment Prompting for Unlearning in LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for modifying parameters are unsystematic and rely on empirical experience.
Approach: They propose a controllable alignment prompting for unlearning framework that decouples unlearning into a learnable prompt optimization process via reinforcement learning.
Outcome: The proposed framework achieves precise, controllable unlearning without updating model parameters.
HSCodeComp: A Realistic and Expert-level Agent Benchmark for Hierarchical Rule Application (2026.acl-long)

Copied to clipboard

Challenge: Existing agent benchmarks neglect hierarchical rule application in real-world domains . a critical gap persists in numerous real-life professional domains where decision-making is governed by expert-written rules.
Approach: They propose a benchmark requiring agents to assign a unique 10-digit Harmonized System (HS) Code to products by aligning their fuzzy attributes with strict tariff classification rules.
Outcome: The proposed benchmarks lack hierarchical rule application capability in real-world domains . the proposed benchmark is based on e-commerce and is open-source .
CLIPErase: Efficient Unlearning of Visual-Textual Associations in CLIP (2025.acl-long)

Copied to clipboard

Challenge: MU has gained significant attention as a means to remove the influence of specific data from a trained model without requiring full retraining.
Approach: They propose a novel approach that disentangles and selectively forgets both visual and textual associations, ensuring that unlearning does not compromise model performance.
Outcome: Experiments on CIFAR-100, Flickr30K, and Conceptual 12M show that CLIPErase effectively removes designated associations from multimodal samples in downstream tasks while preserving model performance on retain set.
Learning Transition Patterns by Large Language Models for Sequential Recommendation (2025.coling-main)

Copied to clipboard

Challenge: Extensive experiments on six real-world datasets show our approach outperforms the best baselines by 7.33% in NDCG@10, 4.65% in Recall@10 and 8.42% in MRR.
Approach: They propose a framework for mapping sequential item texts to sequential item IDs that incorporates multi-query input and item linear projection to model conditional probability distribution of items.
Outcome: The proposed framework outperforms baseline models on six real-world datasets by 7.33% and 4.65% respectively.
GRV-KBQA: A Three-Stage Framework for Knowledge Base Question Answering with Decoupled Logical Structure, Semantic Grounding and Structure-Aware Validation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for Knowledge Base Question Answering generate non-executable queries and inefficiencies in query execution.
Approach: a framework that decouples logical structure generation from semantic grounding is proposed . the framework explicitly enforces KB constraints to improve alignment between generated logical forms and KB structures.
Outcome: GRV-KBQA decouples logical structure generation from semantic grounding and incorporates structure-aware validation to enhance accuracy.
Untie the Knots: An Efficient Data Augmentation Strategy for Long-Context Pre-Training in Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have prioritized expanding the context window from which they can incorporate more information.
Approach: They propose a data augmentation strategy to enable large language models to gain long-context capabilities without the need to modify existing data mixture.
Outcome: The proposed model outperforms existing models on 20 billion tokens and achieves 75% and 84.5% accuracy on RULER at 128K context length.
MirrorCAPTCHA: Wild CAPTCHA, Wild Distribution, Wild Web-based Platform Meet Multimodal LLM Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing agent benchmarks fail to evaluate an agent's real-world capacity to handle CAPTCHA . Existing benchmarks ignore this practical challenge, failing to evaluate agents' ability to handle complex visual CAPTchas.
Approach: They propose a benchmark annotated with Weighted Pass Rate and a new metric to measure agent's ability to handle CAPTCHA.
Outcome: The proposed benchmark outperforms current state-of-the-art closed-source models on mirrorCAPTCHA and achieves 9.4% higher average weighted pass rate and 2.13% higher average Completion degree.
Improving Pre-trained Language Models with Knowledge Enhancement and Filtering Framework (2025.findings-naacl)

Copied to clipboard

Challenge: Existing knowledge enhancement techniques for pre-trained language models (PLMs) introduce noisy entity representations.
Approach: They propose a knowledge enhancement filter that integrates external knowledge bases to enhance PLMs' ability to capture entity knowledge.
Outcome: The proposed method achieves the highest F1-score and accuracy while reducing the computational cost by 1.7-2.5x.
From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs)-based agents have fundamentally reshaped artificial intelligence . however, the inherent statelessness of LLMs hinders their ability to maintain logical consistency across complex, multi-step tasks .
Approach: They propose a framework for LLM agent memory mechanisms that formalizes the development process into three stages: storage, reflection, and experience.
Outcome: The proposed framework breaks the development process into three stages . it analyzes the need for long-range consistency, challenges in dynamic environments, and the ultimate goal of continual learning.
Decoding Scientific Experimental Images: The SPUR Benchmark for Perception, Understanding, and Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Xu and Peng, 2025) . . SPUR is a comprehensive benchmark for scientific experimental image perception, understanding, and reasoning, comprising 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images.
Approach: They propose to use 4,264 question-answering (QA) pairs derived from 1,084 expert-curated images to evaluate the visual perception of multimodal large language models (MLLMs) . they also propose to utilize cross-panel relation understanding to evaluate MLLM’s ability to decipher intricate cross-panel relations.
Outcome: The proposed model is based on 4,264 question-answering pairs derived from 1,084 expert-curated images.
GROVE: A Retrieval-augmented Complex Story Generation Framework with A Forest of Evidence (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for generating stories with complex plots rely on detailed prompts, which inadvertently limit the creative potential of the generated stories.
Approach: They propose a retrieval-auGmented stoRy generation framework with a fOrest of eVidEnce to enhance stories’ complexity.
Outcome: The proposed framework enables generating more diverse plotlines from human-written stories.
Re3: Generating Longer Stories With Recursive Reprompting and Revision (2022.emnlp-main)

Copied to clipboard

Challenge: Recent work has generated short stories of several pages in length, but they are much shorter than typical short stories meant for human consumption.
Approach: They propose a framework to generate long-range plot coherence and relevance by prompting a general-purpose language model and a language model.
Outcome: The proposed framework generates stories of 2000-2500 words, compared to similar-length stories generated directly from the same model.
mABC: Multi-Agent Blockchain-inspired Collaboration for Root Cause Analysis in Micro-Services Architecture (2024.findings-emnlp)

Copied to clipboard

Challenge: Root cause analysis (RCA) in Micro-services architectures with escalating complexity is challenging due to fault propagation and circular dependencies among nodes.
Approach: They propose a framework where multiple agents follow Agent Workflow and collaborate in blockchain-inspired voting to ensure the reliability of root cause analysis.
Outcome: The proposed framework reduces the number of steps and standardizes task processing through Agent Workflow.
Target-Oriented Relation Alignment for Cross-Lingual Stance Detection (2023.findings-acl)

Copied to clipboard

Challenge: Existing work on cross-lingual stance detection has ignored the inconsistency in the occurrences and distributions of targets between languages, which consequently degrades the performance of stance detector in low-resource languages.
Approach: They propose a fine-grained method which considers both target-level associations and language-level alignments to learn the in-language and cross-language associations.
Outcome: The proposed method is compared with competing methods under variant settings and shows that it performs better in low-resource languages.
BOOKWORLD: From Novels to Interactive Agent Societies for Story Creation (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have enabled social simulation through multi-agent systems.
Approach: They propose a system for constructing and simulating book-based multi-agent societies that simulates established fictional worlds and characters.
Outcome: The proposed system generates high-quality stories while maintaining fidelity to the source books, surpassing previous methods with a win rate of 75.36%.
POINTS-Reader: Distillation-Free Adaptation of Vision-Language Models for Document Conversion (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to training document conversion models with manual annotation are costly and time-consuming, and training student models by distilling outputs from teacher models can significantly limit their performance in real-world applications.
Approach: They propose a fully automated framework for constructing high-quality document extraction datasets and models capable of handling diverse document formats and layouts.
Outcome: The proposed model outperforms existing models and improves on annotated documents.
DiffER: Diffusion Entity-Relation Modeling for Reversal Curse in Diffusion Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing large language models exhibit unidirectional behavior when processing bidirectional relationships . authors propose a solution to alleviate the reversal curse in Diffusion LLMs .
Approach: They propose a model that addresses the "reversal curse" of bidirectional behavior in large language models . they propose 'entity-aware training' and balanced data construction to alleviate asymmetry and missing relations .
Outcome: The proposed model alleviates the "reversal curse" in Diffusion LLMs . the proposed model employs whole-entity masking to mitigate entity fragmentation .
ChemActor: Enhancing Automated Extraction of Chemical Synthesis Actions with LLM-Generated Data (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for extracting chemical procedures from literature are insufficient and low-quality due to the inherent ambiguity of chemical language and the high cost of human annotation.
Approach: They propose a fully fine-tuned large language model (LLM) as a chemical executor to convert between unstructured experimental procedures and structured action sequences.
Outcome: The proposed model outperforms the baseline model on R2D and D2A tasks by 10%.
SaSR-Net: Source-Aware Semantic Representation Network for Enhancing Audio-Visual Question Answering (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing AVQA methods often fail to link sound-producing objects in the video with the audio-visual information.
Approach: They introduce a source-aware semantic representation network for AVQA . they use source-wise learnable tokens to capture and align audio-visual elements with the question .
Outcome: The proposed model outperforms state-of-the-art models on the Music-AVQA and AVQA-Yang datasets.
Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate (2024.emnlp-main)

Copied to clipboard

Challenge: Modern large language models (LLMs) have shown remarkable performance on general language tasks but struggle on complex reasoning tasks.
Approach: They propose a multi-agent debate framework that encourages divergent thinking in LLMs . they propose to break debate and use a judge to obtain a final solution .
Outcome: The proposed framework encourages divergent thinking in large language models . it is able to generate novel thoughts even if initial stance is incorrect .
Safe-FedLLM: Delving into the Safety of Federated Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing work on federated learning for large language models (FL) addresses privacy and data-silo issues in the training of large language model training.
Approach: They propose a probe-based defense framework for FedLLM that constructs defenses across three levels: Step-Level, Client-Level and Shadow-Level.
Outcome: The proposed framework improves FedLLM's robustness against malicious clients while maintaining competitive performance on benign data.
DOC: Improving Long Story Coherence With Detailed Outline Control (2023.acl-long)

Copied to clipboard

Challenge: Detailed Outline Control (DOC) framework improves long-range plot coherence . human evaluations of DOC show it outperforms strong Re3 on plot cohesion, outline relevance and interestingness .
Approach: They propose a Detailed Outline Control framework to improve long-range plot coherence . the detailed outliner creates a more detailed, hierarchically structured outline . they propose doc with a detailed controller to ensure the more detailed outline is respected .
Outcome: The proposed framework outperforms Re3 on plot coherence, outline relevance and interestingness.
Multi-level Adaptive Contrastive Learning for Knowledge Internalization in Dialogue Generation (2023.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge-grounded dialogue generation models struggle with dull and repetitive outputs, a problem commonly termed as text degeneration.
Approach: They propose a framework that allows the model to "cheat" the objective by duplicating knowledge segments in a superficial pattern matching based on overlap.
Outcome: The proposed framework can be applied to a WoW dataset and shows that it works across models and decoding strategies.
AgentMark: Utility-Preserving Behavioral Watermarking for Agents (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have improved text generation and reasoning.
Approach: They propose a behavioral watermarking framework that embeds multi-bit identifiers into planning decisions while preserving utility.
Outcome: The proposed framework embeds multi-bit provenance into planning decisions while preserving utility.
Addressing Entity Translation Problem via Translation Difficulty and Context Diversity (2024.findings-acl)

Copied to clipboard

Challenge: Neural machine translation systems often produce inadequate translations for named entities.
Approach: They propose a data augmentation strategy to enhance the accuracy of named entity translation by retraining the target named entity pair.
Outcome: The proposed method improves translation accuracy across test sets and terminology tests.
HoLLMwood: Unleashing the Creativity of Large Language Models in Screenwriting via Role Playing (2024.findings-emnlp)

Copied to clipboard

Challenge: Generative AI has demonstrated unprecedented creativity in the field of computer vision, yet such phenomena have not been observed in the realm of literary creation.
Approach: They propose a framework for unleashing the creativity of large language models (LLMs) they assign LLMs to different roles involved in real-world scenario, they write .
Outcome: The proposed framework outperforms baselines in terms of coherence, relevance, interestingness and overall quality on automatically generated screenplays.
CompKBQA: Component-wise Task Decomposition for Knowledge Base Question Answering (2025.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge base question answering methods struggle with complex queries.
Approach: They propose a framework that optimizes the process of fine-tuning a LLM for generating logical forms by enabling it to learn relevant sub-tasks like skeleton generation, topic entity generation, and relevant relations generation.
Outcome: The proposed framework achieves state-of-the-art on two benchmark KBQA datasets, WebQSP and CWQ.
SecureVibeBench: Benchmarking Secure Vibe Coding of AI Agents via Reconstructing Vulnerability-Introducing Scenarios (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks fail to capture scenarios in which vulnerabilities are introduced by humans . we evaluate 5 popular code agents supported by 5 LLMs on SecureVibeBench .
Approach: They propose a benchmarking tool that compares 105 C/C++ secure coding tasks . they use real-world open-source vulnerabilities and a comprehensive evaluation tool .
Outcome: The proposed benchmarks show that code agents struggle to produce correct and secure code . the best performing agent produces merely 23.8% correct and secured solutions .
Is Parameter Collision Hindering Continual Learning in LLMs? (2025.coling-main)

Copied to clipboard

Challenge: Existing methods to learn multiple tasks in parallel often lead to catastrophic forgetting, resulting in overwriting knowledge.
Approach: They propose a non-collision low-rank Adaptation approach that leverages low collision rates to enhance continual learning (CL) in large language models.
Outcome: The proposed approach achieves better task orthogonality and higher task orthognality than existing SOTA methods.
TANet: Thread-Aware Pretraining for Abstractive Conversational Summarization (2022.findings-naacl)

Copied to clipboard

Challenge: Existing pre-trained language models are difficult to apply to abstractive conversational summarization tasks.
Approach: They propose a thread-aware Transformer-based network that incorporates contextual dependency into the conversational summarization model.
Outcome: The proposed model can be applied to real conversations using a large-scale pretraining dataset.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations