Papers by Yang Ren

75 papers
Reinforced Efficient Reasoning via Semantically Diverse Exploration (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for reinforcement learning with verifiable rewards suffer from limited exploration diversity and inefficient reasoning.
Approach: They propose a method that rewards concise and correct reasoning while penalizing unnecessarily long reasoning chains.
Outcome: Extensive experiments on Qwen and Llama models validate the effectiveness and efficiency of ROSE.
Resource-Limited Joint Multimodal Sentiment Reasoning and Classification via Chain-of-Thought Enhancement and Distillation (2026.findings-acl)

Copied to clipboard

Challenge: Current approaches for Multimodal Sentiment Analysis (MSA) rely on parameter-heavy LLMs for classification, overlooking multimodal sentiment reasoning generation in resource-limited environments.
Approach: They propose a multimodal sentiment reasoning distillation model that employs a teacher-assistant-student paradigm to address deployment constraints in resource-limited environments.
Outcome: The proposed model performs well on a resource-limited JMSRC task with only 3B parameters and shows generalization and interpretability.
SLARD: A Chinese Superior Legal Article Retrieval Dataset (2025.coling-main)

Copied to clipboard

Challenge: Existing retrieval methods struggle to achieve ideal results, a study finds . existing large language models lack prior knowledge of the content of superior legal articles .
Approach: They propose to use a Chinese superior legal article retrieval dataset to find relevant articles with higher legal effectiveness.
Outcome: The proposed dataset shows that existing retrieval methods struggle to achieve ideal results.
Biology-Instructions: A Dataset and Benchmark for Multi-Omics Sequence Understanding Capability of Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Biology-Instructions is the first large-scale instruction-tuning dataset for multi-omics biological sequences.
Approach: They propose a large-scale instruction-tuning dataset for multi-omics biological sequences . they propose 'chatMultiOmics' to overcome limitations of current LLMs on multi-ome tasks .
Outcome: The proposed dataset bridges LLMs and complex biological sequence-related tasks while maintaining conversational fluency.
Beyond "I Don’t Know": Evaluating LLM Self-Awareness in Discriminating Data and Model Uncertainty (2026.acl-long)

Copied to clipboard

Challenge: Prior studies treat refusal as a generic "I don't know" lack of distinction limits downstream action decisions like requesting clarification or invoking external tools.
Approach: They propose a benchmark to evaluate explicit uncertainty attribution in large language models.
Outcome: The proposed method improves uncertainty attribution while preserving answer accuracy.
Benchmarking Data Science Agents (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have emerged as promising data science aids, assisting humans in data analysis and processing.
Approach: They propose an evaluation paradigm and benchmarks that assess the performance of data science agents throughout the entire data science lifecycle.
Outcome: The proposed evaluation paradigm streamlines dataset preparation, improves coverage, and expands benchmarking comprehensiveness.
On the Robustness of Reading Comprehension Models to Entity Renaming (2022.naacl-main)

Copied to clipboard

Challenge: SpanBERT model is more robust than RoBERTa, despite having similar accuracy on unperturbed test data.
Approach: They propose a pipeline to replace entity names with names from a variety of sources.
Outcome: The proposed model performs worse when entities are renamed, the authors show . SpanBERT, which is pretrained with span-level masking, is more robust than RoBERTa .
MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LMMs) struggle with simple tasks such as geometry, e.g., arithmetic, and reasoning.
Approach: They propose to leverage code as supervision for cross-modal alignment . they propose to use FigCodifier and ImgCode-8.6M to synthesize novel mathematical figures .
Outcome: The proposed model surpasses GPT-4o and Claude 3.5 Sonnet in the geometry problem-solving subset of MathVista, achieving improvements of 8.9% and 9.2%.
GeAR: Graph-enhanced Agent for Retrieval-augmented Generation (2025.findings-acl)

Copied to clipboard

Challenge: Retrieval-augmented Generation (RAG) relies on effective retrieval capabilities, yet traditional sparse and dense retrievers struggle with multi-hop retrieval scenarios.
Approach: They propose a graph expansion mechanism that augments any conventional base retriever and an agent framework that incorporates the resulting graph-based retrieval into a multi-step retrieval framework.
Outcome: The proposed system achieves state-of-the-art results on three multi-hop question answering datasets while consuming fewer tokens and requiring fewer iterations than existing multi-step retrieval systems.
RAG-Star: Enhancing Deliberative Reasoning with Retrieval Augmented Verification and Refinement (2025.naacl-long)

Copied to clipboard

Challenge: Existing large language models (LLMs) show exceptional problem-solving capabilities but struggle with complex reasoning tasks.
Approach: They propose a novel RAG approach that integrates retrieved information to guide tree-based reasoning process based on LLMs.
Outcome: The proposed approach outperforms existing methods in large language models . iteratively plans intermediate sub-queries and answers based on the LLM itself .
Perplexity-Aware Data Scaling Law: Perplexity Landscapes Predict Performance for Continual Pre-training (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have impressive capabilities across a wide range of domains, but their generalpurpose pre-training objectives often leave them illsuited for specialized applications such as healthcare.
Approach: They propose a perplexity-aware data scaling law that establishes a predictive relationship between the perplexities of domain-specific data and the test loss.
Outcome: Experiments on medical and general-domain benchmarks show that the proposed scaling law consistently identifies near-optimal training subsets with significantly reduced data consumption.
RubricHub: A Comprehensive and Highly Discriminative Rubric Dataset via Automated Coarse-to-Fine Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for generating open-ended rubrics suffer from scalability bottlenecks and coarse criteria resulting in a supervision ceiling effect.
Approach: They propose a framework for automated Coarse-to-Fine Rubric Generation . their framework uses principle-guided synthesis, multi-model aggregation, difficulty evolution .
Outcome: The proposed framework produces comprehensive and highly discriminative criteria capable of capturing the subtle nuances.
Exploiting Emotion-Semantic Correlations for Empathetic Response Generation (2023.findings-emnlp)

Copied to clipboard

Challenge: Empathetic response generation aims to generate empathetic responses by understanding the speaker’s emotional feelings from the language of dialogue.
Approach: They propose a dynamical Emotion-Semantic Correlation Model (ESCM) which constructs dynamic emotion-semantics through the interaction of context and emotions.
Outcome: The proposed model understands emotions more accurately and expresses fluent and informative empathetic responses.
Teaching Vision-Language Models to Ask: Resolving Ambiguity in Visual Questions (2025.acl-long)

Copied to clipboard

Challenge: Existing research addresses ambiguous visual questions by rephrasing questions, but it fails to address the inherently interactive nature of user interactions with visual language models (VLMs). Existing studies focus on re-phrase questions, and lack of a benchmark to assess VLMs’ capacity for resolving ambiguities through interaction.
Approach: They propose a visual question answering task that provides a natural language answer to a question based on a given image and an automated pipeline to generate ambiguity-clarification question pairs.
Outcome: The proposed benchmark targets three common categories of ambiguity in visual question answering (VQA) context and encompasses various VQA scenarios.
Unveiling Internal Reasoning Modes in LLMs: A Deep Dive into Latent Reasoning vs. Factual Shortcuts with Attribute Rate Ratio (2025.emnlp-main)

Copied to clipboard

Challenge: Existing research in multi-hop questions has identified two reasoning modes, but has not investigated how these modes differ during inference.
Approach: They propose a classification metric that compares latent reasoning and factual shortcuts in multi-hop questions.
Outcome: The proposed metric achieves 90% accuracy on the proposed datasets and demonstrates effectiveness in RAG conflict scenarios.
Ask-before-Plan: Proactive Language Agents for Real-World Planning (2024.findings-emnlp)

Copied to clipboard

Challenge: despite the advancements of large language models, the potential of LLM-powered agents to comprehend ambiguous user instructions is still under exploration.
Approach: They propose a task that requires agents to predict clarification needs based on conversation and agentenvironment interaction and generate a plan to fulfill the user's demands.
Outcome: The proposed framework is based on a new ask-before-plan benchmark dataset.
Out-of-Distribution Generalization in Natural Language Processing: Past, Present, and Future (2023.emnlp-main)

Copied to clipboard

Challenge: Existing literature on the generalization of machine learning models to out-of-distribution data is lacking.
Approach: They propose to present the first comprehensive review of recent progress, methods, and evaluations on the generalization challenge from an OOD perspective in natural language understanding.
Outcome: The proposed survey provides the first comprehensive review of recent progress, methods, and evaluations on the generalization challenge from an OOD perspective in natural language understanding.
RiddleSense: Reasoning about Riddle Questions Featuring Linguistic Creativity and Commonsense Knowledge (2021.findings-acl)

Copied to clipboard

Challenge: a riddle-style commonsense questions require complex commonsensense reasoning and figurative language skills . there is currently no dataset aimed at testing these abilities . authors propose a new multiple-choice question answering task .
Approach: They propose a new multiple-choice question answering task that uses a large dataset for riddlestyle commonsense questions.
Outcome: The proposed task comes with the first large dataset for answering riddlestyle commonsense questions.
MIND: From Passive Mimicry to Active Reasoning through Capability-Aware Multi-Perspective CoT Distillation (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches restrict students to following a single golden rationale and treat different reasoning paths independently, causing suboptimal performance.
Approach: They propose a capability-adaptive framework that transitions distillation from passive mimicry to active cognitive construction and employ a feedback-driven inertia calibration mechanism to align supervision with the student’s current adaptability.
Outcome: Experiments show that the proposed framework achieves state-of-the-art performance on both in-distribution and out-of distribution benchmarks.
SafeMCP: Proactive Power Regulation for LLM Agent Defense via Environment-Grounded Look-Ahead Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Large Language Model (LLM) agents are expanding their action spaces to operate in complex environments.
Approach: They propose a server-side defense plugin that constrains tool acquisition via predictive reasoning regarding future safety risks.
Outcome: Experiments on PowerSeeking Bench, ToolEmu, and AgentHarm show that SafeMCP achieves a safe equilibrium, effectively mitigating risks while preserving agent utility.
Fisher Information-based Efficient Curriculum Federated Learning with Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing frameworks for learning Large Language Models (LLMs) require adaptive data processing and low-rank adjustment to improve accuracy and fine-tuning speed.
Approach: They propose a fisher information-based adaptive federated curriculum learning framework with two novel methods to improve FL fine-tuning process.
Outcome: The proposed framework improves performance and fine-tuning speed compared with baseline approaches.
APPSI-139: A Parallel Corpus of English Application Privacy Policy Summarization and Interpretation (2026.acl-long)

Copied to clipboard

Challenge: a lack of high-quality English privacy policy corpus optimized for legal clarity and readability is limiting translation of privacy policies . 139 privacy policies are often considered "incomprehensible" due to technical jargon, legal language, and convoluted grammatical structures.
Approach: They propose a high-quality English privacy policy corpus annotated by domain experts . they propose APPSI-139 to summarize and interpret privacy policies in English .
Outcome: The proposed framework outperforms large language models in terms of readability and accuracy.
Jakiro: Boosting Speculative Decoding via Decoupled MoE (2026.acl-long)

Copied to clipboard

Challenge: Existing methods to accelerate large language model inference have a fundamental limitation: candidates at the same tree layer share identical feature representations, constraining diversity and diminishing overall effectiveness.
Approach: They propose a decoupled mixture of experts (MoE) into a draft model to generate diverse tokens from distinct feature spaces.
Outcome: The proposed approach achieves significant speedups over strong baselines, with notable improvements in non-greedy scenarios where token diversity is crucial.
Probability-Consistent Preference Optimization for Enhanced LLM Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in preference optimization have demonstrated significant potential for improving mathematical reasoning capabilities in large language models.
Approach: They propose a framework that establishes two quantitative metrics for preference selection: surface-level answer correctness and intrinsic token-level probability consistency.
Outcome: The proposed framework outperforms existing outcome-only criterion approaches across a diverse range of LLMs and benchmarks.
ASAP: A Chinese Review Dataset Towards Aspect Category Sentiment Analysis and Rating Prediction (2021.naacl-main)

Copied to clipboard

Challenge: Sentiment analysis is a key task in e-commerce to detect fine-to-coarse sentiment polarities.
Approach: They propose to use a large-scale Chinese restaurant review dataset ASAP to investigate the sentiment polarities underlying user reviews.
Outcome: The proposed model outperforms state-of-the-art models on both tasks.
Measuring Bargaining Abilities of LLMs: A Benchmark and A Buyer-Enhancement Method (2024.findings-acl)

Copied to clipboard

Challenge: Using a novel approach, we can evaluate an agent’s bargaining abilities as an asymmetric incomplete information game.
Approach: They propose an approach that integrates a deterministic Offer Generator and an LLM Narrator to create natural language sentences for generated offers.
Outcome: The proposed approach improves the buyer’s deal rates from 26.67% to 88.88% and brings a ten times multiplication of profits on all baselines, even a model that has not been aligned.
APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical Reasoning (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to improve logical reasoning skills require complex data processing.
Approach: They propose an adaptive pretraining approach to improve logical reasoning over text . they use a subset of Wikipedia sentences for pretraining and a sentence-level classification loss .
Outcome: The proposed model outperforms baselines on LogiQA and ReClor.
Social Welfare Function Leaderboard: On the Emergence of LLM Agents as the Welfare Dictator (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are increasingly entrusted with high-stakes decisions that affect human welfare.
Approach: They evaluate 20 state-of-the-art Large language models (LLMs) and 20 LLM dictators to create a social welfare function benchmark.
Outcome: The proposed model creates dilemma between maximizing collective efficiency and ensuring distributive fairness.
Knowledge Diffusion for Neural Dialogue Generation (P18-1)

Copied to clipboard

Challenge: End-to-end neural dialogue generation does not employ knowledge to guide the generation.
Approach: They propose a neural knowledge diffusion model to introduce knowledge into dialogue generation.
Outcome: The proposed model outperforms baseline models on a real-world dataset.
DVMap: Fine-Grained Pluralistic Value Alignment via High-Consensus Demographic-Value Mapping (2026.acl-long)

Copied to clipboard

Challenge: Current Large Language Models (LLMs) rely on coarse-grained national labels for pluralistic value alignment.
Approach: They propose a framework for fine-grained pluralistic value alignment using demographic constraints.
Outcome: The proposed framework can identify groups with predictable, high-consensus value preference . it achieves 48.6% accuracy, surpassing open-source LLM DeepSeek-v3.2 .
Model Balancing Helps Low-data Training and Fine-tuning (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in foundation models have emphasized the need to align pre-trained models with specialized domains using small, curated datasets.
Approach: They propose a layer-wise learning rate scheduler that balances training quality across layers . they adapt it to a curated dataset to achieve alignment with specialized domains .
Outcome: The proposed model shows that it can be used to balance training quality across layers and improve low-data training and fine-tuning for both NLP and SciML tasks.
Cross-Domain Audio Deepfake Detection: Dataset and Analysis (2024.emnlp-main)

Copied to clipboard

Challenge: Existing audio deepfake detection datasets are outdated and lack generalization capabilities.
Approach: They construct a new cross-domain audio deepfake detection dataset comprising over 300 hours of speech data that is generated by five advanced zero-shot TTS models.
Outcome: The proposed models achieve 4.1% and 6.5% error rates in the cross-domain ADD dataset generated by five advanced zero-shot TTS models.
From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan (2026.acl-long)

Copied to clipboard

Challenge: Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages.
Approach: They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English.
Outcome: The proposed model outperforms open-source and Tibetan-focused models on diverse tasks.
Unsupervised Preference-Aware Language Identification (2022.findings-acl)

Copied to clipboard

Challenge: Existing studies do not consider inter-personal variations due to the lack of user annotated training data.
Approach: They propose to use user preferences to identify ambiguous texts in multilingual applications without user annotated training data to build a preference-aware LID model.
Outcome: The proposed model significantly outperforms existing LID systems on handling ambiguous texts.
Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Models (2021.naacl-main)

Copied to clipboard

Challenge: Recent studies reveal a security threat to natural language processing models, called the Backdoor Attack.
Approach: They propose to hack a model by modifying one single word embedding vector without sacrificing accuracy on clean samples.
Outcome: The proposed method is more efficient and stealthier on sentiment analysis and sentence-pair classification tasks.
Fundamental Capabilities of Large Language Models and their Applications in Domain Scenarios: A Survey (2024.acl-long)

Copied to clipboard

Challenge: Existing benchmark-based evaluations cannot accurately reflect the performance of real-world applications.
Approach: They propose a reliable strategy for domains to choose more robust LLMs for real-world applications.
Outcome: The proposed strategy addresses the challenges faced by domains to choose more robust LLMs for real-world applications.
Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generation (2022.acl-long)

Copied to clipboard

Challenge: Current neural response generation models generate responses directly, omitting unstated implicit knowledge.
Approach: They propose a generative approach to externalize implicit commonsense knowledge and use it to generate responses.
Outcome: Empirical results show that TBS models outperform end-to-end RG models on most automatic metrics and generate more informative, specific, and commonsense-following responses.
G-Cap: A Game Character Caption Generator (2026.acl-long)

Copied to clipboard

Challenge: Existing studies on Large Vision-Language Models (LVLMs) primarily focus on real-world scenarios, leaving surreal, highly stylized, and semantically hybrid virtual-world situations significantly underexplored.
Approach: They propose to use a manually annotated benchmark to evaluate LVLMs' ability to perceive and describe game character from the virtual-world.
Outcome: The proposed task evaluates LVLMs’ ability to perceive and describe game character from the virtual-world.
Guided by the Plan: Enhancing Faithful Autoregressive Text-to-Audio Generation with Guided Decoding (2026.eacl-long)

Copied to clipboard

Challenge: Autoregressive (AR) models excel at generating temporally coherent audio by producing tokens sequentially, yet they often falter in faithfully following complex textual prompts.
Approach: They propose a lightweight auxiliary model trained with a GAE-inspired objective to predict final instruction-following quality from partial generations.
Outcome: The proposed model achieves 10 points improvement in CLAP score over baseline AR models while maintaining computational parity with best-of-N decoding.
RICO: Improving Accuracy and Completeness in Image Recaptioning via Visual Reconstruction (2025.emnlp-main)

Copied to clipboard

Challenge: Existing recaptioning methods suffer from inaccuracies due to missing fine-grained details.
Approach: They propose a framework that refines captions through visual reconstruction using a text-to-image model and a visual reconstruction framework.
Outcome: The proposed framework outperforms baselines on CapsBench and CompreCap by 10%.
MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Tasks (2024.eacl-long)

Copied to clipboard

Challenge: Existing approaches to automating ML are time-consuming and difficult to understand for human developers.
Approach: They propose a framework that leverages large language models to develop ML solutions for novel tasks.
Outcome: The proposed framework bridges the gap between machine intelligence and human knowledge by exploiting state-of-the-art large language models.
RAG4ITOps: A Supervised Fine-Tunable and Comprehensive RAG Framework for IT Operations and Maintenance (2024.emnlp-industry)

Copied to clipboard

Challenge: Large Language Models (LLMs) have improved the open-domain QA’s performance, but how to efficiently handle enterprise-exclusive corpora and build domain-specific QA systems are still not studied for industrial applications.
Approach: They propose a general and comprehensive framework based on Retrieval Augmented Generation (RAG) and facilitate the whole business process of establishing QA systems for IT operations and maintenance.
Outcome: The proposed framework achieves superior results on two kinds of QA tasks.
Rust-doctor: Enhanced Feature for Rust Ownership and Lifetime Repair with Balanced Training Data Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Rust has gained popularity due to its safety features during compilation.
Approach: They propose to use a training dataset to generate a balanced training dataset and leverage the Mid-level Intermediate Representation (MIR) as enhanced features for Rust’s unique compilation error repair.
Outcome: The proposed model outperforms state-of-the-art models in terms of Pass@K and Acc@K.
UR2 : Unify RAG and Reasoning through Reinforcement Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing attempts to unify large language models are limited to open-domain QA with fixed retrieval settings.
Approach: They propose a general reinforcement learning framework that dynamically coordinates retrieval and reasoning.
Outcome: The proposed framework outperforms existing paradigms on open-domain QA, MMLU-Pro, medical, and mathematical reasoning tasks.
RouterHGC: Optimized Router for LLM-based Multi-Agent Systems via Heterogeneous Graph Contrastive Learning (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs)-driven Multi-Agent Systems (MAS) have demonstrated remarkable scalability and generalizability across complex tasks.
Approach: They propose a new framework for routing using large language models . they formalize routing as node selection through edge-weight prediction .
Outcome: The proposed framework outperforms the best single LLM and baselines on five datasets . it achieves 0.80%–6.17% accuracy gains on MATH and HotpotQA while reducing inference cost by 27.40%.
Alignment with Fill-In-the-Middle for Enhancing Code Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for generating test cases with limited training data are not reliable and may be counterproductive.
Approach: They propose a method that splits code snippets into smaller, granular blocks, creating more diverse DPO pairs from the same test cases.
Outcome: The proposed approach shows significant improvements in code generation tasks on benchmark datasets such as HumanEval (+), MBPP (+), and APPS.
Towards Robust Real-World Spreadsheet Understanding with Multi-Agent Multi-Format Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Spreadsheets are among the most widely used data formats in real-world applications . existing large language models treat tables as plain text, overlooking layout cues and visual semantics.
Approach: They propose a two-stage multi-agent framework for spreadsheet understanding that adopts a step-by-step reading and reasoning paradigm.
Outcome: Extensive experiments on two spreadsheet datasets show the proposed framework outperforms existing methods on Spreadsheet Bench.
Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization (2023.emnlp-main)

Copied to clipboard

Challenge: Prompt tuning of Large Language Models (LLMs) can incur performance degradation or low training efficiency.
Approach: They propose a prompt tuning approach with Adaptive Optimization to enable efficient FL of LLMs.
Outcome: The proposed approach improves performance and efficiency simultaneously and addresses client drift problems on both the device and server sides.
FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for speech editing still suffer from over-smoothing problem and lack of robustness due to stutter.
Approach: They propose a stutter-oriented automatic speech editing model that incorporates sutter information into the hidden sequence.
Outcome: The proposed model achieves state-of-the-art performance on a speech recording dataset . it can improve fluency of stuttering speech in terms of objective and subjective metrics.
Cultural Bias Matters: A Cross-Cultural Benchmark Dataset and Sentiment-Enriched Model for Understanding Multimodal Metaphors (2025.acl-long)

Copied to clipboard

Challenge: Metaphors are pervasive in communication, making them crucial for natural language processing.
Approach: They propose a multicultural multimodal metaphor dataset designed for cross-cultural studies of metaphor in Chinese and English.
Outcome: The proposed model improves metaphor comprehension across cultural backgrounds and cultural domains.
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)

Copied to clipboard

Challenge: Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation.
Approach: They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets.
Outcome: The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark.
Rethinking Denoised Auto-Encoding in Language Pre-Training (2021.emnlp-main)

Copied to clipboard

Challenge: Pre-trained models such as BERT have achieved success in learning sequence representations, but they tend to learn representations that are covariant with the noise of pre-training.
Approach: They propose to train self-trained models to learn noise invariant sequence representations . they encourage consistency between original sequence and corrupted version via unsupervised instance-wise training signals.
Outcome: The proposed model improves on 11 natural language understanding and cross-modal tasks and achieves 0.6% gain on GLUE benchmarks and 0.8% increment on NLVR2 .
Dynamic Voting for Efficient Reasoning in Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Multi-path voting methods generate multiple reasoning paths for each problem, causing factual errors and illusion generation.
Approach: They propose a multi-path voting technique that effectively reduces the number of reasoning paths during multi-path voting while preserving accuracies.
Outcome: The proposed method outperforms Self-consistency using 24.7% of the number of paths on the LetterConcat task.
FIER: Fine-Grained and Efficient KV Cache Retrieval for Long-context LLM Inference (2025.findings-emnlp)

Copied to clipboard

Challenge: Key-Value (KV) cache reading latency increases with context lengths hindering LLM inference . important tokens are sparsely distributed across the long context, making existing retrieval inaccurate .
Approach: They propose a method to retain a small fraction of KV cache based on token importance . important tokens are often sparsely distributed across the long context .
Outcome: The proposed method reduces decoding latency by 1.2 to 1.5.
E-ViC: Reasoning Beyond Text via Embodied Visual Chain for Spatial Intelligence (2026.acl-long)

Copied to clipboard

Challenge: Existing Vision-Language Models (VLMs) lack spatial reasoning, despite text-based CoTs . e-ViC reframes spatial intelligence as a verifiable, tool-using capability, argues a new study.
Approach: They propose a framework that moves reasoning beyond text into the visual domain . they ground reasoning in pixel-level interactions to enable human-like "look-and-confirm" strategies .
Outcome: The proposed framework outperforms existing Vision-Language Models with an average gain of 10.1%.
EASYTOOL: Enhancing LLM-based Agents with Concise Tool Instruction (2025.naacl-long)

Copied to clipboard

Challenge: EASYTOOL combines tools from diverse tool documentation into a single tool instruction.
Approach: They propose a framework that transforms tool documentation into a unified tool instruction.
Outcome: EASYTOOL combines extensive tool documentation into a concise tool instruction . it reduces token consumption and improves performance of LLM-based agents .
An Iterative Associative Memory Model for Empathetic Response Generation (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for empathetic response generation ignore the associated words between dialogue utterances.
Approach: They propose an iterative associative memory model to capture associated words between dialogue utterances and situations, dialogue history, and a memory module for storing associated words.
Outcome: The proposed model captures key words between dialogue utterances and situations, dialogue history, and a memory module, thereby accurately and nuancedly comprehending the utterables.
GA-S3: Comprehensive Social Network Simulation with Group Agents (2025.findings-acl)

Copied to clipboard

Challenge: Existing social network simulations focus on discrete events or system dynamics instead of elucidating underlying mechanisms or causal relationships.
Approach: They propose a Social network simulation system that leverages newly designed Group Agents to make intelligent decisions regarding various online events.
Outcome: The proposed system can make intelligent decisions regarding online events at a manageable cost.
Towards Informative Open-ended Text Generation with Dynamic Knowledge Triples (2023.findings-emnlp)

Copied to clipboard

Challenge: Pretrained language models (PLMs) have impressive capabilities in open-ended text generation.
Approach: They propose a dynamic knowledge-guided informative open-ended text generation approach that utilizes a knowledge graph to help the model generate more contextually related entities and detailed facts.
Outcome: The proposed approach generates more informative texts than baselines.
CAME: Confidence-guided Adaptive Memory Efficient Optimization (2023.acl-long)

Copied to clipboard

Challenge: Existing memory-efficient methods require second-moment estimates of the per-parameter gradients to maintain their performance.
Approach: They propose to use memory-efficient optimizers to reduce memory usage by preserving second-moment estimates of gradients.
Outcome: The proposed method achieves fast convergence and lower memory usage across training tasks.
Does Higher Order LSTM Have Better Accuracy for Segmenting and Labeling Sequence Data? (C18-1)

Copied to clipboard

Challenge: Existing neural models take long distance dependencies into account when predicting the tag of the current token.
Approach: They propose a method to capture long distance tag dependencies and use them for dependency analysis.
Outcome: The proposed model can predict multiple tags for the current token without taking dependencies between tags into account.
LogicPoison: Logical Attacks on Graph Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Graph-based Retrieval-Augmented Generation (GraphRAG) enhances the reasoning capabilities of Large Language Models (LLMs) however, traditional RAG attacks are difficult to pose an effective threat to GraphRAg systems.
Approach: They propose a novel attack framework that targets logical reasoning rather than injecting false contents into GraphRAG systems by grounding their responses in structured knowledge graphs.
Outcome: The proposed framework outperforms state-of-the-art attacks on GraphRAG systems in both effectiveness and stealth.
Learning Dynamic Context Augmentation for Global Entity Linking (D19-1)

Copied to clipboard

Challenge: Existing collective entity linking methods are expensive and often lack local context information.
Approach: They propose a dynamic context-augmented inference model that can be used to make collective inference.
Outcome: The proposed model can cope with different local EL models with different learning settings, base models, decision orders and attention mechanisms.
Learning Relation Alignment for Calibrated Cross-modal Retrieval (2021.acl-long)

Copied to clipboard

Challenge: despite advances in multimodal pre-training, cross-modal retrieval remains challenging . lack of relation consistency impairs contextualized representation of image-text pairs .
Approach: They propose a new metric to quantify the relation consistency by measuring the semantic distance between linguistic and visual relations.
Outcome: The proposed method boosts the performance of prevailing models on Flickr30k and MS COCO datasets by a considerable margin.
O2NA: An Object-Oriented Non-Autoregressive Approach for Controllable Video Captioning (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods for video captioning consider a sequence of frames and biases towards focused objects.
Approach: They propose an Object-Oriented Non-Autoregressive approach to video captioning . it performs three steps: 1) identify the focused objects and predict their locations . 2) generate related attribute words and relation words of these focused objects to form a draft caption .
Outcome: The proposed method achieves competitive results with the state-of-the-art methods but with higher diversity and faster inference speed.
Prediction or Comparison: Toward Interpretable Qualitative Reasoning (2021.findings-acl)

Copied to clipboard

Challenge: Qualitative relationships are a significant portion of textual knowledge . current approaches use semantic parsers to transform natural language inputs into logical expressions or a "black-box" model to solve them in one step.
Approach: They propose to use neural network modules to simulate qualitative reasoning tasks . they use two qualitative reasoning question answering datasets to test their methods .
Outcome: Experiments on two qualitative reasoning question answering datasets show the proposed methods are general and general and interpretable.
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering (2022.acl-long)

Copied to clipboard

Challenge: Open-Domain Question Answering (ODQA) models typically include a retrieving module and a reading module.
Approach: They propose a new open-domain question-answering framework that uses a knowledge-enhanced version of FiD to improve the approach.
Outcome: The proposed model improves on ODQA benchmark datasets with less than 40% computation cost.
Transferring General Multimodal Pretrained Models to Text Recognition (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for text recognition rely on large-scale pretraining on human-annotated or synthetic data.
Approach: They propose a method to transfer multimodal pretrained models to text recognition using image captioning.
Outcome: The proposed method outperforms the baselines and achieves state-of-the-art performance in the Chinese text recognition benchmark.
MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQL (2025.coling-main)

Copied to clipboard

Challenge: Recent LLM-based Text-to-SQL methods suffer from performance degradation on “huge” databases and complex user questions that require multi-step reasoning.
Approach: They propose a framework that integrates a decomposer agent and auxiliary agents to generate SQL queries from natural language text.
Outcome: The proposed framework achieves comparable execution accuracy on SQL-Llama tasks compared to the baseline model.
Hate Speech Detection Based on Sentiment Knowledge Sharing (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for hate speech detection are stereotyped and biased . et al., a paper examining the effectiveness of multitask learning in hate speech recognition tasks .
Approach: They propose a hate speech detection framework based on sentiment knowledge sharing . they extract affective features of the target sentence and use sentiment features from external resources .
Outcome: The proposed model can detect hate speech over two public datasets.
OntoGuard: Enforcing Action Admissibility for LLM Agents in Complex Interactive Environments (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to large language models (LLMs) are limited by their ability to enforce environmental and behavioral admissibility.
Approach: They propose an ontological framework to guard LLM agents by enforcing environmental and behavioral admissibility.
Outcome: Experiments on ScienceWorld and VirtualHome show that OntoGuard can enforce environmental and behavioral admissibility while preventing invalid actions.
TOREE: Evaluating Topic Relevance of Student Essays for Chinese Primary and Middle School Education (2024.findings-acl)

Copied to clipboard

Challenge: Existing research on Automatic Essay Scoring (AES) for Chinese essays has overlooked topic relevance and lacks detailed feedback.
Approach: They propose to use TOREE to assess topic relevance in Chinese primary and middle school students’ essays to improve automatic and human evaluations.
Outcome: The proposed method significantly improves both automatic and human evaluations across four diverse LLMs.
MPR-GUI: Benchmarking and Enhancing Multilingual Perception and Reasoning in GUI Agents (2026.acl-long)

Copied to clipboard

Challenge: Existing GUI benchmarks lack fine-grained diagnostics to identify which capabilities lead to task failures.
Approach: They propose a multilingual P R GUI Benchmark to assess LVLMs' language capabilities . they propose XLI to align non-English hidden states with English ones during inference .
Outcome: The proposed benchmark reveals consistent gaps between English and non-English settings . it reduces the cross-lingual gaps with an average gain of 6.5% in non- English settings compared to static benchmarks .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations