Papers by Bo Zhao

89 papers
MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing datasets often rely on synthetic data or figure-caption pairs, failing to capture the depth and complexity of geoscientific reasoning.
Approach: They propose a multimodal scientific dataset and benchmark curated from open-access publications.
Outcome: MSEarth features over 289K figures with captions enriched by contextual discussions and reasoning from original papers.
Unified Thinker: A General Reasoning Core for Image Generation (2026.acl-long)

Copied to clipboard

Challenge: generative models struggle with logic-intensive instruction following, exposing a persistent reasoning–execution gap.
Approach: They propose a task-agnostic reasoning architecture for general image generation . they propose pixel-level feedback to ground the Thinker's policy in pixel feedback .
Outcome: The proposed system significantly improves image reasoning and generation quality.
v-HUB: A Benchmark for Video Humor Understanding from Vision and Sound (2026.acl-long)

Copied to clipboard

Challenge: Humor enriches our daily lives and appears in many forms, from jokes and cartoons to comedies and viral videos.
Approach: They introduce a video humor understanding benchmark to test their ability to understand humor from visual cues.
Outcome: The proposed video humor understanding benchmark is based on a collection of short videos . it features rich annotations and a study of environmental sound that can enhance humor .
TableVista: Benchmarking Multimodal Table Reasoning under Visual and Structural Complexity (2026.findings-acl)

Copied to clipboard

Challenge: TableVista evaluates multimodal table reasoning under visual and structural complexity . current models struggle to maintain reasoning consistency when structural complexity combined with visually integrated presentations.
Approach: They propose a benchmark for evaluating multimodal table reasoning under visual and structural complexity.
Outcome: The proposed model performs poorly on visual and structural complexity.
ChemVLR: Prioritizing Reasoning in Perception for Chemical Vision-Language Understanding (2026.findings-acl)

Copied to clipboard

Challenge: Currently, vision-Language Models are optimized for direct visual question-answering tasks.
Approach: They propose a visual-language-based VLM that prioritizes reasoning within the perception process.
Outcome: The proposed model outperforms existing models and domain-specific open-source models in the chemical domain.
GeoLaux: A Benchmark for Evaluating MLLMs’ Geometry Performance on Long-Step Problems Requiring Auxiliary Lines (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for Geometry problem solving lack fine-grained evaluation for long-step problems necessitating auxiliary line construction.
Approach: They present a fine-grained annotated dataset with long-step reasoning and auxiliary line construction that provides a detailed evaluation of 23 leading MLLMs.
Outcome: The proposed model performs significantly worse on long-step problems than short-step ones, with 18 models showing a performance drop of over 50%.
Beyond Linguistic Cues: Fine-grained Conversational Emotion Recognition via Belief-Desire Modelling (2024.lrec-main)

Copied to clipboard

Challenge: Emotion recognition in conversation (ERC) is essential for dialogue systems to identify the emotions expressed by speakers.
Approach: They propose a method that incorporates both belief and desire to accurately identify emotions by extracting emotion-eliciting events from utterances and construct graphs that represent beliefs and desires in conversations.
Outcome: The proposed model outperforms existing models on four popular ERC datasets and validates its performance with multiple state-of-the-art models.
MergeIT: From Selection to Merging for Efficient Instruction Tuning (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for instruction tuning rely on LLMs to score instruction quality . existing methods rely only on Llms to rank instruction quality, but this approach is expensive and time-consuming .
Approach: They propose a novel LLM-based Merging strategy for better Instruction Tuning that shifts the focus from selection to synthesis.
Outcome: The proposed method reduces time and computational cost while preserving diversity and reducing redundancy.
A Survey on LLM-based Conversational User Simulation (2026.eacl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have enabled high-fidelity generation of synthetic user conversation.
Approach: They propose a taxonomy covering user granularity and simulation objectives . they analyze core techniques and evaluation methodologies to help them understand the latest developments .
Outcome: The proposed model enables high-fidelity generation of synthetic user conversation.
Solid-SQL: Enhanced Schema-linking based In-context Learning for Robust Text-to-SQL (2025.coling-main)

Copied to clipboard

Challenge: Existing text-to-SQL approaches have overlooked the critical aspect of system robustness.
Approach: They propose a robust text-to-SQL solution that integrates with LLMs . their method achieves SOTA SQL execution accuracy levels of 82.1% and 58.9% .
Outcome: The proposed solution achieves SOTA SQL execution accuracy levels of 82.1% and 58.9% on the general Spider and Bird benchmarks.
Representation Degeneration Problem in Prompt-based Models for Natural Language Understanding (2024.lrec-main)

Copied to clipboard

Challenge: Prompt-based fine-tuning (PF) models have shown improved performance on few-shot natural language understanding benchmarks.
Approach: They propose a framework to alleviate anisotropy in the embedding space by aligning with pre-trained language models' training objective.
Outcome: The proposed method outperforms mainstream methods on many NLU benchmarks.
Masks Can be Learned as an Alternative to Experts (2025.acl-long)

Copied to clipboard

Challenge: a recent study shows that sparse activation techniques can reduce inference performance without sacrificing performance.
Approach: They propose to sparsify a pre-trained dense large language model into a mixture-of-experts architecture for faster inference.
Outcome: The proposed approach is more efficient than one-shot sparsification techniques . it achieves 97% performance retention on downstream tasks with only 50% of parameters activated .
CR-GIS: Improving Conversational Recommendation via Goal-aware Interest Sequence Modeling (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to determine a goal item by sequentially tracking users’ interests ignore the rich goal-aware implicit interest sequence patterns in a dialog.
Approach: They propose to model goal-aware implicit user interest sequence patterns in a dialog and a hierarchical Star Transformer to guide multi-turn utterances generation.
Outcome: The proposed framework achieves more accurate recommendations with more fluent and coherent dialog utterances.
PGPO: Enhancing Agent Reasoning via Pseudocode-style Planning Guided Preference Optimization (2025.findings-acl)

Copied to clipboard

Challenge: Existing LLM agents generate verbose and inefficient natural language plans to guide reasoning, which restricts agents’ ability to generalize across similar tasks.
Approach: They propose a pseudocode-style planning guide optimization method that captures the structural logic of reasoning and uses two planning-oriented rewards to enhance agent learning.
Outcome: The proposed method outperforms existing LLM agents on representative agent benchmarks and outperformed the current leading baselines.
LLM-Enhanced Self-Evolving Reinforcement Learning for Multi-Step E-Commerce Payment Fraud Risk Detection (2025.acl-industry)

Copied to clipboard

Challenge: e-commerce payment fraud detection is a new area for reinforcement learning (RL) and Large Language Models (LLMs).
Approach: They propose to integrate reinforcement learning (RL) with Large Language Models (LLMs) by framing transaction risk as a multi-step Markov Decision Process (MDP), RL optimizes risk detection across multiple payment stages.
Outcome: The proposed approach improves fraud detection accuracy and demonstrates zero-shot capability.
Circuit Complexity Bounds for RoPE-based Transformer Architecture (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies provide the circuit complexity bounds to Transformer-like architectures. position embedding has emerged as a crucial technique in modern large language models.
Approach: They propose to use position embedding to improve Transformer-like architectures by analyzing their circuits and analyzing the results.
Outcome: The proposed model is able to solve canonical tasks without embedding positional information.
ShopSimulator: Evaluating and Exploring RL-Driven LLM Agent for Shopping Assistants (2026.acl-long)

Copied to clipboard

Challenge: Existing studies on large language model-based agents focus on evaluation benchmarks without training support.
Approach: They propose a large-scale Chinese shopping simulation environment that uses large language models to train agents.
Outcome: The proposed model performs poorly in a large-scale and challenging shopping environment in China.
M2PO: Multi-Perspective Multi-Pair Preference Optimization for Machine Translation (2026.acl-long)

Copied to clipboard

Challenge: prevailing methods for machine translation are often hindered by misleading reward signals.
Approach: They propose a framework that aligns large language models to human preferences . they propose 'M2PO' to correct the bias towards partial errors .
Outcome: The proposed framework outperforms open-source models and achieves parity with proprietary models.
Generating Temporally-ordered Event Sequences via Event Optimal Transport (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for temporal event ordering and event infilling ignore the global semantics of events, and the model adopts a word-level objective to model events in texts.
Approach: They propose a temporal event ordering and event infilling task using a model that uses maximum likelihood estimation to model events in texts.
Outcome: The proposed model outperforms existing models on all evaluation datasets.
Read As Human: Compressing Context via Parallelizable Close Reading and Skimming (2026.acl-long)

Copied to clipboard

Challenge: Existing task-aware methods require loading the entire input sequence at once for compression, which suffer from computational inefficiency.
Approach: They propose a framework that adopts an adaptive hybrid reading strategy to reduce computational inefficiency and redundant information in long-context scenarios.
Outcome: Experiments show that RAM outperforms baselines on multiple question answering and summarization benchmarks while delivering up to a 12x speedup on long inputs.
Beyond Query Memorization: Large Language Model Routing with Query Decomposition and Historical Matching (2026.acl-long)

Copied to clipboard

Challenge: Existing routing methods rely on direct mapping from queries to models based on surface-level features, leading to poor generalizability on out-of-distribution data.
Approach: They propose a new routing framework that recasts the routing task as a matching process of sifting similar queries from historical logs.
Outcome: The proposed framework improves matching accuracy while lowering inference costs . it decouples linguistic surface forms from task-intrinsic requirements .
See the World, Discover Knowledge: A Chinese Factuality Evaluation for Large Vision Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing models for large vision language models do not fully reflect their knowledge capacity and reliability, resulting in erroneous outputs that do not align with the image content or provide answers lacking knowledge evidence.
Approach: They propose a Chinese-based benchmark for visual factuality across 8 major topics and 56 subtopics and a multi-hop question construction.
Outcome: The proposed model decouples visual factuality into two parts: seeing the world and discovering knowledge.
Marco-Bench-MIF: On Multilingual Instruction-Following Capability of Large Language (2025.acl-long)

Copied to clipboard

Challenge: Existing datasets for instruction-following are monolingual and centered on English . existing data are unable to capture linguistic and cultural subtle differences .
Approach: They propose an extension of IFEval to a localized multilingual version called Marco-Bench-MIF . their benchmark addresses linguistic constraints and cultural references via translation and verification .
Outcome: The proposed extension of IFEval to a localized multilingual version covers 30 languages with varying levels of localization.
Towards Interpretable Tabular Reasoning: Enhancing LLM Reasoning on Tabular Data with Pre-Constructed Logic Graph (2026.acl-long)

Copied to clipboard

Challenge: Tabular data is used in fields such as finance and healthcare due to its heterogeneity and complexity.
Approach: They propose a Logic-Graph-Enhanced LLM Reasoning framework that integrates the strengths of tree-based models and LLMs to improve their interpretability.
Outcome: The proposed framework outperforms tree-based models and state-of-the-art LLMs on tabular prediction tasks, achieving superior accuracy and interpretability.
MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent Space (2024.emnlp-main)

Copied to clipboard

Challenge: Personalized Dialogue Generation relies on external role data, which can be scarce and raise privacy concerns.
Approach: They propose a framework to extract role information from dialogue history . they use persona codebook to represent roles in latent space and posterior distribution of role information .
Outcome: The proposed framework can generalize across roles, even for unseen roles.
MegaPairs: Massive Data Synthesis for Universal Multimodal Retrieval (2025.acl-long)

Copied to clipboard

Challenge: despite the growing demand for multimodal retrieval, there is a lack of training data.
Approach: They propose a data synthesis method that leverages vision language models and open-domain images to generate high-quality data.
Outcome: The proposed method outperforms baseline models on 70 more datasets and can scale up.
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)

Copied to clipboard

Challenge: Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages .
Approach: They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models .
Outcome: The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English .
VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for multimodal retrieval are mostly text-oriented, which lack the capability to process visual information.
Approach: They propose a multi-modal multi-text embedding model VISTA which extends a powerful text encoder with the image understanding capability by introducing visual token embedds.
Outcome: The proposed model achieves superior performance across a variety of multi-modal retrieval tasks in zero-shot and supervised settings.
Attribution-Based Analysis and Optimization of Modular Agentic Workflows (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have driven the rise of agentic workflows . yet, how can we attribute performance gains to individual upgrades and their interactions?
Approach: They propose a game-theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values.
Outcome: The proposed framework provides interaction-aware attribution and recommendation for model allocation under a fixed workflow structure.
Bipartite Graph Pre-training for Unsupervised Extractive Summarization with Graph Convolutional Auto-Encoders (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to rank sentences using pre-trained embeddings create a gap due to different optimization objectives.
Approach: They propose a pre-trained embedding process that optimizes informative sentences . they use sentence-word bipartite graphs to model intra-sentential distinctive features .
Outcome: The proposed model outperforms heavy BERT- or RoBERTa-based sentence ranking methods by providing summary-worthy representations.
Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Persona (2023.acl-long)

Copied to clipboard

Challenge: Existing personalized dialogue agents model persona profiles from sparse or dense persona descriptions and dialogue histories.
Approach: They propose a model that clusters dense persona descriptions into sparse categories and generates personalized responses from dialogue histories.
Outcome: The proposed model improves on Chinese and English datasets.
SCCS: Semantics-Consistent Cross-domain Summarization via Optimal Transport Alignment (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for multimodal summarization ignore the structure and semantics of the whole video and article.
Approach: They propose a semantic-consistent cross-domain summarization model that extracts features from video and article and uses fusion methods to select representative one.
Outcome: The proposed model produces high-quality multimodal summaries on three MSMO datasets.
TopKG: Target-oriented Dialog via Global Planning on Knowledge Graph (2022.coling-1)

Copied to clipboard

Challenge: Existing target-oriented dialogs take a local and greedy strategy for response generation, where global planning is absent.
Approach: They propose a global planning method for target-oriented dialog on a commonsense knowledge graph to adjust local response generation towards the global target.
Outcome: The proposed method can reach the target with a higher success rate, fewer turns, and more coherent responses.
Guess Me if You Can: Acronym Disambiguation for Enterprises (P18-1)

Copied to clipboard

Challenge: Acronyms are abbreviations formed from the initial components of words or phrases . acronyms can be difficult to understand for people who are not familiar with the subject matter .
Approach: They propose a framework to automatically resolve the true meanings of acronyms in a given context . they use the enterprise corpus as input and a high-quality acronym disambiguation system as output .
Outcome: The proposed framework can be deployed to any enterprise to support acronym disambiguation.
Augmentation, Retrieval, Generation: Event Sequence Prediction with a Three-Stage Sequence-to-Sequence Approach (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to predict event sequences are complex and ignore the knowledge of external events.
Approach: They propose a statistical induction problem to generate a sequence of events by exploring the similarity between the given goal and known sequences of events.
Outcome: The proposed model outperforms existing methods on an event sequence prediction task.
ELAD: Explanation-Guided Large Language Models Active Distillation (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are hindered by their memory inefficiency, computational demands, and the high costs of API inferences.
Approach: They propose an Explanation-Guided LLMs Active Distillation framework that employs an active learning strategy to optimize the balance between annotation costs and model performance.
Outcome: The proposed framework significantly improves the efficiency of LLMs knowledge distillation.
Dynamic Personality in LLM Agents: A Framework for Evolutionary Modeling and Behavioral Analysis in the Prisoner’s Dilemma (2025.findings-acl)

Copied to clipboard

Challenge: Current models rely on static personality traits but lack natural selection processes and direct psychological metrics, failing to accurately capture authentic dynamic personality variations.
Approach: They propose a framework that uses game payoffs as environmental feedback to drive adaptive personality evolution and analyze correlations between personality metrics and behavior.
Outcome: The proposed framework reveals new behavioral patterns of agents and evaluates personality-behavior relationships, advancing agent-based social simulations and human-AI symbiosis research.
C2PO: Diagnosing and Disentangling Bias Shortcuts in LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to solve large language models address stereotypical and structural biases in isolation . however, prior paradigms address these in isolation, often at the expense of exacerbating the other .
Approach: They propose a framework to tackle latent spurious feature correlations within input that drive erroneous reasoning shortcuts.
Outcome: The proposed framework mitigates stereotypical and structural biases while preserving robust general reasoning capabilities.
Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for parameter pruning fail to utilize the knowledge from pruned parameters.
Approach: They propose a method that uses manifold learning and the Information Bottleneck measure to merge similar layers to preserve model performance.
Outcome: The proposed method outperforms pruning methods on multiple datasets and LLMs with quantization and achieves substantial compression ratios.
Igniting Creative Writing in Small Language Models: LLM-as-a-Judge versus Multi-Agent Refined Rewards (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for enhancing Large Language Models (LLMs) struggle with novelty and Reinforcement Learning from human feedback (RLHF) is costly.
Approach: They propose to use a Reward Model (RM) and a principle-guided LLM-as-a-Judge to enhance creative output over baselines.
Outcome: The proposed approach significantly enhances creative output over baselines, but the principle-guided LLM-as-a-Judge yields superior generation quality.
SparkRA: A Retrieval-Augmented Knowledge Service System Based on Spark Large Language Model (2024.emnlp-demo)

Copied to clipboard

Challenge: Large language models (LLMs) have shown remarkable achievements across various language tasks.
Approach: They propose a scientific literature LLM and a knowledge service system based on it . they collect scientific literature and then pre-train it using autoregressive training .
Outcome: The proposed system provides literature investigation, paper reading, and academic writing functions.
Text Detoxification: Data Efficiency, Semantic Preservation and Model Generalization (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for detoxification of text often rely on manually annotated data . xiangli: "detoxification of texts is a powerful way to remove toxic content"
Approach: They propose a reinforcement learning framework that optimizes detoxification and semantic preservation without annotating large amounts of data.
Outcome: The proposed method overcomes major limitations and surpasses humanannotated references across multiple benchmarks.
Towards Automatic Evaluation of Dialog Systems: A Model-Free Off-Policy Evaluation Approach (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for evaluation of dialog systems are expensive and not scalable . a framework for estimating human evaluation scores is proposed to bridge this gap .
Approach: They propose a framework for estimating human evaluation scores based on off-policy evaluation . they use language quality metrics for single-turn response generation given a fixed context .
Outcome: The proposed framework outperforms existing methods in terms of correlation with human evaluation scores.
REG: Retrieval via Emotion Similarity for Guiding Empathetic Dialogue Generation (2026.acl-long)

Copied to clipboard

Challenge: Empathy relies on the cognitive capacity to relate to similar past experiences. Existing methods prioritize semantic similarity over emotion characteristics, leading to unempathetic responses.
Approach: They propose a framework that integrates four Emotion Attributes into the retrieval process to ensure explicit emotional alignment.
Outcome: Empirical results show that REG significantly outperforms baselines, offering a robust solution for empathetic generation.
FCM: A Fine-grained Comparison Model for Multi-turn Dialogue Reasoning (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing neural dialogue models only capture syntactic and semantic information, but fail to model the logical consistency between the dialogue history and the generated response.
Approach: They propose a fine-grained comparison model to capture syntactic and semantic information and then compare each candidate's representation with the whole history to obtain a history consistency representation.
Outcome: The proposed model obtains higher ranking scores than baseline models on two public dialogue datasets.
Exploring Label Hierarchy in a Generative Way for Hierarchical Text Classification (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for hierarchical text classification are lacking in the field of natural language processing.
Approach: They propose a hierarchy-aware T5 model with path-adaptive attention mechanism to exploit hierarchical dependency across different levels.
Outcome: The proposed model outperforms state-of-the-art models especially in Macro-F1 and low Macro.
LoRE: Enhancing Search Relevance with Progressive Chain-of-Thought and Preference Alignment (2026.findings-acl)

Copied to clipboard

Challenge: E-commerce search relevance is a critical component of retrieval systems.
Approach: They propose a large-generative model for search relevance that trains reasoning knowledge, multi-modal understanding and rule awareness into three core competencies.
Outcome: The proposed model outperforms GPT-5 in Macro-F1 and achieves 27% online gain.
Explicit vs. Implicit: Investigating Social Bias in Large Language Models through Self-Reflection (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to quantify and quantify social biases in Large Language Models (LLMs) focus on explicit bias, with little attention to implicit bias.
Approach: They propose a self-reflection-based evaluation framework that measures implicit bias and evaluates explicit bias by prompting LLMs to analyze their own generated content.
Outcome: The proposed framework compares explicit and implicit biases in large language models . it demonstrates that explicit bias manifests as mild stereotypes, while implicit bias exhibits strong stereotypes.
MTGP: Multi-turn Target-oriented Dialogue Guided by Generative Global Path with Flexible Turns (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches focus on global planning, which plans toward the target before the conversation.
Approach: They propose to generate a global path as a natural language sentence instead of a sequence of nodes.
Outcome: The proposed method has fewer turns, more coherent semantics, and higher success rate than baselines.
ECC: Synergizing Emotion, Cause and Commonsense for Empathetic Dialogue Generation (2025.coling-main)

Copied to clipboard

Challenge: Empathy improves human-machine dialogue systems by enhancing the user's experience.
Approach: They propose a framework that leverages specialized encoders to capture the key features of emotion, cause, and commonsense and collaboratively models these through a Conditional Variational Auto-Encoder.
Outcome: Empirical results show that the framework outperforms baseline models and offers a robust solution for empathetic dialogue generation.
Class Lifelong Learning for Intent Detection via Structure Consolidation Networks (2023.findings-acl)

Copied to clipboard

Challenge: Existing intent detection models can only handle predefined intent classes in the offline environment.
Approach: They propose a method that continually learns new intent classes from new data . structure-based retrospection and contrastive knowledge distillation are used to solve these problems .
Outcome: The proposed method outperforms existing models on three benchmarks.
From Parameters to Performance: A Data-Driven Study on LLM Structure and Development (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models have revolutionized a wide range of domains, driving significant advancements in both technology and real-world applications.
Approach: They present a large-scale dataset encompassing diverse open-source LLM structures and their performance across multiple benchmarks.
Outcome: The proposed model validates the relationship between structural configurations and performance across multiple benchmarks and further corroborates the findings using mechanistic interpretability techniques.
RoleBreak: Character Hallucination as a Jailbreak Attack in Role-Playing Systems (2025.coling-main)

Copied to clipboard

Challenge: Existing approaches to combat character hallucination are vulnerable to attack . large language models (LLMs) are capable of generating responses inconsistent with intended personas .
Approach: They propose a novel defence strategy that generates supplemental context through narration to mitigate role-query conflicts and improve query generalization.
Outcome: The proposed defence strategy outperforms refusal-based strategies in character hallucinations and query generalization.
RAVR: Reference-Answer-guided Variational Reasoning for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Experiments show that reinforcement learning (RL) can refine the reasoning abilities of large language models (LLMs) but requires a key prerequisite: the model must already be able to generate high-utility reasoning paths with non-negligible probability.
Approach: They propose a framework that uses answer-conditioned reasoning as a variational surrogate for question-only reasoning.
Outcome: Experiments on 11 benchmarks and 3 models show that RAVR reduces hesitation, strengthens conclusion consolidation, and promotes problem-specific strategies in reasoning.
Don’t Be Misled by Style: A Style-Adaptive Reranker for Capturing Effective Knowledge in Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Existing rerankers are mainly trained on well-edited texts, but stylistic features can be misled by reranked models.
Approach: They propose a style-augmented multi-task framework that prioritizes effective knowledge over stylistic perturbations by using an LLM to derive passage-level supervision on whether a passage helps or harms answer correctness.
Outcome: Extensive experiments show that SARK improves generation performance across multiple LLMs under mixed-style conditions.
GRAG: Graph Retrieval-Augmented Generation (2025.findings-naacl)

Copied to clipboard

Challenge: Naive Retrieval-Augmented Generation (RAG) focuses on individual documents during retrieval and is not suitable for networked documents.
Approach: They propose a novel divide-and-conquer strategy that retrieves optimal subgraph structure in linear time.
Outcome: The proposed approach outperforms current state-of-the-art methods on graph reasoning benchmarks.
CoMeT: Collaborative Memory Transformer for Efficient Long Context Modeling (2026.acl-long)

Copied to clipboard

Challenge: a novel architecture that enables LLMs to handle arbitrarily long sequences with constant memory usage and linear time complexity is a major barrier to long-context processing.
Approach: They propose a novel architecture that enables LLMs to handle arbitrarily long sequences with constant memory usage and linear time complexity.
Outcome: The proposed architecture can handle arbitrarily long sequences with constant memory usage and linear time complexity.
Analyzing Modality Robustness in Multimodal Sentiment Analysis (2022.naacl-main)

Copied to clipboard

Challenge: despite its importance, little attention has been paid to improving the robustness of multimodal models.
Approach: They propose simple diagnostic checks for modality robustness in a trained multimodal model . they find MSA models highly sensitive to a single modality, which creates issues .
Outcome: The proposed checks show that models are highly sensitive to a single modality, which creates issues in their robustness.
MoC: Mixtures of Text Chunking Learners for Retrieval-Augmented Generation System (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for text chunking are limited by text chunks and lack of domain-specific knowledge.
Approach: They propose a dual-metric evaluation method to quantify text chunking quality . they aim to generate a structured list of chunking regular expressions .
Outcome: The proposed method enables direct quantification of chunking quality . it substantiates the need to integrate LLMs into chunking process .
SeDev: Structured Semantic Exploration for LLM-Driven Code Generation (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown remarkable capabilities in automating code generation, but they suffer from insufficient exploration of the vast solution space.
Approach: They propose a large-scale LLM-driven code generation framework that efficiently finds high-quality solutions in only a few iterations.
Outcome: The proposed framework outperforms baselines while maintaining reasonable time and computational costs.
Select Before Use: On the Importance of Reference Model Selection in Preference Alignment (2026.acl-long)

Copied to clipboard

Challenge: Supervised Fine-Tuning (SFT) is used as the initialization and reference model for subsequent preference alignment.
Approach: They propose to use RewardRank to estimate initial implicit alignment between reference model and preference objective to ensure LLMs generate safe, helpful, and instruction-aligned content.
Outcome: Empirical evidence shows that using the selected model as reference can gain up to 67.6% relative increase on length-controlled win rate compared to baselines.
FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction (2023.acl-long)

Copied to clipboard

Challenge: Existing Universal Information Extraction models rely heavily on span boundaries in data during training, which does not reflect the reality of span annotation challenges.
Approach: They propose a framework that uses fuzzy spans to model various IE tasks . they propose generative Universal Information Extraction (UIE) to unify various ie tasks based on fuzzy span boundaries .
Outcome: The proposed framework improves on a series of main IE tasks with small amounts of data and training epochs.
EasyGen: Easing Multimodal Generation with BiDiffuser and LLMs (2024.acl-long)

Copied to clipboard

Challenge: Existing multimodal models that depend on encoders like CLIP or ImageBind need ample amounts of training data to bridge modalities.
Approach: They propose an efficient model that leverages bidirectional conditional diffusion model to foster more efficient modality interactions.
Outcome: The proposed model is able to train a projection layer linking an LLM and an adapter to align the LLM’s text space with the bidirectional diffusion model.
A + B: A General Generator-Reader Framework for Optimizing LLMs to Unleash Synergy Potential (2024.findings-acl)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) is an effective solution to supplement necessary knowledge to large language models.
Approach: They propose a "generate-then-read" pipeline to replace retrieval stage with generation from the LLM itself.
Outcome: The proposed framework outperforms single models in the base and chat versions and addresses safety and helpfulness post-adaptation challenges.
On Domain-Adaptive Post-Training for Multimodal Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Adapting general multimodal large language models to specific domains is important for practical applications.
Approach: They investigate domain adaptation of multimodal large language models via post-training . they develop a generate-then-filter pipeline that curates diverse visual instruction tasks .
Outcome: The proposed model outperforms existing models in domain adaptation by combining data from open-source models with training pipelines.
AEGIS: A Holistic Benchmark for Evaluating Forensic Analysis of AI-Generated Academic Images (2026.acl-long)

Copied to clipboard

Challenge: AEGIS examines whether current models can effectively audit AI-generated images in academic papers.
Approach: They propose a holistic benchmark for forensic analysis of AI-Generated academic ImageS that reveals limitations in academic image forensics.
Outcome: AEGIS compared with existing benchmarks on seven academic categories and features key advances in forensic analysis.
Emotion Recognition in Conversation via Dynamic Personality (2024.lrec-main)

Copied to clipboard

Challenge: Existing approaches to ERC focus on conversational contexts, but focus on static personality.
Approach: They propose a model that considers the dynamic personality of speakers during conversations.
Outcome: The proposed model outperforms existing models on three benchmark conversational datasets.
Modelling Long-distance Node Relations for KBQA with Global Dynamic Graph (2020.coling-main)

Copied to clipboard

Challenge: Existing studies rely on deep graph neural networks (GNNs) to capture rich structural information, but they lack the structural information needed for QA.
Approach: They propose a framework which captures structural information from KBs and models long-distance node relations from two perspectives.
Outcome: The proposed framework models long-distance node relations from two perspectives . it is based on two widely used multi-hop KBQA datasets .
Point, Disambiguate and Copy: Incorporating Bilingual Dictionaries for Neural Machine Translation (2021.acl-long)

Copied to clipboard

Challenge: Existing approaches to incorporate bilingual dictionaries into Neural Machine Translation (NMT) models have been criticized for lack of integration of bilingual lexical information into the neural architecture.
Approach: They propose a neural architecture to incorporate bilingual dictionaries into Neural Machine Translation models by introducing three new components: Pointer, Disambiguator, and Copier.
Outcome: The proposed method achieves the following merits inherently compared with previous efforts: (1) Pointer leverages the semantic information from bilingual dictionaries, for the first time, to better locate source words whose translation in dictionary can potentially be used; (2) Disambiguator synthesizes contextual information from source view and target view, both of which contribute to distinguishing translation of a specific source word from multiple candidates in dicaries; (3) Copier systematically connects Pointer and Disambiguators based on a hierarchical
LeTS: Learning to Think-and-Search via Process-and-Outcome Reward Hybridization (2025.emnlp-main)

Copied to clipboard

Challenge: Recent research focuses on integrating reasoning capabilities into the realm of retrieval-augmented generation (RAG) via outcome-supervised reinforcement learning (RL).
Approach: They propose a process-level reward module to mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation.
Outcome: The proposed framework can boost LLMs’ reasoning ability by integrating external knowledge sources through retrieval-augmented generation (RAG) The proposed model can mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation.
SATQuest: A Verifier for Logical Reasoning Evaluation and Reinforcement Fine-Tuning of LLMs (2026.acl-long)

Copied to clipboard

Challenge: Large language models exhibit strong general reasoning abilities, yet the community lacks controllable, scalable, and verifiable tools to analyze and improve them.
Approach: They propose a verifier that generates diverse SAT-based reasoning tasks from CNF instances and checks answers objectively with PySAT.
Outcome: The proposed verifier generates diverse SAT-based reasoning tasks from CNF instances and checks answers objectively with PySAT.
Guiding Dialogue Agents to Complex Semantic Targets by Dynamically Completing Knowledge Graph (2023.findings-acl)

Copied to clipboard

Challenge: Existing knowledge graphs are incomplete in tracking complex semantic relations of the target-oriented dialogue.
Approach: They combine methods of knowledge retrieval and relationship prediction to construct a context-related dynamic KG and a metric to evaluate the tracked path automatically.
Outcome: The proposed method can control the agent more logically and smoothly toward the complex target.
M2RC-EVAL: Massively Multilingual Repository-level Code Completion Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Existing repository-level code completion benchmarks focus on a limited number of languages . existing benchmarks report overall average scores of different languages ignoring fine-grained abilities .
Approach: They propose to use repository-level code completion benchmarks to evaluate general code intelligence abilities across languages for existing code Large Language Models.
Outcome: The proposed benchmarks improve the code completion abilities of existing LLMs by using two types of annotations on the parsed syntax tree.
Marco-o1 v2: Towards Widening The Distillation Bottleneck for Reasoning Models (2025.acl-long)

Copied to clipboard

Challenge: Recent efforts to distill large reasoning models into smaller lightweight models have shown competitive performances.
Approach: They propose to distill long Chain-of-Thought data to improve SFT and RL methods by constructing data from scratch using Monte Carlo Tree Search.
Outcome: The proposed method significantly improves reasoning performance on various benchmarks such as math (GSM8K, MATH, AIME).
GraphNarrator: Generating Textual Explanations for Graph Neural Networks (2025.acl-long)

Copied to clipboard

Challenge: Graph representation learning has garnered significant attention due to its broad applications in various domains, such as recommendation systems and social network analysis.
Approach: They propose to use a generative language model to map input-output pairs to explanations reflecting the model’s decision-making process to generate a model that generates pseudo-labels that capture the model's decisions from saliency-based explanations.
Outcome: Extensive experiments show that GraphNarrator produces human-preferred explanations that are faithful, concise, and human-like.
GoT-R1: Internalizing Graph-of-Thought via Structural Reinforcement for High-Density Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Chain-of-Thought reasoning suffers from an inherent mechanism flaw: linearity induces overthinking . emergence of Large Language Models (LLMs) has fundamentally redefined artificial intelligence .
Approach: They propose a framework that replaces verbose linear trajectories with high-density reasoning graphs.
Outcome: The proposed framework outperforms state-of-the-art models with reduced token overhead.
Aligning Recommendation and Conversation via Dual Imitation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing conversational recommendation systems ignore the advantage of user interest shift in connecting recommendation and conversation, leading to an ineffective loose coupling structure.
Approach: They propose a dual imitation to explicitly align recommendation and conversation paths . they propose to generate high-quality responses with accurate recommendations and coherent explanations .
Outcome: The proposed model outperforms the state-of-the-art models on recommendation and conversation performance with automatic, human, and novel explainability metrics.
Segment First or Comprehend First? Explore the Limit of Unsupervised Word Segmentation with Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to measure word segmentation only assess the language model's understanding of the overall meaning of sentences, lacking an evaluation of the language models' understanding capabilities at a fine-grained level.
Approach: They propose a framework to explore the limit of unsupervised word segmentation with Large Language Models (LLMs) they employ current mainstream LLMs to perform word segmentations across multiple languages .
Outcome: The proposed method improves on existing methods and combines the advanced pattern recognition capabilities of Aho-Corasick automata with the deep insights of well-pretrained LLMs.
EvoWiki: Evaluating LLMs on Evolving Knowledge (2025.acl-long)

Copied to clipboard

Challenge: Existing knowledge evolution benchmarks are static and fail to capture the evolving nature of LLMs and knowledge.
Approach: They propose an evolving dataset that categorizes information into stable, evolved, and uncharted states.
Outcome: The proposed dataset is auto-updatable and enables evaluation of continuously changing knowledge and newly released LLMs.
Denoising Concept Vectors with Sparse Autoencoders for Improved Language Model Steering (2026.findings-eacl)

Copied to clipboard

Challenge: Existing methods for steering concept vectors suffer from noisy features in diverse datasets that undermine steering robustness.
Approach: They propose a Sparse Autoencoder-Denoised Concept Vector (SDCV) which selectively keeps the most discriminative SAE latents while reconstructing hidden representations.
Outcome: The proposed method improves steering success rates by 4-16% across six challenging concepts while maintaining topic relevance.
Inside Out: Evolving User-Centric Core Memory Trees for Long-Term Personalized Dialogue Systems (2026.acl-long)

Copied to clipboard

Challenge: Existing personalized dialogue systems struggle to reconcile unbounded interactions with finite context constraints.
Approach: They propose a framework that utilizes a globally maintained PersonaTree as the carrier of long-term user profiling.
Outcome: The proposed framework outperforms existing systems in suppressing contextual noise and persona inconsistency.
Hierarchical Multi-label Text Classification with Horizontal and Vertical Category Correlations (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to hierarchical multi-label text classification ignore vertical category correlations or exploit dependencies across levels without considering horizontal correlations .
Approach: They propose a hierarchical multi-label text classification framework that considers both vertical and horizontal category correlations.
Outcome: The proposed framework improves on real-world HMTC datasets with significant improvements over baselines.
Can Brain Signals Reveal Inner Alignment with Human Languages? (2023.findings-emnlp)

Copied to clipboard

Challenge: Brain Signals, such as Electroencephalography, and human languages have been explored independently for many downstream tasks, however, the connection between them has not been well explored.
Approach: They introduce a multimodal transformer alignment model to observe coordinated representations between EEG and language.
Outcome: The proposed method achieved an F1-score improvement of 1.7% on ZuCo and 9.3% on Zuco datasets for sentiment analysis, and 7.4% on ZuCO for relation detection.
Empower Large Language Model to Perform Better on Industrial Domain-Specific Question Answering (2023.emnlp-industry)

Copied to clipboard

Challenge: Large Language Models (LLMs) have gained popularity but lack specific domain knowledge in domain-specific tasks.
Approach: They propose a model interaction paradigm that empowers LLM to achieve better performance on domain-specific tasks where it is not proficient.
Outcome: The proposed approach outperforms the commonly used LLM with retrieval methods in domain-specific tasks.
A Comparative Study of Explicit and Implicit Gender Biases in Large Language Models via Self-evaluation (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies on the explicit and implicit biases in large language models (LLMs) focus on either explicit or implicit bias.
Approach: They propose a self-evaluation-based two-stage measurement of explicit and implicit biases within large language models grounded in social psychology.
Outcome: The proposed model is based on two stages of self-evaluation on state-of-the-art LLMs to measure explicit bias toward social targets, where bias is less likely to be self-recognized by the LLM.
SafeRAG: Benchmarking Security in Retrieval-Augmented Generation of Large Language Model (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to integrating external knowledge into large language models (LLMs) however, the incorporation of external knowledge increases the vulnerability of LLMs .
Approach: They propose a benchmark to evaluate the RAG security using a dataset . they classify attack tasks into silver noise, inter-context conflict, soft ad, and white Denial-of-Service .
Outcome: The proposed benchmark evaluates the security of RAG against 14 representative RAG components.
Generative Prompt Tuning for Relation Classification (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing prompt tuning methods for RC are limited by label spaces and rigid prompt restrictions.
Approach: They propose a generative prompt tuning method to reformulate relation classification as an infilling problem by adding cloze-style phrases to masked language modeling problems.
Outcome: The proposed method exploits rich semantics of entity and relation types and can predict label verbalizations with varying lengths at multiple predicted positions.
Mobile-R1: Towards Interactive Capability for VLM-Based Mobile Agent via Systematic Training (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to training agents for visual-language models trap them in local optima, hindering exploration and error correction with the environment.
Approach: They propose a hierarchical training recipe that bridges atomic action execution and strategic task completion.
Outcome: The proposed training recipe bridges atomic action execution and strategic task completion.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations