Papers by Bo Zhou

77 papers
ARM: Alignment with Residual Energy-Based Model (2024.naacl-long)

Copied to clipboard

Challenge: Large language models (LLMs) acquire a wide range of abilities and abilities, but their behavior does not align with human preferences.
Approach: They propose to minimize a forward Kullback–Leibler divergence from a target policy to a parameteric policy instead of a reverse KL as in RLHF methods.
Outcome: The proposed method can learn an aligned policy by minimizing a forward Kullback–Leibler divergence from a target policy to a parameteric policy instead of a reverse KL as in RLHF methods.
OpenForecast: A Large-Scale Open-Ended Event Forecasting Dataset (2025.coling-main)

Copied to clipboard

Challenge: Existing closed-ended event forecasting methods are constrained by a limited answer space.
Approach: They introduce OpenForecast, a large-scale open-ended dataset with three open-ending event forecasting tasks and an automatic LLM-based method for complex events.
Outcome: The proposed method can be used to evaluate the ability of complex event forecasting of large language models.
Towards Holistic and Automatic Evaluation of Open-Domain Dialogue Generation (2020.acl-main)

Copied to clipboard

Challenge: Existing methods of open-domain dialogue evaluation are labor-intensive and inefficient.
Approach: They propose to use open-domain dialogues to evaluate different aspects of dialogues using holistic evaluation metrics.
Outcome: The proposed metrics show strong correlations with human judgments.
Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback (2025.acl-long)

Copied to clipboard

Challenge: Recent studies show that AI-assisted research methods can improve research efficiency . a closed-loop framework is used to enhance the automation level of scientific research .
Approach: They propose a closed-loop LLM-driven framework to enhance the automation level of scientific research.
Outcome: The proposed framework improves the efficiency of scientific research by improving data analysis, accelerating computation, and fostering novel idea generation.
AT²PO: Agentic Turn-based Policy Optimization via Tree Search (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have catalyzed the development of autonomous agents capable of executing complex, multi-turn tasks.
Approach: They propose a framework for agentic reinforcement learning that integrates turn-level tree search with tree search to address key challenges.
Outcome: The proposed framework addresses key challenges: limited exploration diversity, sparse credit assignment, and misaligned policy optimization.
MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing datasets often rely on synthetic data or figure-caption pairs, failing to capture the depth and complexity of geoscientific reasoning.
Approach: They propose a multimodal scientific dataset and benchmark curated from open-access publications.
Outcome: MSEarth features over 289K figures with captions enriched by contextual discussions and reasoning from original papers.
Unified Thinker: A General Reasoning Core for Image Generation (2026.acl-long)

Copied to clipboard

Challenge: generative models struggle with logic-intensive instruction following, exposing a persistent reasoning–execution gap.
Approach: They propose a task-agnostic reasoning architecture for general image generation . they propose pixel-level feedback to ground the Thinker's policy in pixel feedback .
Outcome: The proposed system significantly improves image reasoning and generation quality.
RWKV: Reinventing RNNs for the Transformer Era (2023.findings-emnlp)

Copied to clipboard

Challenge: recurrent neural networks struggle to match the performance of Transformers due to limitations in parallelization and scalability.
Approach: They propose a model architecture that combines the efficient parallelizable training of transformers with the efficient inference of RNNs.
Outcome: The proposed model performs on par with similarly sized RNNs, suggesting future work can leverage this architecture to create more efficient models.
v-HUB: A Benchmark for Video Humor Understanding from Vision and Sound (2026.acl-long)

Copied to clipboard

Challenge: Humor enriches our daily lives and appears in many forms, from jokes and cartoons to comedies and viral videos.
Approach: They introduce a video humor understanding benchmark to test their ability to understand humor from visual cues.
Outcome: The proposed video humor understanding benchmark is based on a collection of short videos . it features rich annotations and a study of environmental sound that can enhance humor .
FlowRAG: Synergizing Explicit Reasoning via Frequency-Aware Multi-Granularity Graph Flow (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for Graph-based retrieval-augmented generation rely on implicit semantic relevance propagation.
Approach: They propose a semantic-aware retrieval framework that improves both semantic recall and explicit reasoning.
Outcome: Extensive experiments show that FlowRAG improves both semantic recall and explicit reasoning.
The Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exit (2025.acl-long)

Copied to clipboard

Challenge: Existing frameworks for Large Language Models (LLMs) for Click-Through Rate prediction require a careful balance between computational efficiency and predictive accuracy.
Approach: They propose a framework that integrates Retrieval-Augmented Generation with a novel multi-head early exit architecture to address both challenges.
Outcome: The proposed framework reduces retrieval time while maintaining high model performance.
Enhancing Neural Models with Vulnerability via Adversarial Attack (2020.coling-main)

Copied to clipboard

Challenge: Existing work on adversarial attack to improve performance of NLSM tasks has not been done.
Approach: They propose a general two-stage training framework to enhance neural models with Vulnerability via adversarial attack.
Outcome: The proposed framework improves neural models with Vulnerability via adversarial attack on NLSM datasets.
mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understanding (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing Multimodal Large Language Models lack general structure understanding abilities for text-rich document images.
Approach: They propose to use unified structure learning to boost the performance of MLLMs by encoding structure information into text-rich images.
Outcome: The proposed model achieves state-of-the-art on 10 visual document understanding benchmarks.
CR-GIS: Improving Conversational Recommendation via Goal-aware Interest Sequence Modeling (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to determine a goal item by sequentially tracking users’ interests ignore the rich goal-aware implicit interest sequence patterns in a dialog.
Approach: They propose to model goal-aware implicit user interest sequence patterns in a dialog and a hierarchical Star Transformer to guide multi-turn utterances generation.
Outcome: The proposed framework achieves more accurate recommendations with more fluent and coherent dialog utterances.
DISC: Plug-and-Play Decoding Intervention with Similarity of Characters for Chinese Spelling Check (2025.acl-long)

Copied to clipboard

Challenge: Chinese spelling check (CSC) tasks require that incorrect characters are usually similar to the correct ones in either phonetics or glyph.
Approach: They propose a plug-and-play decoding intervention with similarity of characters module for Chinese spelling check (CSC) they propose to incorporate phonetic and glyph similarities only during the inference phase.
Outcome: The proposed method significantly improves Chinese spelling check models on benchmarks and on benchmark datasets.
M2PO: Multi-Perspective Multi-Pair Preference Optimization for Machine Translation (2026.acl-long)

Copied to clipboard

Challenge: prevailing methods for machine translation are often hindered by misleading reward signals.
Approach: They propose a framework that aligns large language models to human preferences . they propose 'M2PO' to correct the bias towards partial errors .
Outcome: The proposed framework outperforms open-source models and achieves parity with proprietary models.
ReLook: Vision-Grounded RL with a Multimodal LLM Critic for Agentic Web Coding (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) excel at algorithmic code generation, but front-end development is lacking in visual fidelity and interaction.
Approach: They propose an agentic, vision-grounded reinforcement learning framework that closes a loop by invoking a multimodal LLM as a tool.
Outcome: The proposed framework outperforms baselines in front-end code generation.
Musical Score Understanding Benchmark: Evaluating Large Language Models’ Comprehension of Complete Musical Scores (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for musical score understanding are narrow in scope, focusing on isolated fragments, short excerpts, or multiple-choice formulations, rather than supporting holistic reasoning over entire scores.
Approach: They propose a benchmark for score-level musical understanding across textual and visual modalities.
Outcome: The musical score understanding benchmark contains 1,800 question-answer pairs from works by Bach, Beethoven, Chopin, Debussy, and others.
Generating Temporally-ordered Event Sequences via Event Optimal Transport (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for temporal event ordering and event infilling ignore the global semantics of events, and the model adopts a word-level objective to model events in texts.
Approach: They propose a temporal event ordering and event infilling task using a model that uses maximum likelihood estimation to model events in texts.
Outcome: The proposed model outperforms existing models on all evaluation datasets.
Friendly Topic Assistant for Transformer Based Abstractive Summarization (2020.emnlp-main)

Copied to clipboard

Challenge: Abstractive document summarization is a comprehensive task in natural language processing.
Approach: They propose a topic assistant that rearranges and learns document semantics . they propose TA that is compatible with Transformer-based models and user-friendly .
Outcome: The proposed model is compatible with Transformer-based models and user-friendly.
MegaPairs: Massive Data Synthesis for Universal Multimodal Retrieval (2025.acl-long)

Copied to clipboard

Challenge: despite the growing demand for multimodal retrieval, there is a lack of training data.
Approach: They propose a data synthesis method that leverages vision language models and open-domain images to generate high-quality data.
Outcome: The proposed method outperforms baseline models on 70 more datasets and can scale up.
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)

Copied to clipboard

Challenge: Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages .
Approach: They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models .
Outcome: The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English .
VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for multimodal retrieval are mostly text-oriented, which lack the capability to process visual information.
Approach: They propose a multi-modal multi-text embedding model VISTA which extends a powerful text encoder with the image understanding capability by introducing visual token embedds.
Outcome: The proposed model achieves superior performance across a variety of multi-modal retrieval tasks in zero-shot and supervised settings.
HyperHatePrompt: A Hypergraph-based Prompting Fusion Model for Multimodal Hate Detection (2025.coling-main)

Copied to clipboard

Challenge: Existing models for multimodal hate detection lack implicit hateful cues, cross-modal-induced hate, and diversity of hate target groups.
Approach: They propose a hypergraph-based prompting fusion model that uses LLMs to generate hate cue prompts and hypergraph learning to merge multimodal hate features.
Outcome: The proposed model outperforms state-of-the-art models on two benchmark datasets showing that it can detect hate content across multiple modalities.
Reinforcement Learning on Pre-Training Data (2026.acl-long)

Copied to clipboard

Challenge: Recent progress in large language models is driven by scaling of training compute through pre-training with nexttoken prediction (NTP) or post-training (RL) Pre-training using NTP enables models to acquire extensive knowledge and skills from general data, but it suffers from data inefficiency and catastrophic forgetting in continual learning settings.
Approach: They propose to scale training compute through pre-training with next-token prediction (NTP) or post-training by scaling reinforcement learning (RL) to improve learning from general data.
Outcome: Experiments on multiple benchmarks and models show that the proposed approach improves continual pre-training and provides a strong foundation for post-training on Qwen3-8B-Base.
Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models (2025.acl-long)

Copied to clipboard

Challenge: Existing Mixture-of-Experts training frameworks use a micro-batch to calculate LBL . micro-batches are restricted to a single sequence, preventing expert specialization .
Approach: They propose to use a global-batch to loosen the load balance constraint for MoEs models . they propose to synchronize fi across micro-batches and then use it to calculate the LBL .
Outcome: The proposed global-batch LBL improves the domain specialization of experts . the micro-battery LBL is almost at the sequence level, and the router is pushed to distribute the token evenly .
TopKG: Target-oriented Dialog via Global Planning on Knowledge Graph (2022.coling-1)

Copied to clipboard

Challenge: Existing target-oriented dialogs take a local and greedy strategy for response generation, where global planning is absent.
Approach: They propose a global planning method for target-oriented dialog on a commonsense knowledge graph to adjust local response generation towards the global target.
Outcome: The proposed method can reach the target with a higher success rate, fewer turns, and more coherent responses.
Augmentation, Retrieval, Generation: Event Sequence Prediction with a Three-Stage Sequence-to-Sequence Approach (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to predict event sequences are complex and ignore the knowledge of external events.
Approach: They propose a statistical induction problem to generate a sequence of events by exploring the similarity between the given goal and known sequences of events.
Outcome: The proposed model outperforms existing methods on an event sequence prediction task.
Dynamic Expert Specialization: Towards Catastrophic Forgetting-Free Multi-Domain MoE Adaptation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to adapt Mixture-of-Experts models to multiple domains are prohibitive computation, cross-domain interference or require separate runs per domain.
Approach: They propose a dynamic expert specialization framework for multi-domain adaptation of Mixture-of-Experts models.
Outcome: The proposed framework reduces forgetting by 89% compared to full fine-tuning as domains scale from 2 to 6 and achieves faster convergence than conventional methods.
Low-probability Tokens Sustain Exploration in Reinforcement Learning with Verifiable Reward (2026.findings-acl)

Copied to clipboard

Challenge: Recent studies show that RLVR training is slow and results plateau as policy entropy collapses . low-probability regularization (Lp-Reg) reduces the number of low-quality exploratory tokens induced by RL training .
Approach: They propose a method to reduce RLVR over-penalization by eliminating low-probability exploratory tokens . they propose 'Low-provability Regularization' to reduce the gradual elimination of low-quality exploratory entropy tokens.
Outcome: The proposed method eliminates low-probability exploratory tokens and prevents suppression of potentially valuable low-property candidates.
SharPT: Shared Latent Space Prompt Tuning (2023.findings-eacl)

Copied to clipboard

Challenge: Prompt tuning is an efficient method for adapting large language models, but it is difficult and expensive to identify the source task that provides optimal prompts.
Approach: They propose to learn a shared latent space which captures a set of basis skills from a mixture of source tasks and then transfer them to target tasks.
Outcome: The proposed method outperforms previous methods on NLI, sentence completion, QA, conference resolution, word sense disambiguation and on various model scales.
CodexGraph: Bridging Large Language Models and Code Repositories via Code Graph Databases (2025.naacl-long)

Copied to clipboard

Challenge: Large Language Models excel in stand-alone code tasks but struggle with handling entire code repositories.
Approach: They propose a system that integrates LLM agents with graph database interfaces extracted from code repositories.
Outcome: The proposed system integrates LLM agents with graph database interfaces extracted from code repositories.
Low-Resource Language Expansion and Translation Capacity Enhancement for LLM: A Study on the Uyghur (2025.coling-main)

Copied to clipboard

Challenge: Extensive experiments have shown that our strategy effectively expands the low-resource languages supported by large language models and significantly enhances the model’s translation ability in Uyghur with less parallel data.
Approach: They propose a direct preference optimization based on translation self-evolution to expand low-resource languages into large language models by using Uyghur as an example.
Outcome: The proposed strategy expands low-resource languages supported by large language models and significantly enhances the model’s translation ability in Uyghur with less parallel data.
CASE: Aligning Coarse-to-Fine Cognition and Affection for Empathetic Response Generation (2023.acl-long)

Copied to clipboard

Challenge: Existing empathetic dialogue models only consider the affective aspect of empathy, which limits the capability of emotional response generation.
Approach: They propose a model that aligns the user's cognition and affection at both the coarse-grained and fine-grounded levels and then automatically and manually evaluates the model.
Outcome: The proposed model outperforms state-of-the-art models and generates more empathetic and informative responses.
Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Mixture-of-Experts (MoE) LLMs achieve higher performance with fewer active parameters, but are still difficult to deploy due to their immense parameter sizes.
Approach: They propose expert-level sparsification techniques to enhance the deployment efficiency of large language models by introducing plug-and-play expert pruning and skipping techniques.
Outcome: The proposed methods reduce model sizes and increase inference speed while maintaining satisfactory performance across a wide range of tasks.
Memorize Step by Step: Efficient Long-Context Prefilling with Incremental Memory and Decremental Chunk (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to optimize LLM for long sequences for long documents are slow and consume memory.
Approach: They propose a method that starts with a small memory size and gradually increases it . they propose Decremental Chunk based on Incremental Memory (IMDC) which reduces chunk size while increasing memory size .
Outcome: The proposed method is faster (1.45x) and reduces GPU memory consumption by 23.3% compared to fixed-size memory.
WYWEB: A NLP Evaluation Benchmark For Classical Chinese (2023.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for classical Chinese are inadequate to evaluate performance of different NLP models.
Approach: They propose an evaluation benchmark for classical Chinese NLP, which evaluates existing models.
Outcome: The proposed benchmark evaluates the performance of existing models in classical Chinese.
Entity-Aware Abstractive Multi-Document Summarization (2021.findings-acl)

Copied to clipboard

Challenge: Existing models for multidocument summarization do not focus on explicitly modeling the underlying semantic information across documents.
Approach: They propose an entityaware model for abstractive multi-document summarization that augments the classical Transformer-based encoder-decoder framework with a heterogeneous graph consisting of text units and entities as nodes.
Outcome: The proposed model can deal with saliency and redundancy issues explicitly and can be used with pre-trained language models, arriving at improved performance.
Few-shot Unified Question Answering: Tuning Models or Prompts? (2023.findings-emnlp)

Copied to clipboard

Challenge: Question-answering (QA) tasks investigate specific question types, knowledge domains, or reasoning skills, leading to specialized models catering to specific categories of QA tasks.
Approach: They propose to use model and prompt tuning for unified QA in a low-resource setting to overcome drawbacks of unified models.
Outcome: The proposed model and prompt tuning paradigms outperform model tuning in a few-shot setting with a good initialization and achieve a significant performance boost from pre-training in 'low-resource' setting.
A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Correction Based on Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Using an LLM for Chinese spelling correction tasks is completely different from previous approaches . given a Chinese character, there may exist many others with the same or similar pronunciations, or with similar shapes.
Approach: They propose a training-free prompt-free approach to leverage large language models for Chinese spelling correction task.
Outcome: The proposed model significantly improves performance on five public datasets, enabling them to compete with state-of-the-art domain-general CSC models.
BayesFlow: A Probability Inference Framework for Meta-Agent Assisted Workflow Generation (2026.findings-eacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable generality, often solving tasks with a single carefully engineered prompt.
Approach: They propose to cast automatic workflow generation as Bayesian inference over a posterior distribution on workflows and instantiate BayesFlow as Bayer-based workflow generation framework.
Outcome: The proposed framework improves accuracy by 9 percentage points over baselines and 65 percentage points on pool-wide benchmarks.
Discovery and Reinforcement of Tool-Integrated Reasoning Chains via Rollout Trees (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to augment Large Language Models (LLMs) with computational capabilities have focused on short Chain-of-thought (CoT) integrating tool-use into long CoT remains underexplored due to the scarcity of training data and the challenge of integrating it without compromising the model’s intrinsic long-chain reasoning.
Approach: They propose a framework that enables spontaneous tool-use during long CoT reasoning without additional human annotation.
Outcome: Experiments on AIME and GPQA-Diamond show that DART significantly outperforms existing methods, successfully harmonizing tool execution with long CoT reasoning.
MPPO: Multi Pair-wise Preference Optimization for LLMs with Arbitrary Negative Samples (2025.coling-main)

Copied to clipboard

Challenge: Existing preference optimization methods such as DPO and KTO are inherently derived from PPO, requiring a reference model that adds GPU memory resources and relies heavily on abundant preference data.
Approach: They propose an algorithm that leverages the average likelihood of model responses to fit the reward function and maximizes the utilization of preference data.
Outcome: The proposed algorithm outperforms DPO, ORPO, and SimPO on MT-Bench and Arena-Hard.
FlowSearch: Advancing Deep Research with Dynamic Structured Knowledge Flow (2026.acl-long)

Copied to clipboard

Challenge: FlowSearch is a multi-agent framework that actively constructs and evolves a dynamic structured knowledge flow to drive subtask execution and reasoning.
Approach: They propose a multi-agent framework that actively constructs and evolves a dynamic structured knowledge flow to drive subtask execution and reasoning.
Outcome: The proposed framework achieves competitive performance on GAIA, HLE, GPQA and TRQA benchmarks and is available to download.
Skill-Based Few-Shot Selection for In-Context Learning (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods based on pre-trained embeddings can be easily biased by surface features that are not important for the target task.
Approach: They propose a skill-based few-shot selection method for in-context learning . it generates skill-specific descriptions for each test case and candidate example .
Outcome: The proposed method significantly outperforms existing methods in five cross-domain semantic parsing datasets and six backbone models.
Temporal Evidence Chain for Temporal Knowledge Graph Question Answering with Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Temporal Knowledge Graph Question Answering (TKGQA) aims to answer temporal questions using knowledge from Temporal knowledge graphs.
Approach: They propose a framework to construct temporal evidence chains for LLM reasoning using Temporal Knowledge Graphs.
Outcome: TECQA outperforms existing methods on MultiTQ and CronQuestions.
Beyond Inherent Cognition Biases in LLM-Based Event Forecasting: A Multi-Cognition Agentic Framework (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models exhibit human-like cognitive biases in event forecasting . a human-curated dataset reveals significant cognitive bias in LLMs .
Approach: They propose a human-curated dataset to explore LLMs' cognitive biases . they leverage LLM participants to act as multi-cognition event participants .
Outcome: The proposed framework alleviates cognitive biases in LLMs and offers diverse perspectives.
Rose-SQL: Role-State Evolution Guided Structured Reasoning for Multi-Turn Text-to-SQL (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to multi-turn Text-to-SQL tasks rely on unstable APIs or expensive fine-tuning.
Approach: They propose a training-free framework that leverages small-scale LRMs through in-context learning to enable accurate context-dependent parsing.
Outcome: The proposed framework outperforms in-context learning baselines at the 4B scale and surpasses state-of-the-art models at the 8B and 14B scales.
Decoding Knowledge Attribution in Mixture-of-Experts: A Framework of Basic-Refinement Collaboration and Efficiency Analysis (2025.acl-long)

Copied to clipboard

Challenge: Existing attribution methods for dense models fail to capture dynamic routing-expert interactions in sparse MoE architectures.
Approach: They propose to analyze sparse MoE architectures against dense models to capture dynamic routing-expert interactions.
Outcome: The proposed algorithm shows that sparse models achieve higher efficiency per layer . it also shows that deep Qwen-MoE mitigates expert failures while minimizing complexity .
Exploring and Verbalizing Academic Ideas by Concept Co-occurrence (2023.acl-long)

Copied to clipboard

Challenge: a new framework for academic idea inspiration is being developed for academic research assistants . number of academic publications is increasing exponentially, making it difficult for an independent researcher to understand these papers thoroughly.
Approach: They propose a framework based on concept co-occurrence for academic idea inspiration . they construct evolving concept graphs according to the co-existence relationship of concepts from 20 disciplines or topics .
Outcome: The proposed system can be used to explore connections between academic concepts and verbalize the new ideas.
Unveiling Opinion Evolution via Prompting and Diffusion for Short Video Fake News Detection (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for short video fake news detection ignore the implicit opinions and evolving nature of opinions across modalities.
Approach: They propose a short video fake news model that mines implicit opinions within short videos and promotes the evolution of both explicit and implicit opinions across all modalities.
Outcome: The proposed model outperforms existing methods on a publicly available dataset for short video fake news detection.
Vector Calligrapher: Generating Scalable Vector Graphics via Structured Linguistic Supervision (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to generate SVG-based fonts struggle with semantic ambiguity and inefficiency . edward mcginley: generic text tokenizers fragment coordinate-dense SVG XML into excessively long sequences .
Approach: They propose a system that treats SVG generation as a conditional language modeling task . they propose linguistic supervision framework that decomposes typographic style into interpretable linguistic dimensions .
Outcome: The proposed system improves CLIP score by +23% while reducing geometric error by 48% and boosts generation efficiency by 18% Command-per-Token (C/T) ratio.
A + B: A General Generator-Reader Framework for Optimizing LLMs to Unleash Synergy Potential (2024.findings-acl)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) is an effective solution to supplement necessary knowledge to large language models.
Approach: They propose a "generate-then-read" pipeline to replace retrieval stage with generation from the LLM itself.
Outcome: The proposed framework outperforms single models in the base and chat versions and addresses safety and helpfulness post-adaptation challenges.
Improving Seq2Seq Grammatical Error Correction via Decoding Interventions (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to grammatical error correction (GEC) are sequence-to-sequence and sequence-edit.
Approach: They propose a unified decoding intervention framework that employs an external critic to assess the appropriateness of the token to be generated incrementally.
Outcome: The proposed framework outperforms baselines and state-of-the-art methods on English and Chinese datasets.
Boosting Event Extraction with Denoised Structure-to-Text Augmentation (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for event extraction neglect grammatical incorrectness, structure misalignment, and semantic drifting . et al., 2004; Ahn, 2006) show that the proposed method generates more diverse text representations for event extracting compared with the state-of-the-art.
Approach: They propose a framework for event extraction that generates additional training data and iteratively selects the effective subset from the generated training data.
Outcome: The proposed method generates more diverse representations of training data and achieves comparable results with the state-of-the-art.
Eliminating Sentiment Bias for Aspect-Level Sentiment Classification with Unsupervised Opinion Extraction (2021.findings-emnlp)

Copied to clipboard

Challenge: Aspect-level sentiment classification (ALSC) is a practical setting in aspect-based sentiment analysis due to no opinion term labeling needed, but it fails to interpret why a sentiment polarity is derived for the aspect.
Approach: They propose a span-based anti-bias aspect representation learning framework that eliminates the sentiment bias in the aspect embedding by adversarial learning against aspects’ prior sentiment.
Outcome: The proposed framework achieves state-of-the-art performance on five benchmarks, with the capability of unsupervised opinion extraction.
Benchmarking the Fine-Grained Discriminability in Image-Text Retrieval via Controlled Contrastive Differences (2026.findings-acl)

Copied to clipboard

Challenge: Existing cross-modal image-text retrieval models often retrieve samples with inconsistent details.
Approach: They propose two fine-grained image-text retrieval benchmarks that incorporate extensive contrastive samples with one controlled contrastive difference from its anchor.
Outcome: Extensive experiments show that contrastive samples can significantly degrade retrieval performance.
ABC-Bench: Benchmarking Agentic Backend Coding in Real-World Development (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have redefined the role of AI in software engineering . current benchmarks focus on localized code generation, but neglect dynamic, full-process requirements of real-world engineering.
Approach: They propose a benchmark to evaluate agentic backend coding within a realistic, executable workflow.
Outcome: The ABC-Bench benchmark evaluates agentic backend coding within a realistic, executable workflow.
SpiderFlow: Efficient Topology-Aware Scheduling for LLM Training Across Decentralized GPU Clusters (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to training large language models lack topologyaware task scheduling mechanisms and model parallelization strategies.
Approach: They propose a topology-aware scheduling system specifically designed for decentralized GPU clusters . they propose heuristic methods at the inter-cluster level with ILP-based optimization within clusters.
Outcome: The proposed system reduces job completion time by 1.2-1.3 and improves throughput by 1.12-1.25 . it also reduces scheduling overhead by 20-90 on average compared to state-of-the-art scheduling systems.
Facilitating Multi-turn Emotional Support Conversation with Positive Emotion Elicitation: A Reinforcement Learning Approach (2023.acl-long)

Copied to clipboard

Challenge: Existing approaches to provide emotional support (ESC) ignore the effect on ES and lack explicit goals to guide emotional positive transition.
Approach: They propose a new paradigm to formalize multi-turn ESC as a process of positive emotion elicitation.
Outcome: The proposed model outperforms existing models in achieving positive emotion elicitation while maintaining conversational goals like coherence.
Extending Context Window of Large Language Models via Semantic Compression (2024.findings-acl)

Copied to clipboard

Challenge: Existing models rely on a quadratic computation to generate long texts . current models impose limitations on the length of text inputs .
Approach: They propose a semantic compression method that extends the context window of large language models . the method reduces the semantic redundancy of long inputs before passing them to the LLMs .
Outcome: The proposed method extends the context window of large language models across tasks . it exhibits consistent fluency in text generation while reducing associated computational overhead.
Unleashing the Native Recommendation Potential: LLM-Based Generative Recommendation via Structured Term Identifiers (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for constructing item identifiers face bottlenecks due to their large output space and expensive vocabulary expansion and alignment training.
Approach: They propose to use Large Language Models to develop general-purpose, semantically-aware recommender systems that can be generalized and reusable.
Outcome: Experiments on real-world datasets show that GRAM outperforms baselines and significantly outperformed baselines.
A Training-free LLM-based Approach to General Chinese Character Error Correction (2025.acl-long)

Copied to clipboard

Challenge: Chinese spelling correction (CSC) is a crucial task that aims to correct character errors in text.
Approach: They propose a task that handles missing and redundant characters and an additional prompt-based large language model to improve performance.
Outcome: The proposed task is based on a high-quality dataset and a prompt-based large language model.
Document Modeling with Graph Attention Networks for Multi-grained Machine Reading Comprehension (2020.acl-main)

Copied to clipboard

Challenge: Existing approaches to machine reading comprehension treat documents at their hierarchical nature, ignoring their dependencies.
Approach: They propose a machine reading comprehension benchmark with two-grained answers . they use graph attention networks to model documents at their hierarchical nature .
Outcome: The proposed framework outperforms existing systems at long and short answer criteria.
CRFR: Improving Conversational Recommender Systems via Flexible Fragments Reasoning on Knowledge Graphs (2021.emnlp-main)

Copied to clipboard

Challenge: Existing conversational recommender systems (CRS) do not track the deep shift of user interest in conversations due to the complex of high-order and incomplete paths.
Approach: They propose a conversational context-based reinforcement learning model which does explicit multi-hop reasoning on KGs with a contextual context-driven reinforcement learning framework.
Outcome: Extensive experiments show that CRFR improves on paths of interest shift in knowledge graphs (KGs) .
Long Document Summarization with Top-down and Bottom-up Inference (2023.findings-eacl)

Copied to clipboard

Challenge: Recent models infer latent representations of words or tokens with a transformer encoder, which is bottom-up and thus does not capture long-distance context well.
Approach: They propose a method to infer latent representations of words or tokens in documents . they assume a hierarchical structure of a document where top-level captures long range dependency .
Outcome: The proposed model can summarize an entire book and achieve competitive performance on a wide range of document summarization benchmarks.
Physics Reasoner: Knowledge-Augmented Reasoning for Solving Physics Problems with Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Existing large language models (LLMs) fail due to lack of knowledge or incorrect knowledge application.
Approach: They propose a knowledge-augmented framework that constructs a formula set to provide explicit physics knowledge and utilizes checklists to guide effective knowledge application.
Outcome: The proposed framework achieves state-of-the-art performance on SciBench with an average accuracy improvement of 5.8%.
ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: ConceptMath evaluates concept-wise mathematical reasoning of Large Language Models (LLMs) Existing benchmarks that evaluate general mathematical reasoning with an average accuracy fail to probe the fine-grained failure modes of mathematical reasoning on specific datasets.
Approach: They introduce a bilingual, fine-grained benchmark that evaluates concept-wise mathematical reasoning of Large Language Models.
Outcome: The proposed benchmarks evaluate concept-wise mathematical reasoning of Large Language Models with concept-based accuracies.
Bridging the Gap between Prior and Posterior Knowledge Selection for Knowledge-Grounded Dialogue Generation (2020.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge-grounded dialogue models lack prior and posterior knowledge selection . prior selection module may not learn to select knowledge properly because of lack of posterior information .
Approach: They propose a knowledge distillation-based training strategy to remove the exposure bias of knowledge selection.
Outcome: The proposed model improves on two knowledge-grounded dialogue datasets.
MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have greatly enhanced dialogue systems, but evaluation of their capabilities remains a challenge.
Approach: They propose a model to evaluate the fine-grained abilities of Large Language Models in multi-turn dialogues.
Outcome: The proposed model evaluates 21 popular chatbots based on MT-Bench-101 . it includes 3 overarching abilities and 13 distinct tasks within multi-turn dialogue scenarios.
LLM-KT: Enhancing Large Language Models with Knowledge Tracing via Multi-Level Plug-and-Play Alignment (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to learn behavioral sequences fail to capture complex behavioral patterns due to a lack of deep reasoning capabilities and world knowledge.
Approach: They propose a framework that integrates the reasoning power of Large Language Models with the sequential modeling strengths of traditional KT methods via multi-level plug-and-play alignment.
Outcome: Extensive experiments on four standard datasets show that the proposed framework outperforms existing methods on state-of-the-art questions.
Aligning Recommendation and Conversation via Dual Imitation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing conversational recommendation systems ignore the advantage of user interest shift in connecting recommendation and conversation, leading to an ineffective loose coupling structure.
Approach: They propose a dual imitation to explicitly align recommendation and conversation paths . they propose to generate high-quality responses with accurate recommendations and coherent explanations .
Outcome: The proposed model outperforms the state-of-the-art models on recommendation and conversation performance with automatic, human, and novel explainability metrics.
EnsLM: Ensemble Language Model for Data Diversity by Semantic Clustering (2021.acl-long)

Copied to clipboard

Challenge: Existing studies have shown that data diversity affects the performance of LMs if we train a single LM over the entire dataset.
Approach: They propose an autoencoding topic model with a mixture prior to perform clustering for the data.
Outcome: The proposed model can learn knowledge from different samples while extracting cluster-specific features.
From spoken dialogue to formal summary: An utterance rewriting for dialogue summarization (2022.naacl-main)

Copied to clipboard

Challenge: Existing models focus more on the structure of summary, not on the personal and logical inconsistency problem.
Approach: They propose a model to solve the problem of personal and logical inconsistency . they use an utterance rewriter to complete the ellipsis content of dialogue content .
Outcome: The proposed model outperforms baseline models on both SAMSum and DialSum datasets.
ASCM: An Answer Space Clustered Prompting Method without Answer Engineering (2022.findings-acl)

Copied to clipboard

Challenge: Pre-trained language models have shown a great impact on NLP tasks.
Approach: They propose an answer space clustered prompting model and a synonym initialization method that automatically categorizes all answer tokens in a semantic-clustered embedding space.
Outcome: Experiments show that the proposed method outperforms existing state-of-the-art methods in few-shot settings.
Rhombus: Incentivizing Coordination in Parallel Thinking through Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Parallel thinking is a promising avenue for scaling test-time compute in Large Language Models . however, coordinating the exploration and aggregation stages remains challenging .
Approach: They propose a parallel thinking framework that explicitly incentivizes coordination between components via end-to-end reinforcement learning.
Outcome: The proposed framework improves accuracy by 6.0% over long chain-of-thought baselines while reducing wall-clock latency by 39.4% under matched token budgets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations