Papers by Bo He

67 papers
CE-RM: A Pointwise Generative Reward Model Optimized via Two-Stage Rollout and Unified Criteria (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies have shown that rule-based evaluation methods are ineffective for open-ended natural language generation.
Approach: They propose a pointwise generative reward model with a dedicated two-stage rollout method and unified query-based criteria that can be trained with 5.7K high-quality data.
Outcome: The proposed model achieves superior performance on diverse reward model benchmarks, especially in Best-of-N scenarios, and delivers more effective improvements in downstream RL practice.
Chinese SafetyQA: A Safety Short-form Factuality Benchmark for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large language models have created significant safety concerns . factuality ability is crucial in determining whether they can be deployed and applied safely and compliantly within specific regions.
Approach: They propose a benchmark to evaluate the factuality of large language models in China . they evaluate the models' ability to provide accurate and reliable information .
Outcome: The proposed benchmark evaluates the factuality abilities of existing LLMs and compares them to LLM abilities.
All Languages Matter: Understanding and Mitigating Language Bias in Multilingual RAG (2026.acl-long)

Copied to clipboard

Challenge: Existing mRAG systems suffer from a language bias during reranking, systematically favoring English and the query’s native language.
Approach: They propose a language-agnostic utility-driven reranker alignment technique to mitigate language bias during re-ranking.
Outcome: The proposed approach mitigates language bias and consistently improves mRAG performance across languages.
Enhancing Medical Dialogue Generation through Knowledge Refinement and Dynamic Prompt Adjustment (2025.findings-acl)

Copied to clipboard

Challenge: Medical dialogue systems (MDS) struggle to identify relevant medical knowledge and generate accurate responses.
Approach: They propose a medical dialogue system that integrates knowledge refining and dynamic prompt adjustment to improve medical knowledge and accuracy.
Outcome: The proposed system outperforms state-of-the-art systems in both generation quality and medical entity accuracy.
RWKV: Reinventing RNNs for the Transformer Era (2023.findings-emnlp)

Copied to clipboard

Challenge: recurrent neural networks struggle to match the performance of Transformers due to limitations in parallelization and scalability.
Approach: They propose a model architecture that combines the efficient parallelizable training of transformers with the efficient inference of RNNs.
Outcome: The proposed model performs on par with similarly sized RNNs, suggesting future work can leverage this architecture to create more efficient models.
Rethinking Smoothness for Fast and Adaptable Entity Alignment Decoding (2025.findings-naacl)

Copied to clipboard

Challenge: Existing methods for integrating knowledge graphs rely on entity and relation embeddings . Fig. 1 shows how to decode knowledge graph in under 6 seconds .
Approach: They propose a framework that only utilizes entity embeddings to decode knowledge graphs.
Outcome: The proposed framework reconstructs KG representation by maximizing smoothness of entity embeddings.
FlowRAG: Synergizing Explicit Reasoning via Frequency-Aware Multi-Granularity Graph Flow (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for Graph-based retrieval-augmented generation rely on implicit semantic relevance propagation.
Approach: They propose a semantic-aware retrieval framework that improves both semantic recall and explicit reasoning.
Outcome: Extensive experiments show that FlowRAG improves both semantic recall and explicit reasoning.
UHGEval: Benchmarking the Hallucination of Chinese Large Language Models via Unconstrained Generation (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) produce hallucinated text, compromising their practical utility in professional contexts.
Approach: They have developed an unconstrained hallucination generation evaluation benchmark that contains hallucines generated by large language models with minimal restrictions.
Outcome: The proposed benchmarks are based on a Chinese-language dataset that is lacking in the field.
Correctable-DST: Mitigating Historical Context Mismatch between Training and Inference for Improved Dialogue State Tracking (2022.emnlp-main)

Copied to clipboard

Challenge: Existing dialogue state tracking approaches predict the dialogue state of a target turn sequentially based on the ground-truth previous dialogue state.
Approach: They propose a method that predicts dialogue state sequentially based on previous dialogue state . they propose generating a previously “predicted” dialogue state using ground-truth previous dialogue states .
Outcome: The proposed method achieves 67.51%, 68.24%, 70.30%, 71.38%, and 81.27% joint goal accuracy on MultiWOZ 2.0-2.4 datasets.
UFO: A UI-Focused Agent for Windows OS Interaction (2025.naacl-long)

Copied to clipboard

Challenge: UFO is a UI-Fcused agent designed to fulfill user requests tailored to Windows OS applications . it decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications.
Approach: They propose a UI-Fcused Windows OS agent that decomposes user requests using a divide-and-conquer approach and incorporates a control interaction module tailored for Windows OS.
Outcome: The proposed agent decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications.
Representation Degeneration Problem in Prompt-based Models for Natural Language Understanding (2024.lrec-main)

Copied to clipboard

Challenge: Prompt-based fine-tuning (PF) models have shown improved performance on few-shot natural language understanding benchmarks.
Approach: They propose a framework to alleviate anisotropy in the embedding space by aligning with pre-trained language models' training objective.
Outcome: The proposed method outperforms mainstream methods on many NLU benchmarks.
From Pseudo-Balancing to True Specialization: Memory-Aware Routing for Mixture-of-Experts (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to optimize expert-centered load balancing fail to account for pseudo-balance phenomenon . severe knowledge overlap among experts leads to redundant representations and inefficient parameter utilization .
Approach: They propose a method that prioritizes expert utilization over semantic alignment . they use memory-aware routing to ensure expert load balancing is consistent .
Outcome: Experimental results show that MAR improves expert specialization by 35% and accuracy by 2%-25% . MAR matches baseline performance with only half the experts .
CR-GIS: Improving Conversational Recommendation via Goal-aware Interest Sequence Modeling (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to determine a goal item by sequentially tracking users’ interests ignore the rich goal-aware implicit interest sequence patterns in a dialog.
Approach: They propose to model goal-aware implicit user interest sequence patterns in a dialog and a hierarchical Star Transformer to guide multi-turn utterances generation.
Outcome: The proposed framework achieves more accurate recommendations with more fluent and coherent dialog utterances.
Navigating the Infinite Dynamic Web Space: Effective In-Context Exploration via Cognitive Multi-Agent Collaboration (2026.eacl-long)

Copied to clipboard

Challenge: Existing methods for dynamic web navigation rely on greedy strategies or value estimation, struggle to achieve effective backtracking and are heavily dependent on proprietary models.
Approach: They propose a cognitive multi-agent collaboration framework that enhances cyberspace exploration capability through In-Context Exploration.
Outcome: The proposed framework surpasses the proprietary model Claude-3.5 Sonnet on the WebArena benchmark.
CaMML: Context-Aware Multimodal Learner for Large Models (2024.acl-long)

Copied to clipboard

Challenge: a lightweight module for tuning large multimodal models is introduced . CaMML integrates contextual samples into large models, enabling them to make inferences .
Approach: They introduce a lightweight module for tuning large multimodal models . they have developed two models that have shown exceptional performance .
Outcome: The proposed model outperforms LLaVA-1.5 on ten widely recognized datasets with a noticeable margin.
Self-Guided Function Calling in Large Language Models via Stepwise Experience Recall (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for function calling require expert effort and prompt engineering becomes inefficient.
Approach: They propose a method that performs fine-grained, stepwise retrieval from a continually updated experience pool.
Outcome: The proposed method achieves an average improvement of 6.1% on easy and 4.7% on hard questions.
MaskTab: Scalable Masked Tabular Pretraining with Scaling Laws and Distillation for Industrial Classification (2026.findings-acl)

Copied to clipboard

Challenge: Tabular data is high-dimensional, riddled with missing entries, and rarely labeled at scale.
Approach: They propose a unified pre-training framework for industrial-scale tabular data . MaskTab encodes missing values via dedicated learnable tokens .
Outcome: The proposed framework outperforms XGBoost and MaskTab-L on industrial-scale . it achieves +5.04% AUC and +8.28% KS over prior art under rigorous scaling .
Token Preference Optimization with Self-Calibrated Visual-Anchored Rewards for Hallucination Mitigation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for predicting hallucinations suffer from two drawbacks: Lack of scalable token-level rewards and Neglect of visual-anchored tokens.
Approach: They propose a Token Preference Optimization model with self-calibrated rewards . they propose based on visual-anchored tokens and visual-aware training objective .
Outcome: The proposed model improves hallucination performance by focusing on visual-anchored tokens without fine-grained annotations.
Multi-Task Reinforcement Learning for Enhanced Multimodal LLM-as-a-Judge (2026.acl-industry)

Copied to clipboard

Challenge: Existing MLLMs are optimized for single-task scenarios and struggle to generalize to diverse contexts.
Approach: They propose a framework that integrates multitask reinforcement learning and generalization capabilities of MLLMs to optimize the judge model across multiple tasks.
Outcome: The proposed framework outperforms baseline models in judgment consistency and correlation with human preferences.
See the World, Discover Knowledge: A Chinese Factuality Evaluation for Large Vision Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing models for large vision language models do not fully reflect their knowledge capacity and reliability, resulting in erroneous outputs that do not align with the image content or provide answers lacking knowledge evidence.
Approach: They propose a Chinese-based benchmark for visual factuality across 8 major topics and 56 subtopics and a multi-hop question construction.
Outcome: The proposed model decouples visual factuality into two parts: seeing the world and discovering knowledge.
MoA: Heterogeneous Mixture of Adapters for Parameter-Efficient Fine-Tuning of Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for parameter-efficient fine-tuning (PEFT) are limited by computational costs and performance degradation.
Approach: They propose a method that integrates Low-Rank Adaptation and Mixture-of-Experts (MoE) they propose combining expert load imbalance and representation collapse to improve LLM performance .
Outcome: The proposed method outperforms homogeneous MoE-LoRA architectures in performance and parameter efficiency.
MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent Space (2024.emnlp-main)

Copied to clipboard

Challenge: Personalized Dialogue Generation relies on external role data, which can be scarce and raise privacy concerns.
Approach: They propose a framework to extract role information from dialogue history . they use persona codebook to represent roles in latent space and posterior distribution of role information .
Outcome: The proposed framework can generalize across roles, even for unseen roles.
CLUE: A Chinese Language Understanding Evaluation Benchmark (2020.coling-main)

Copied to clipboard

Challenge: Existing language evaluation benchmarks for English are limited to English . lack of such benchmarks makes it difficult to replicate success in other languages .
Approach: They introduce a large-scale Chinese language understanding evaluation benchmark . the benchmark uses a set of current state-of-the-art pre-trained Chinese models .
Outcome: The first large-scale Chinese Language Understanding Evaluation (CLUE) benchmark is released . the benchmark evaluates models across a wide range of tasks on original Chinese text . existing language evaluation benchmarks are mostly limited to English .
Attribution-Based Analysis and Optimization of Modular Agentic Workflows (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have driven the rise of agentic workflows . yet, how can we attribute performance gains to individual upgrades and their interactions?
Approach: They propose a game-theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values.
Outcome: The proposed framework provides interaction-aware attribution and recommendation for model allocation under a fixed workflow structure.
Bipartite Graph Pre-training for Unsupervised Extractive Summarization with Graph Convolutional Auto-Encoders (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to rank sentences using pre-trained embeddings create a gap due to different optimization objectives.
Approach: They propose a pre-trained embedding process that optimizes informative sentences . they use sentence-word bipartite graphs to model intra-sentential distinctive features .
Outcome: The proposed model outperforms heavy BERT- or RoBERTa-based sentence ranking methods by providing summary-worthy representations.
Conformalized Answer Set Prediction for Knowledge Graph Embedding (2025.naacl-long)

Copied to clipboard

Challenge: Knowledge graph embeddings (KGE) map entities and predicates into numerical vectors, providing non-classical reasoning capabilities based on similarities and analogies between entities and relations.
Approach: They propose to use knowledge graph embeddings to provide non-classical reasoning capabilities by exploiting similarities and analogies between entities and relations.
Outcome: The proposed model can generate answer sets with probabilistic guarantees on four benchmark datasets and is scaled well with respect to the difficulty of the query.
Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Persona (2023.acl-long)

Copied to clipboard

Challenge: Existing personalized dialogue agents model persona profiles from sparse or dense persona descriptions and dialogue histories.
Approach: They propose a model that clusters dense persona descriptions into sparse categories and generates personalized responses from dialogue histories.
Outcome: The proposed model improves on Chinese and English datasets.
TopKG: Target-oriented Dialog via Global Planning on Knowledge Graph (2022.coling-1)

Copied to clipboard

Challenge: Existing target-oriented dialogs take a local and greedy strategy for response generation, where global planning is absent.
Approach: They propose a global planning method for target-oriented dialog on a commonsense knowledge graph to adjust local response generation towards the global target.
Outcome: The proposed method can reach the target with a higher success rate, fewer turns, and more coherent responses.
Dynamic Personality in LLM Agents: A Framework for Evolutionary Modeling and Behavioral Analysis in the Prisoner’s Dilemma (2025.findings-acl)

Copied to clipboard

Challenge: Current models rely on static personality traits but lack natural selection processes and direct psychological metrics, failing to accurately capture authentic dynamic personality variations.
Approach: They propose a framework that uses game payoffs as environmental feedback to drive adaptive personality evolution and analyze correlations between personality metrics and behavior.
Outcome: The proposed framework reveals new behavioral patterns of agents and evaluates personality-behavior relationships, advancing agent-based social simulations and human-AI symbiosis research.
MCGA: A Multi-task Classical Chinese Literary Genre Audio Corpus (2026.findings-acl)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) have advanced Chinese Classical Studies (CCS) but the audio dimension of CCS remains underexplored due to a lack of high-quality, domain-specific audio corpora.
Approach: They propose a 119-hour audio corpus comprising 22,000 audio samples to bridge this gap . it encompasses a diverse range of literary genres across six tasks .
Outcome: The proposed corpus encompasses a diverse range of literary genres across six tasks: Automatic Speech Recognition (ASR), Speech-to-Text Translation (S2TT), Speech Emotion Captioning (SEC), Spoken Question Answering ( SQA), Speech Understanding (SU), and Speech Reasoning (SR).
2D-DPO: Scaling Direct Preference Optimization with 2-Dimensional Supervision (2025.findings-naacl)

Copied to clipboard

Challenge: Existing methods that optimize for scalar scores or ranking reward ignore multi-dimensional nature of human preferences.
Approach: They propose to extend the preference of Direct Preference Optimization to two dimensions: segments and aspects.
Outcome: The proposed framework decomposes the overall objective into multi-segment and multi-aspect objectives.
AIR: Complex Instruction Generation via Automatic Iterative Refinement (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for generating complex instructions are resource-intensive and lack diversity.
Approach: They propose a framework to generate complex instructions with constraints using a document-generated initial instruction and an iterative refinement framework to incorporate LLM-as-judge guidance.
Outcome: The proposed framework significantly outperforms existing methods for generating complex instructions, and outperformed existing methods.
Explicit vs. Implicit: Investigating Social Bias in Large Language Models through Self-Reflection (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to quantify and quantify social biases in Large Language Models (LLMs) focus on explicit bias, with little attention to implicit bias.
Approach: They propose a self-reflection-based evaluation framework that measures implicit bias and evaluates explicit bias by prompting LLMs to analyze their own generated content.
Outcome: The proposed framework compares explicit and implicit biases in large language models . it demonstrates that explicit bias manifests as mild stereotypes, while implicit bias exhibits strong stereotypes.
MTGP: Multi-turn Target-oriented Dialogue Guided by Generative Global Path with Flexible Turns (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches focus on global planning, which plans toward the target before the conversation.
Approach: They propose to generate a global path as a natural language sentence instead of a sequence of nodes.
Outcome: The proposed method has fewer turns, more coherent semantics, and higher success rate than baselines.
Learning to Evolve: A Self-Improving Framework for Multi-Agent Systems via Textual Parameter Graph Optimization (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for designing and optimizing multi-agent systems are static and do not learn from experience.
Approach: They propose a framework that enables a multi-agent system to learn to evolve . they use "textual gradients" to pinpoint failures and suggest granular modifications .
Outcome: a new framework enables a multi-agent system to learn to evolve . it learns from historical optimization experiences to improve its performance .
ECC: Synergizing Emotion, Cause and Commonsense for Empathetic Dialogue Generation (2025.coling-main)

Copied to clipboard

Challenge: Empathy improves human-machine dialogue systems by enhancing the user's experience.
Approach: They propose a framework that leverages specialized encoders to capture the key features of emotion, cause, and commonsense and collaboratively models these through a Conditional Variational Auto-Encoder.
Outcome: Empirical results show that the framework outperforms baseline models and offers a robust solution for empathetic dialogue generation.
Class Lifelong Learning for Intent Detection via Structure Consolidation Networks (2023.findings-acl)

Copied to clipboard

Challenge: Existing intent detection models can only handle predefined intent classes in the offline environment.
Approach: They propose a method that continually learns new intent classes from new data . structure-based retrospection and contrastive knowledge distillation are used to solve these problems .
Outcome: The proposed method outperforms existing models on three benchmarks.
RoleBreak: Character Hallucination as a Jailbreak Attack in Role-Playing Systems (2025.coling-main)

Copied to clipboard

Challenge: Existing approaches to combat character hallucination are vulnerable to attack . large language models (LLMs) are capable of generating responses inconsistent with intended personas .
Approach: They propose a novel defence strategy that generates supplemental context through narration to mitigate role-query conflicts and improve query generalization.
Outcome: The proposed defence strategy outperforms refusal-based strategies in character hallucinations and query generalization.
Predictive Multiplicity of Knowledge Graph Embeddings in Link Prediction (2024.findings-emnlp)

Copied to clipboard

Challenge: Knowledge graph embeddings (KGE) models are often used to predict missing links for knowledge graphs (KGs) however, multiple KG embedds can give conflicting predictions for unseen queries.
Approach: They define predictive multiplicity in link prediction and introduce evaluation metrics to measure it using commonly used benchmark datasets.
Outcome: The proposed methods significantly mitigat conflicts by 66% to 78% in link prediction.
Continuous Relational Diffusion Driven Topic Model with Multi-grained Text for Microblog (2024.lrec-main)

Copied to clipboard

Challenge: Existing topic models assume that there are only 0/1-state relationships between the two parties in social networks, but the relationship status in real life is more complicated.
Approach: They propose a topic model that leverages unsupervised learning to mine hidden topics in document collections using multi-grained text.
Outcome: The proposed model can be applied to microblog with multi-grained text to realize the representation of the relationship state and make up for the context and structural information lost by previous representation methods.
A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions (2026.acl-long)

Copied to clipboard

Challenge: Existing research on reinforcement learning for LLMs under data scarcity has not been unified.
Approach: They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric.
Outcome: The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area.
Unveiling Privacy Risks in LLM Agent Memory (2025.acl-long)

Copied to clipboard

Challenge: Large Language Model (LLM) agents store private user-agent interactions in memory for demonstrations, introducing new privacy risks for LLM agents.
Approach: They propose an attack that extracts private information from memory under a black-box setting and propose a method that can be used to attack the agent.
Outcome: The proposed attack is effective under a black-box setting and it is demonstrated on two representative agents.
Noise Learning for Text Classification: A Benchmark (2022.coling-1)

Copied to clipboard

Challenge: Existing noise learning methods for text classification are underdeveloped . authors propose a noise learning benchmark for text classification .
Approach: They propose to use four state-of-the-art methods of noise learning from the image domain to classify text.
Outcome: The proposed benchmark of noise learning for text classification is based on four methods and five noise modes.
Copyright Detective: A Forensic System to Evidence LLMs Flickering Copyright Leakage Risks (2026.acl-demo)

Copied to clipboard

Challenge: **Copyright Detective** is the first interactive forensic system for detecting, analyzing, and visualizing potential copyright risks in LLM outputs.
Approach: They propose a system that detects copyright infringements and visualizes them . they use content recall testing, paraphrase-level similarity analysis and persuasive jailbreak probing .
Outcome: The proposed system detects, analyzes, and visualizes potential copyright risks in LLM outputs.
Emotion Recognition in Conversation via Dynamic Personality (2024.lrec-main)

Copied to clipboard

Challenge: Existing approaches to ERC focus on conversational contexts, but focus on static personality.
Approach: They propose a model that considers the dynamic personality of speakers during conversations.
Outcome: The proposed model outperforms existing models on three benchmark conversational datasets.
EchoMLLM: Incentivizing Echocardiographic Video Understanding with Keyframe Grounding and Report Generation (2026.findings-acl)

Copied to clipboard

Challenge: Echocardiography analysis requires a dual capability: rigorous quantitative keyframe localization and comprehensive qualitative synthesis.
Approach: They propose a unified framework designed for real-world echocardiography video understanding.
Outcome: a new framework is designed to support real-world echocardiography video understanding . it reduces temporal grounding errors by up to 76% and improves report generation quality by 65% .
TGEA: An Error-Annotated Dataset and Benchmark Tasks for TextGeneration from Pretrained Language Models (2021.acl-long)

Copied to clipboard

Challenge: Using pretrained language models, we propose an error-annotated dataset for text generation . we use carefully selected prompt words to guide GPT-2 to generate candidate sentences .
Approach: They propose an error-annotated dataset with multiple benchmark tasks for text generation from pretrained language models.
Outcome: The proposed dataset covers 24 types of errors according to common sense and linguistics.
SpiderFlow: Efficient Topology-Aware Scheduling for LLM Training Across Decentralized GPU Clusters (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to training large language models lack topologyaware task scheduling mechanisms and model parallelization strategies.
Approach: They propose a topology-aware scheduling system specifically designed for decentralized GPU clusters . they propose heuristic methods at the inter-cluster level with ILP-based optimization within clusters.
Outcome: The proposed system reduces job completion time by 1.2-1.3 and improves throughput by 1.12-1.25 . it also reduces scheduling overhead by 20-90 on average compared to state-of-the-art scheduling systems.
Massive End-to-end Speech Recognition Models with Time Reduction (2024.naacl-long)

Copied to clipboard

Challenge: Using the neural architecture of Google’s universal speech model, we reduce the frame rate and speed up training and inference.
Approach: They propose to use the neural architecture of Google’s universal speech model with additional funnel pooling layers to significantly reduce the frame rate and speed up training and inference.
Outcome: The proposed methods work with both connectionist temporal classification (CTC) and RNN-Transducer (RNN-T) and over two domains.
Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Current frontier models sometimes generate false outputs or answers that are not substantiated by evidence.
Approach: They propose Chinese SimpleQA, a Chinese benchmark to evaluate LLMs' factuality . they focus on Chinese language over 6 major topics with 99 diverse subtopics .
Outcome: The Chinese SimpleQA benchmark evaluates the factuality ability of LLMs . the questions and answers are short and easy-to-evaluate .
SAE-SSV: Supervised Steering in Sparse Representation Spaces for Reliable Control of Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have impressive capabilities in natural language understanding and generation, but controlling their behavior remains a challenge.
Approach: They propose a supervised steering approach that operates in sparse, interpretable representation spaces.
Outcome: The proposed approach achieves higher success rates with minimal degradation in generation quality compared to existing methods.
CRFR: Improving Conversational Recommender Systems via Flexible Fragments Reasoning on Knowledge Graphs (2021.emnlp-main)

Copied to clipboard

Challenge: Existing conversational recommender systems (CRS) do not track the deep shift of user interest in conversations due to the complex of high-order and incomplete paths.
Approach: They propose a conversational context-based reinforcement learning model which does explicit multi-hop reasoning on KGs with a contextual context-driven reinforcement learning framework.
Outcome: Extensive experiments show that CRFR improves on paths of interest shift in knowledge graphs (KGs) .
IDEA: An Interpretable and Editable Decision-Making Framework for LLMs via Verbal-to-Numeric Calibration (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches fail to integrate domain expert insights beyond simple prompting.
Approach: They propose a framework that extracts LLM decision knowledge into an interpretable parametric model over semantically meaningful factors.
Outcome: Experiments show that IDEA outperforms DeepSeek R1 and GPT-5.2 in accuracy and accuracy.
Global and Local Hierarchical Prompt Tuning Framework for Multi-level Implicit Discourse Relation Recognition (2024.lrec-main)

Copied to clipboard

Challenge: Recent methods to recognize hierarchical discourse relations without explicit connectives are inefficient and ignore the utilization of the output probability distribution information of the verbalizer.
Approach: They propose a global and local hierarchical prompt tuning framework which leverages top-up propagated probability as the global hierarchy to inject it into multi-level verbalizer.
Outcome: The proposed framework achieves competitive results on two benchmacks.
Guiding Dialogue Agents to Complex Semantic Targets by Dynamically Completing Knowledge Graph (2023.findings-acl)

Copied to clipboard

Challenge: Existing knowledge graphs are incomplete in tracking complex semantic relations of the target-oriented dialogue.
Approach: They combine methods of knowledge retrieval and relationship prediction to construct a context-related dynamic KG and a metric to evaluate the tracked path automatically.
Outcome: The proposed method can control the agent more logically and smoothly toward the complex target.
Predicate-Conditional Conformalized Answer Sets for Knowledge Graph Embeddings (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods provide probabilistic guarantees over a reference set of queries and answers, but they fail to identify when the answers to a query are uncertain.
Approach: They propose a method that approximates predicate-conditional coverage guarantees while maintaining compact prediction sets.
Outcome: The proposed method provides predicate-conditional coverage guarantees while maintaining compact prediction sets.
M2RC-EVAL: Massively Multilingual Repository-level Code Completion Evaluation (2025.acl-long)

Copied to clipboard

Challenge: Existing repository-level code completion benchmarks focus on a limited number of languages . existing benchmarks report overall average scores of different languages ignoring fine-grained abilities .
Approach: They propose to use repository-level code completion benchmarks to evaluate general code intelligence abilities across languages for existing code Large Language Models.
Outcome: The proposed benchmarks improve the code completion abilities of existing LLMs by using two types of annotations on the parsed syntax tree.
MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have greatly enhanced dialogue systems, but evaluation of their capabilities remains a challenge.
Approach: They propose a model to evaluate the fine-grained abilities of Large Language Models in multi-turn dialogues.
Outcome: The proposed model evaluates 21 popular chatbots based on MT-Bench-101 . it includes 3 overarching abilities and 13 distinct tasks within multi-turn dialogue scenarios.
GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing models for long contexts struggle to handle long inputs due to limited context window and memory usage.
Approach: They propose a graph-based agent system that analyzes long texts into a graphical graph . GraphReader consistently outperforms GPT-4-128k across context lengths from 16k to 256k .
Outcome: The proposed model outperforms existing models on four challenging benchmarks.
LLM-KT: Enhancing Large Language Models with Knowledge Tracing via Multi-Level Plug-and-Play Alignment (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to learn behavioral sequences fail to capture complex behavioral patterns due to a lack of deep reasoning capabilities and world knowledge.
Approach: They propose a framework that integrates the reasoning power of Large Language Models with the sequential modeling strengths of traditional KT methods via multi-level plug-and-play alignment.
Outcome: Extensive experiments on four standard datasets show that the proposed framework outperforms existing methods on state-of-the-art questions.
Aligning Recommendation and Conversation via Dual Imitation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing conversational recommendation systems ignore the advantage of user interest shift in connecting recommendation and conversation, leading to an ineffective loose coupling structure.
Approach: They propose a dual imitation to explicitly align recommendation and conversation paths . they propose to generate high-quality responses with accurate recommendations and coherent explanations .
Outcome: The proposed model outperforms the state-of-the-art models on recommendation and conversation performance with automatic, human, and novel explainability metrics.
Segment First or Comprehend First? Explore the Limit of Unsupervised Word Segmentation with Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to measure word segmentation only assess the language model's understanding of the overall meaning of sentences, lacking an evaluation of the language models' understanding capabilities at a fine-grained level.
Approach: They propose a framework to explore the limit of unsupervised word segmentation with Large Language Models (LLMs) they employ current mainstream LLMs to perform word segmentations across multiple languages .
Outcome: The proposed method improves on existing methods and combines the advanced pattern recognition capabilities of Aho-Corasick automata with the deep insights of well-pretrained LLMs.
BatonVoice: An Operationalist Framework for Enhancing Controllable Speech Synthesis with Linguistic Intelligence from LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches often fail to leverage the linguistic intelligence of Large Language Models (LLMs) Existing models lack the ability to follow text instructions for controllable Text-to-Speech (TTS).
Approach: They propose a framework where an LLM acts as a conductor, understanding user instructions and generating a textual plan - explicit vocal features.
Outcome: The proposed model outperforms open- and closed-source models in speech synthesis and achieves zero-shot cross-lingual generalization.
A Comparative Study of Explicit and Implicit Gender Biases in Large Language Models via Self-evaluation (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies on the explicit and implicit biases in large language models (LLMs) focus on either explicit or implicit bias.
Approach: They propose a self-evaluation-based two-stage measurement of explicit and implicit biases within large language models grounded in social psychology.
Outcome: The proposed model is based on two stages of self-evaluation on state-of-the-art LLMs to measure explicit bias toward social targets, where bias is less likely to be self-recognized by the LLM.
Can Large Language Models Detect Errors in Long Chain-of-Thought Reasoning? (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in o1-like models have generated long Chain-of-Thought reasoning steps to improve the reasoning abilities of existing Large Language Models (LLMs).
Approach: They propose a DeltaBench to analyze the quality and effectiveness of o1-like models and measure their ability to detect errors in long COT reasoning.
Outcome: The proposed model can detect errors in long COT reasoning.
ModularMoE: Fast LLM Customization with Parameter-Sharing Mixture-of-Experts for Low-Resource Settings (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models impose significant computational and storage burdens on personal devices . existing customization approaches incur excessive computational costs or lead to suboptimal performance .
Approach: They propose a training framework that converts pre-trained LLMs into parameter-sharing MoE models for lightweight deployment.
Outcome: The proposed training framework outperforms state-of-the-art training frameworks at the same sparsity level while delivering up to 2.71 inference speedup.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations