Papers by Yi Hu

59 papers
FISTAPruner: Layer-wise Post-training Pruning for Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing pruning methods require inefficient retraining for billion-scale LLMs or rely on heuristicically designed metrics to determine pruning masks, leading to performance degradation.
Approach: They propose a convex optimization model that induces sparsity in large language models by leveraging FISTA.
Outcome: The proposed method can remove 50% of model parameters while retaining 98.6% and 95.6% of the zero-shot performance.
Decentralized Arena: Towards Democratic and Scalable Automatic Evaluation of Language Models (2026.acl-long)

Copied to clipboard

Challenge: closed-ended question-based benchmarks struggle with saturation as newer models emerge . crowd-sourced leaderboards rely on costly and slow human judges .
Approach: They propose a framework that leverages collective intelligence from all large language models to evaluate each other.
Outcome: a new framework enables a democratic, pairwise evaluation of all large language models . it achieves 97% correlation with human judgements, while significantly reducing the cost.
SDBench: A Survey-based Domain-specific LLM Benchmarking and Optimization Framework (2025.acl-long)

Copied to clipboard

Challenge: acquiring domain-specific knowledge often requires professional expert manpower.
Approach: They propose a generic framework for generating evaluation datasets for domain-specific LLMs.
Outcome: The proposed framework reduces the reliance on expert manpower while ensuring that the collected data is uniformly distributed.
Task Oriented In-Domain Data Augmentation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for large language models suffer from two major issues: in-domain data are scarce compared with general domain-agnostic data.
Approach: They propose a task-oriented in-domain data augmentation framework that uses in- domain data selection and task-orientated synthetic passage generation to adapt LLMs to two domains: advertisement and math.
Outcome: The proposed framework improves LLM performance by 8% in the advertisement domain and 7.5% in the math domain.
How Do Answer Tokens Read Reasoning Traces? Self-Reading Patterns in Thinking LLMs for Quantitative Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Prior work on activation steering has focused on shaping reasoning traces, but it remains unclear how answer tokens actually read and integrate the reasoning to produce reliable outcomes.
Approach: They propose a training-free steering method that uses self-reading quality scores to guide inference toward benign self-readiness and away from uncertain and disorganized reading.
Outcome: The proposed method yields consistent accuracy gains in the reasoning traces generated by thinking LLMs.
Reasoning with Language Model is Planning with World Model (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have shown remarkable reasoning capabilities, particularly with Chain-of-Thought-style prompts.
Approach: They propose a framework that repurposes the LLM as both a world model and a reasoning agent and incorporates a principled planning algorithm (based on Monte Carlo Tree Search)
Outcome: The proposed framework repurposes the LLM as both a world model and a reasoning agent and incorporates a principled planning algorithm (based on Monte Carlo Tree Search) it achieves optimum balance between exploration and exploitation, while achieving high-reward reasoning paths efficiently.
Knowledge Graph-Guided Retrieval Augmented Generation (2025.naacl-long)

Copied to clipboard

Challenge: Existing studies on RAG focus on semantic retrieval of isolated relevant chunks, which ignore their intrinsic relationships.
Approach: They propose a framework that utilizes knowledge graphs to provide fact-level relationships between chunks, improving the diversity and coherence of the retrieved results.
Outcome: Extensive experiments on the HotpotQA dataset and its variants demonstrate the advantages of KG2RAG compared to existing RAG-based approaches in terms of response quality and retrieval quality.
Chinese Lexical Substitution: Dataset and Method (2023.emnlp-main)

Copied to clipboard

Challenge: Existing benchmarks for lexical substitution (LS) are limited and limited in coverage . despite extensive research on Lexical Substitution in various languages, there is limited evidence for LS in Chinese.
Approach: They propose to use human and machine collaboration to construct a Chinese LS dataset . they combine four unsupervised LS methods to generate candidate substitutes .
Outcome: The proposed method outperforms existing benchmarks on the Chinese lexical substitution task.
Understanding How Value Neurons Shape the Generation of Specified Values in LLMs (2025.findings-emnlp)

Copied to clipboard

Challenge: Current approaches to interpret value representations are limited by superficial judgments over mechanistic analysis.
Approach: They propose a mechanistic interpretability framework that uses the Schwartz Values Survey to interpret value . they use a dataset that operationalizes four dimensions of universal value through behavioral contexts .
Outcome: The proposed method bridges psychological value frameworks with neuron analysis in large language models.
Towards a Mechanistic Understanding of Large Reasoning Models: A Survey of Training, Inference, and Failures (2026.acl-long)

Copied to clipboard

Challenge: Recent research has shown that reinforcement learning can elicit intriguing emergent reasoning behaviors.
Approach: They propose a comprehensive survey of the mechanistic understanding of large reasoning models . they organize findings into three core dimensions: 1) training dynamics, 2) reasoning mechanisms, and 3) unintended behaviors.
Outcome: This paper synthesizes the mechanistic understanding of large reasoning models into three dimensions . authors outline a roadmap for future studies including improved interpretability and methodologies .
Beyond Chunking: Discourse-Aware Hierarchical Retrieval for Long Document Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Existing long document question answering systems process texts as flat sequences or use heuristic chunking, which overlooks the discourse structures that guide human comprehension.
Approach: They propose a discourse-aware hierarchical framework that leverages rhetorical structure theory for long document question answering.
Outcome: The proposed framework exhibits strong robustness across diverse document types and linguistic settings.
R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling (2021.acl-long)

Copied to clipboard

Challenge: Existing models with stacked layers do not explicitly model hierarchical structure of language understanding.
Approach: They propose a recursive Transformer model based on differentiable CKY style binary trees to emulate hierarchical composition process.
Outcome: The proposed model can predict words given their left and right abstraction nodes.
Multi-Aspect Controllable Text Generation with Disentangled Counterfactual Augmentation (2024.acl-long)

Copied to clipboard

Challenge: Existing studies neglect attribute correlations formed by the intertwining of different attributes.
Approach: They propose a multi-aspect controllable text generation method with disentangled counterfactual augmentation that alleviates imbalanced attribute correlations during training by disentanglement.
Outcome: The proposed method outperforms state-of-the-art methods in imbalanced and balanced attribute correlation scenarios.
[MASK] Insertion: a robust method for anti-adversarial attacks (2023.findings-eacl)

Copied to clipboard

Challenge: Existing studies have focused on adversarial defenses against pretrained language models.
Approach: They propose an adversarial defensing algorithm that inserts tokens into input sequences . they show an improvement in accuracy between 3.2 and 11.1 absolute points .
Outcome: The proposed algorithm improves model accuracy on clean and polluted inputs compared with state-of-the-art models .
Seeing the wood for the trees: a contrastive regularization method for the low-resource Knowledge Base Question Answering (2022.findings-naacl)

Copied to clipboard

Challenge: Existing methods for Knowledge Base Question Answering rely on semantic parsing and information retrieval.
Approach: They propose a contrastive regularization based method to extract correct answer entities from a context knowledge base and a corresponding question.
Outcome: The proposed method achieves state-of-the-art performance on the WebQuestionsSP dataset and the effectiveness of proposed modules is also evaluated.
MMAC: A Multilingual, Multimodal Alignment Framework for Cultural Grounding Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Existing models lack cultural alignment across modalities and languages . a new framework to assess cultural awareness across linguistics and languages is needed .
Approach: They propose a framework that integrates tri-modally aligned cultural benchmarks and a five-dimensional evaluation protocol to assess cross-country awareness disparities.
Outcome: The proposed framework assesses cultural awareness disparities across modalities and languages . it is the first dataset aligned at the input level across text, image, and speech .
Evade the Trap of Mediocrity: Promoting Diversity and Novelty in Text Generation via Concentrating Attention (2022.emnlp-main)

Copied to clipboard

Challenge: Recent studies have shown that powerful Transformer architectures produce dull high-frequency phrases, severely hurting the diversity and novelty of generated text.
Approach: They propose a method to control the sharpness of the attention distribution by python code and use it to learn a Bayesian approximation of posterior attention.
Outcome: The proposed method improves diversity and novelty while maintaining comparable quality on conditional and unconditional generation tasks.
Lying with Truths: Open-Channel Multi-Agent Collusion for Belief Manipulation via Generative Montage (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) evolve to autonomous agents synthesizing real-time information, but their reasoning capabilities introduce an unexpected attack surface.
Approach: They propose a framework that constructs deceptive narratives through adversarial debate and coordinated posting of evidence fragments, causing victims to internalize and propagate fabricated conclusions.
Outcome: The proposed framework constructs deceptive narratives through adversarial debate and coordinated posting of evidence fragments, causing victims to internalize and propagate fabricated conclusions.
LOFT: Scalable and More Realistic Long-Context Evaluation (2025.findings-naacl)

Copied to clipboard

Challenge: Long-context language models (LCLMs) can be used to perform tasks traditionally reliant on external tools like retrieval systems or databases.
Approach: They propose a benchmark to evaluate LCLMs' performance on in-context retrieval and reasoning tasks using a set of tokens.
Outcome: The proposed model outperforms state-of-the-art retrieval and RAG systems on in-context retrieval tasks while still requiring prompting strategies.
Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing image instruction fine-tuning datasets do not fully exploit visual information to enhance multimodal reasoning capabilities of Large language models (LLMs).
Approach: They propose a LLaVA-based model fine-tuned with MathV360K to bridge this gap by collecting 40K high-quality images with question-answer pairs from 24 existing datasets and synthesizing 320K new pairs.
Outcome: The proposed model improves the multimodal reasoning capabilities of LLaVA-1.5 and demonstrates enhanced generalizability on the MMMU benchmark.
EverMemOS: A Self-Organizing Memory Operating System for Structured Long-Horizon Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Existing memory systems for LLMs store isolated records and retrieve fragments . Existing systems store isolated data and fragments, limiting their ability to consolidate evolving experience and resolve conflicts.
Approach: They propose an engram-inspired memory operating system that implements an 'engram'-inspired lifecycle for computational memory.
Outcome: Experiments on LoCoMo, LongMemEval, and PersonaMeM-v2 show that EverMemeOS outperforms state-of-the-art methods on memory-augmented reasoning tasks.
SubTokenTest: A Practical Benchmark for Real-World Sub-token Understanding (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks have highlighted character-level tasks as lacking practical relevance . many real-world applications rely heavily on precise sub-token understanding .
Approach: They propose a benchmark that assesses sub-token understanding through practical tasks . they examine the impact of test-time scaling on sub-word reasoning .
Outcome: The proposed benchmark assesses sub-token understanding through practical tasks . it includes ten tasks across four domains and isolates tokenization-related failures .
Meta-Reinforced Multi-Domain State Generator for Dialogue Systems (2020.acl-main)

Copied to clipboard

Challenge: Existing methods to train a multi-domain dialogue state tracker are lacking in accuracy.
Approach: They propose a Meta-Reinforced Multi-Domain State Generator to train a DST meta-learning model with a few domains as source domains and a new domain as target domain.
Outcome: The proposed system outperforms the traditional training approach with extremely little training data in target domain.
AD-LLM: Benchmarking Large Language Models for Anomaly Detection (2025.findings-acl)

Copied to clipboard

Challenge: Anomaly detection (AD) is an important machine learning task with many real-world uses, including fraud detection, medical diagnosis, and industrial monitoring.
Approach: They propose a benchmark that evaluates how large language models (LLMs) can help with NLP anomaly detection.
Outcome: The proposed model can perform zero-shot detection without tasks-specific training, data augmentation and model selection, and it can suggest unsupervised AD models.
Don’t Miss the Potential Customers! Retrieving Similar Ads to Improve User Targeting (2021.findings-emnlp)

Copied to clipboard

Challenge: a method for user targeting is developed to identify online users to whom an ad should be targeted.
Approach: They propose a method for automatic augmentation of positive and negative clickthrough data for user targeting models.
Outcome: The proposed method can increase positive and negative instances of positive training instances on two datasets.
Improving Image Captioning Evaluation by Considering Inter References Variance (2020.acl-main)

Copied to clipboard

Challenge: Existing one-to-one metrics penalize mismatches without considering the intrinsic variance between ground truth captions.
Approach: They propose a one-to-one metric based on BERTScore that could be extended to include new features for image captioning evaluation.
Outcome: The proposed metric achieves state-of-the-art human judgment correlation while improving performance.
Three Minds, One Legend: Jailbreak Large Reasoning Model with Adaptive Stacked Ciphers (2026.findings-acl)

Copied to clipboard

Challenge: Existing jailbreak methods struggle to balance effectiveness with robustness against adaptive safety mechanisms.
Approach: They propose a novel approach that targets Large Reasoning Models through an adaptive encryption pipeline designed to overwhelm their reasoning capabilities.
Outcome: The proposed approach achieves an attack success rate of 85.6% on OpenAI GPT-o4-mini, outperforming state-of-the-art baselines by a significant margin of 17.2%.
Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions? (2023.emnlp-main)

Copied to clipboard

Challenge: Pre-trained vision and language models have demonstrated state-of-the-art capabilities over existing tasks involving images and texts.
Approach: They analyze a visual question answering dataset tailored for info-seeking questions . they show that pre-trained visual and language models can use fine-grained knowledge .
Outcome: The proposed dataset elicits models to use fine-grained knowledge learned during pre-training.
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage.
Approach: They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas.
Outcome: The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality.
Refining Sample Embeddings with Relation Prototypes to Enhance Continual Relation Extraction (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to extract relationships from texts depend on memory size and replay these memorized samples in subsequent tasks.
Approach: They propose to use a model to extract relations between entities from texts where the samples of different relations are delivered into the model continuously.
Outcome: The proposed model outperforms the state-of-the-art models and avoids catastrophic forgetting.
PUPPET: Neural-Symbolic Standardized Patients for Mental Health (2026.acl-long)

Copied to clipboard

Challenge: Existing LLM-based training approaches lack faithful responses to clinical errors and explainable feedback.
Approach: They propose a neural-symbolic virtual standardized patient governed by an OBSERVE-THINK-BEHAVE architecture that embeds LLM reasoning into a symbolic system where experts implant causal associations between intervention logic and patient mental states.
Outcome: The proposed model outperforms baselines in faithfulness and pedagogical value.
Predict the Future from the Past? On the Temporal Data Distribution Shift in Financial Sentiment Classifications (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods for financial sentiment analysis use random splits of a dataset into training and testing to ensure there is no distribution shift between training and deployment.
Approach: They propose a method that combines out-of-distribution detection with time series modeling for temporal financial sentiment analysis.
Outcome: The proposed method improves the model’s ability to adapt to evolving temporal shifts in a volatile financial market.
Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on knowledge distillation have shown that not all knowledge is necessary for learning a good student model.
Approach: They propose an actor-critic approach to selecting appropriate knowledge to transfer during the process of knowledge distillation.
Outcome: The proposed method outperforms several strong knowledge distillation baselines significantly on the GLUE datasets.
Bidirectional Hierarchical Attention Networks based on Document-level Context for Emotion Cause Extraction (2021.findings-emnlp)

Copied to clipboard

Challenge: Emotion cause extraction (ECE) aims to extract the causes behind certain emotion in text.
Approach: They propose a bidirectional hierarchical attention network corresponding to the specified candidate cause clause to capture document-level context in a structured and dynamic manner.
Outcome: The proposed method achieves competitive performances on two public datasets in Chinese and English.
Chain-Talker: Chain Understanding and Rendering for Empathetic Conversational Speech Synthesis (2025.findings-acl)

Copied to clipboard

Challenge: Current generative CSS models face interpretability limitations due to insufficient emotional perception and redundant discrete speech coding.
Approach: They propose a framework that aligns synthesized speech with the emotional context of user-agent interactions to achieve empathy.
Outcome: The proposed framework produces more expressive speech than existing methods on three datasets.
ICON: Improving Inter-Report Consistency in Radiology Report Generation via Lesion-aware Mixup Augmentation (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to radiology report generation lack inter-report consistency, exhibiting biases towards common patterns and susceptibility to lesion variants.
Approach: They propose a method which improves the inter-report consistency of radiology report generation by extracting lesions from input images and examining their characteristics.
Outcome: The proposed system captures similarities in semantically equivalent lesions and can be used to generate reports for two semantically identical cases.
Recurrence Boosts Diversity! Revisiting Recurrent Latent Variable in Transformer-Based Variational AutoEncoder for Diverse Text Generation (2022.findings-emnlp)

Copied to clipboard

Challenge: Variational Auto-Encoder (VAE) has been widely adopted in text generation due to its ability to learn flexible representations.
Approach: They propose a Transformer-based recurrent VAE structure that imposes recurrence on segment-wise latent variables with arbitrarily separated text segments and constructs the posterior distribution with residual parameterization.
Outcome: The proposed structure can deduce a non-zero lower bound of the KL term and enhance the entanglement of each segment and preceding latent variables, providing a theoretical guarantee of generation diversity.
Dialogue Meaning Representation for Task-Oriented Dialogue Systems (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing work on dialogue meaning representations is limited in scalability for complex expressions.
Approach: They propose a pliable and easily extendable representation for task-oriented dialogue . they propose an inheritance hierarchy mechanism focusing on domain extensibility .
Outcome: The proposed representation can be easily extended to a task-oriented dialogue dataset.
CoTKR: Chain-of-Thought Enhanced Knowledge Rewriting for Complex Knowledge Graph Question Answering (2024.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge rewriting methods may include irrelevant information, omit crucial details, or fail to align with the question’s semantics.
Approach: They propose a new rewriting method CoTKR for generating reasoning traces and corresponding knowledge in an interleaved manner, thereby mitigating the limitations of single-step knowledge rewrite.
Outcome: The proposed method mitigates the limitations of single-step knowledge rewriting and bridges the preference gap between the knowledge reactor and the question answering (QA) model.
UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition (2022.emnlp-main)

Copied to clipboard

Challenge: Existing studies study sentiment and emotion separately and do not fully exploit the complementary knowledge behind the two.
Approach: They propose a multimodal sentiment knowledge-sharing framework that unifies MSA and ERC tasks from features, labels, and models.
Outcome: The proposed framework achieves consistent improvements on four public benchmark datasets on MOSI, MOSEI, MELD, and IEMOCAP.
Sculpting the Vector Space: Towards Efficient Multi-Vector Visual Document Retrieval via Prune-then-Merge Framework (2026.findings-acl)

Copied to clipboard

Challenge: Visual Document Retrieval (VDR) is of importance in multimodal retrieval applications.
Approach: They propose a two-stage pruning and merging frameworks that combine pruning and merge techniques to achieve higher compression rates.
Outcome: The proposed framework outperforms existing methods on 29 visual document retrieval datasets.
NLP-ADBench: NLP Anomaly Detection Benchmark (2025.findings-emnlp)

Copied to clipboard

Challenge: Anomaly detection (AD) is an important machine learning task, but its effectiveness in detecting harmful content, phishing attempts, and spam reviews is limited.
Approach: They introduce NLP-ADBench, the most comprehensive NLP anomaly detection benchmark to date . it includes eight curated datasets and 19 state-of-the-art algorithms .
Outcome: The NLP-ADBench benchmark includes 19 state-of-the-art methods and 8 curated datasets . no single model dominates across all datasets, indicating need for automated model selection .
HVGuard: Utilizing Multimodal Large Language Models for Hateful Video Detection (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for hateful video detection rely on unimodal analysis or feature fusion . Existing tools struggle to capture cross-modal interactions and reason through implicit hate in sarcasm and metaphor .
Approach: They propose a reasoning-based hateful video detection framework with multimodal large language models . they integrate Chain-of-Thought reasoning to enhance multimodal interaction modeling .
Outcome: The proposed framework outperforms existing tools on two public datasets covering English and Chinese.
SPPD: Self-training with Process Preference Learning Using Dynamic Value Margin (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to improve numerical and logical reasoning of Large Language Models are limited . existing approaches rely on prompt engineering and pretrained knowledge to ensure correctness .
Approach: They propose to train LLMs with process-based reasoning using a dynamic value margin . they use the Bellman optimality equation to derive a value margin for step-level preference optimization .
Outcome: The proposed method is equivalent to on-policy policy gradient methods under constrained reward functions.
FAIRGAMER: Evaluating Social Biases in LLM-Based Video Game NPCs (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have enhanced or replaced traditional non-player characters in video games.
Approach: They propose a benchmark to evaluate social biases across three interaction patterns: transaction, cooperation, and competition.
Outcome: The proposed benchmark assesses four bias types across transaction, cooperation, and competition using a novel metric, FairMCV.
Cognitive Alpha Mining via LLM-Driven Code-Based Evolution (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to finding effective predictive signals from financial data are limited by their complexity and low signal-to-noise ratio.
Approach: They propose a framework that combines code-level alpha representation with LLM-driven reasoning and evolutionary search.
Outcome: The proposed framework combines code-level alpha representation with LLM-driven reasoning and evolutionary search.
MR-ALIGN: Meta-Reasoning Informed Factuality Alignment for Large Reasoning Models (2026.findings-acl)

Copied to clipboard

Challenge: Large reasoning models (LRMs) show strong capabilities in complex reasoning, yet their marginal gains on evidence-dependent factual questions are limited.
Approach: They propose a Meta-Reasoning informed alignment framework that quantifies state-transition probabilities along the model’s thinking process and constructs a transition-aware implicit reward that reinforces beneficial reasoning patterns while suppressing defective ones at the atomic thinking segments.
Outcome: Empirical evaluations of four factual QA datasets and one long-form factuality benchmark show that MR-ALIGN consistently improves accuracy and truthfulness while reducing misleading reasoning.
Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text Generation (2022.naacl-main)

Copied to clipboard

Challenge: Variational Auto-Encoders are often used for text generation tasks due to the sequential nature of the text.
Approach: They propose a variational Transformer framework that learns a series of layer-wise latent variables with each inferred from those of lower layers and tightly coupled with the hidden states by low-rank tensor product.
Outcome: The proposed framework can learn latent variables from lower layers and incorporate more information.
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)

Copied to clipboard

Challenge: a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide.
Approach: They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions .
Outcome: The proposed agents are based on operating systems (OS) and operating systems frameworks.
Do Code Semantics Help? A Comprehensive Study on Execution Trace-Based Information for Code Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Code Large Language Models have limited ability to reason about runtime behavior and understand functionality . authors present a generic framework to support integrating semantic information to code task-relevant prompts .
Approach: a study examines the role of trace-based semantic information in boosting supervised fine-tuning and post-phase inference of Code LLMs.
Outcome: a new framework integrates semantic information to code task-relevant prompts . the proposed framework shows that trace-based semantic information boosts reasoning ability .
Avoiding Knowledge Edit Skipping in Multi-hop Question Answering with Guided Decomposition (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for knowledge editing fail to work in multi-hop question answering due to 'edit skipping' edit skipping occurs due to the mismatch between the granularity of LLMs in problem-solving and the facts in the edited memory.
Approach: They propose a retrieval-augmented generation-based method that edits knowledge without modifying parameters without retraining LLMs.
Outcome: The proposed method outperforms state-of-the-art methods for KE in multi-hop question answering.
AlphaQT-Bench: Diagnosing the Gap between Financial Code Generation and Quantitative Reasoning in LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks rely on outcome-driven metrics such as profitability and look-ahead bias.
Approach: They propose a diagnostic benchmark for instruction-grounded financial code generation under strict semantic and temporal constraints.
Outcome: The proposed benchmarks show that the models fail under causal, structural, or functional constraints.
OneRec-Think: In-Text Reasoning for Generative Recommendation (2026.acl-long)

Copied to clipboard

Challenge: Existing generative models lack the capacity for explicit and controllable reasoning, a key advantage of LLMs.
Approach: They propose a framework that integrates dialogue, reasoning, and personalized recommendation.
Outcome: Experiments across public benchmarks show state-of-the-art performance.
Beyond Dynamic Quantization: An Efficient Static Hierarchical Mix-precision Framework for Near-Lossless LLM Compression (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing methods for dynamic quantization are hardware-unfriendly and often lead to large quantization errors in static scenarios.
Approach: They propose a Static Hierarchical Mix-precision Quantization method which quantifies both inter-layer and intra-layer sensitivity through unified derivations involving Hessian.
Outcome: The proposed method achieves 75.58% on zero-shot reasoning tasks while yielding average speedup of 2.86.
SPARK: Simulating the Co-evolution of Stance and Topic Dynamics in Online Discourse with LLM-based Agents (2025.emnlp-main)

Copied to clipboard

Challenge: a new framework for topic evolution and stance dynamics is needed to understand online discourse . topic evolution is central to understanding fragmentation of debates, spread of misinformation .
Approach: They propose a stance and topic evolution reasoning framework for co-evolution of topics and stances through natural language interactions.
Outcome: The proposed framework captures key empirical patterns across five real-world domains.
DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation (2022.acl-long)

Copied to clipboard

Challenge: Existing pre-trained dialog models shed light on various downstream tasks in natural language processing (NLP).
Approach: They propose a dialog pre-training framework that introduces latent variables into the enhanced encoder-decoder pre-train framework to increase relevance and diversity of responses.
Outcome: The proposed model achieves state-of-the-art on personaChat, DailyDialog, and DSTC7-AVSD datasets.
TOREE: Evaluating Topic Relevance of Student Essays for Chinese Primary and Middle School Education (2024.findings-acl)

Copied to clipboard

Challenge: Existing research on Automatic Essay Scoring (AES) for Chinese essays has overlooked topic relevance and lacks detailed feedback.
Approach: They propose to use TOREE to assess topic relevance in Chinese primary and middle school students’ essays to improve automatic and human evaluations.
Outcome: The proposed method significantly improves both automatic and human evaluations across four diverse LLMs.
Rhombus: Incentivizing Coordination in Parallel Thinking through Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Parallel thinking is a promising avenue for scaling test-time compute in Large Language Models . however, coordinating the exploration and aggregation stages remains challenging .
Approach: They propose a parallel thinking framework that explicitly incentivizes coordination between components via end-to-end reinforcement learning.
Outcome: The proposed framework improves accuracy by 6.0% over long chain-of-thought baselines while reducing wall-clock latency by 39.4% under matched token budgets.
RADAR: Enhancing Radiology Report Generation with Supplementary Knowledge Injection (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to enhance radiology report generation overlook the knowledge already embedded within the models, leading to redundant information integration.
Approach: They propose a framework for enhancing radiology report generation with supplementary knowledge injection that leverages both internal and external knowledge.
Outcome: Extensive experiments on MIMIC-CXR, CheXpert-Plus, and IU X-ray show that the proposed model outperforms state-of-the-art LLMs in both language quality and clinical accuracy.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations