Papers by Lei Jiang

75 papers
MentalSeek-Dx: Towards Progressive Hypothetico-Deductive Reasoning for Real-world Psychiatric Diagnosis (2026.acl-long)

Copied to clipboard

Challenge: Mental health disorders represent a burgeoning global public health challenge . lack of ecological validity and fine-grained diagnostic supervision limits their utility .
Approach: They propose a medical-specialized LLM trained to internalize clinical reasoning process through supervised trajectory construction and curriculum-based reinforcement learning.
Outcome: The proposed model achieves state-of-the-art with only 14B parameters, establishing a clinically grounded framework for reliable psychiatric diagnosis.
Chart-MRAG: Benchmarking Multimodal Retrieval Augmented Generation on Chart-based Documents (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on simple image-text interactions, overlooking complex visual formats like charts.
Approach: They propose a semi-automatic framework for generating evaluation samples through multi-modal keypoint extraction, knowledge graph construction, and qa pair synthesis.
Outcome: The proposed framework generates 4,738 question-answering pairs across 8 domains from real-world documents.
GMH: A General Multi-hop Reasoning Model for KG Completion (2021.emnlp-main)

Copied to clipboard

Challenge: Knowledge graphs are incomplete with many facts missing, causing performance bottlenecks in many applications.
Approach: They propose a general multi-hop reasoning task that can be formulated as a search process and can be extended to long-distance reasoning scenarios.
Outcome: The proposed model improves on baselines in short and long distance reasoning scenarios.
ZoFia: Zero-Shot Fake News Detection with Entity-Guided Retrieval and Multi-LLM Interaction (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are limited by knowledge cutoff and can generate factual hallucinations when handling time-sensitive news.
Approach: They propose a two-stage zero-shot fake news detection framework that uses a hierarchical salience and saliency-calibrated minimum margin of relevance algorithm to extract core entities accurately.
Outcome: The proposed framework outperforms existing zero-shot baselines and even most few-shot methods on two public datasets.
Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language Translation (2024.lrec-main)

Copied to clipboard

Challenge: Previous Sign Language Translation methods have relied on gloss annotations to improve performance, but labeling high-quality glosses is labor-intensive and inefficient.
Approach: They propose to integrate Large Language Model (LLM) into SLT by factorizing learning into two stages to improve the learning curve.
Outcome: The proposed approach improves on three SLT datasets conducted under the gloss-free setting.
MINED: Probing and Updating with Multimodal Time-Sensitive Knowledge for Large Multimodal Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for Large Multimodal Models (LMMs) are constrained by static representations, inadequately evaluating their ability to understand time-sensitive knowledge.
Approach: They propose a benchmark containing 2,104 time-sensitive knowledge samples spanning six knowledge types to evaluate temporal awareness along 6 key dimensions and 11 challenging tasks.
Outcome: The proposed benchmark measures temporal awareness along 6 key dimensions and 11 tasks, while most open-source LMMs still lack time understanding ability.
A Challenge Dataset and Effective Models for Aspect-Based Sentiment Analysis (D19-1)

Copied to clipboard

Challenge: Existing ABSA methods only use one aspect or multiple aspects with the same sentiment polarity . recent studies show that neural network methods can be trained end-to-end and automatically learn important features.
Approach: They propose a large-scale multi-aspect multi-sentiment dataset with two different aspects with different sentiment polarities.
Outcome: The proposed model outperforms the state-of-the-art models on the large-scale dataset . it is based on a novel neural network approach that can be trained end-to-end .
Bayesian Optimization for Controlled Image Editing via LLMs (2025.findings-acl)

Copied to clipboard

Challenge: achieving precise control over generated content and maintaining semantic consistency remain significant limitations, particularly concerning grounding techniques and the necessity for model fine-tuning.
Approach: They propose an off-the-shelf approach that integrates Large Language Models with Bayesian Optimization to facilitate precise and user-friendly image editing.
Outcome: The proposed approach outperforms existing methods in editing accuracy and semantic preservation, as validated using different LLMs including Claude3 and GPT-4.
Toward Better Loanword Identification in Uyghur Using Cross-lingual Word Embeddings (C18-1)

Copied to clipboard

Challenge: Almost every natural language processing task suffers from data sparseness.
Approach: They propose a method which identify loanwords in monolingual corpora by using cross-lingual word embeddings as core feature and a log-linear model which combines several shallow features to predict the final results.
Outcome: The proposed method outperforms baseline models significantly on loanword identification and translation in four languages and eight translation directions.
Xiaomingbot: A Multilingual Robot News Reporter (2020.acl-demos)

Copied to clipboard

Challenge: Xiaomingbot is a multilingual and multimodal software robot with four capabilities: news generation, news translation, news reading and avatar animation.
Approach: They propose to build a multilingual and multimodal software robot with four inte- gal capabilities: news generation, news translation, news reading and avatar animation.
Outcome: The proposed system generates Chinese news, then reads it in multiple languages and generates an animated avatar reading it.
The Role of Deductive and Inductive Reasoning in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated impressive capabilities in reasoning tasks, yet their reliability in problem-solving remains debatable.
Approach: They propose a framework that integrates both deductive and inductive reasoning approaches to enhance LLM reasoning by progressively adapting its reasoning pathways based on problem complexity.
Outcome: The proposed framework achieves 70.3% accuracy on AIW, compared to 62.2% for Tree of Thought, while maintaining lower computational costs.
Emotion Transfer with Enhanced Prototype for Unseen Emotion Recognition in Conversation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing research on emotion recognition in conversation does not reach a consensus on classification theories . despite this, there is no clear consensus on how to recognize previously unseen emotions in real-world applications.
Approach: They propose a prototype-based emotion transfer framework that can be used in real-world applications.
Outcome: The proposed framework shows promise but still faces key challenges in the field of emotion recognition in conversation.
Parameter Importance is Not Static: Evolving Parameter Isolation for Supervised Fine-Tuning (2026.acl-long)

Copied to clipboard

Challenge: Recent approaches to fine-tuning of large language models suffer from task interference and catastrophic forgetting.
Approach: They propose a fine-tuning framework that adapts isolation decisions based on online estimates of parameter importance.
Outcome: The proposed framework reduces interference and forgetting while releasing outdated parameters to recover plasticity.
ArchiDocGen: Multi-Agent Framework for Expository Document Generation in the Architectural Industry (2025.acl-industry)

Copied to clipboard

Challenge: drafting method statements is labor-intensive and time-consuming . traditional methods involve using static templates filled in manually by engineers .
Approach: They propose a framework that automates method statement generation by using multi-agent collaboration.
Outcome: The proposed framework achieves 4.38 ContentScore, excelling in specialization, completeness, organization, and clarity.
Leveraging Human and Machine Preferences for Zero-shot Detection of AI-Generated Text (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models have enabled generated texts to closely mimic human writing, posing significant challenges to the detection of AI-generated content.
Approach: They propose a human-machine prediction discrepancy adapter for AI-generated text detection . they use a joint fine-tuning strategy and a discrepany-aware reweighting mechanism .
Outcome: The proposed framework improves the detection performance of five representative models under various evaluation scenarios.
Why Supervised Fine-Tuning Fails to Learn: A Systematic Study of Incomplete Learning in Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Incomplete learning is widespread and heterogeneous in large language models . authors identify five recurrent sources of incomplete learning: missing prerequisite knowledge, conflicts between SFT supervision and pre-training knowledge, internal inconsistencies within SFT data, left-side forgetting during sequential fine-tuning, and insufficient optimization for rare or complex patterns.
Approach: They propose a diagnostic-first framework that maps incomplete learning to causes . they identify five recurrent sources of incomplete learning: missing prerequisite knowledge, conflicts between supervision and pre-training knowledge, internal inconsistencies, left-side forgetting during sequential fine-tuning, and insufficient optimization for rare or complex patterns.
Outcome: The proposed framework maps incomplete learning to causes using observable training and inference signals.
RecInDial: A Unified Framework for Conversational Recommendation with Pretrained Language Models (2022.aacl-main)

Copied to clipboard

Challenge: Existing generative methods to recommend items are shallowly integrated into the model training and have poor chit-chat ability.
Approach: They propose a framework that integrates recommendation into the dialog generation by introducing a vocabulary pointer.
Outcome: The proposed framework outperforms the state-of-the-art models on a benchmark dataset.
NOAHQA: Numerical Reasoning with Interpretable Graph Question Answering Dataset (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing question answering datasets lack numerical reasoning and reasoning processes . current research on numerical reasoning focuses on simple calculations .
Approach: They propose a conversational and bilingual question answering dataset with numerical reasoning with compound mathematical expressions.
Outcome: The proposed model achieves 55.5 exact match scores while human performance is 89.7.
EGSS: Entropy-guided Stepwise Scaling for Reliable Software Engineering (2026.acl-long)

Copied to clipboard

Challenge: Entropy-Guided Stepwise Scaling (EGSS) is a novel TTS framework for software engineering tasks.
Approach: They propose an entropy-guided stepwise scaling framework that balances efficiency and effectiveness through entropic-guide encoding and robust test-suite augmentation.
Outcome: EGSS boosts performance by 5–10% across all evaluated models, and reduces inference-time token usage by over 28% . compared to existing methods, EGS reduces token usage and reduce inference time by over 20% .
DCP: Dual-Cue Pruning for Efficient Large Vision-Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing pruning methods for large vision language models use visual tokens to prune . existing methods fail to balance efficiency and semantic alignment due to large number of visual token.
Approach: They propose a cross-modal pruning framework that considers textual semantics and visual self-attention to combine them to achieve efficient inference acceleration.
Outcome: The proposed pruning framework can retain only 25% of the visual tokens, with a minimal performance degradation of only 0.063% on LLaVA-1.5-13B.
Time-RA: Towards Time Series Reasoning for Anomaly Diagnosis with LLM Feedback (2026.findings-acl)

Copied to clipboard

Challenge: Time series anomaly detection (TSAD) has traditionally focused on binary classification and lacks the fine-grained categorization and explanatory reasoning required for transparent decision-making.
Approach: They propose a time-series reasoning task that reformulates TSAD from discriminative to reasoning-intensive paradigm.
Outcome: The proposed task reformulates TSAD from discriminative to reasoning-intensive paradigm.
Align Voting Behavior with Public Statements for Legislator Representation Learning (2021.acl-long)

Copied to clipboard

Challenge: Existing studies rely on roll call data to estimate political preference of legislators.
Approach: They propose to integrate voting behavior and public statements on Twitter to jointly model legislators.
Outcome: The proposed model improves on the task of roll call vote prediction . it also shows that the model captures nuances in statements .
Syntactic Graph Convolutional Network for Spoken Language Understanding (2020.coling-main)

Copied to clipboard

Challenge: Existing work on slot filling and intent detection builds joint models without prior knowledge of linguistic knowledge.
Approach: They propose a joint model that integrates syntactic structure for learning slot filling and intent detection jointly.
Outcome: The proposed model outperforms existing models on two public benchmark datasets and further improves on slot filling and intent detection.
SAPGraph: Structure-aware Extractive Summarization for Scientific Papers with Heterogeneous Graph (2022.aacl-main)

Copied to clipboard

Challenge: Abstractive and extractive methods are used to condense long text into concise summaries while retaining essential information.
Approach: They propose to use paper structure to extract paper summaries from long text . they provide a large-scale dataset of COVID-19-related papers .
Outcome: The proposed framework generates more comprehensive and valuable summaries compared to previous work on COVID-19-related papers.
CAGenMol: Condition-Aware Diffusion Language Model for Goal-Directed Molecular Generation (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to optimize target-directed molecular generation fail to reconcile conflicting objectives without compromising structural validity.
Approach: They propose a condition-aware discrete diffusion framework that allows for conditional denoising guided by heterogeneous structural and property signals.
Outcome: The proposed framework improves on structure-conditioned, property-conditioned and dual-conditioned benchmarks in binding affinity, drug-likeness, and success rate.
Threshold Filtering Packing for Supervised Fine-Tuning: Training Related Samples within Packs (2025.naacl-long)

Copied to clipboard

Challenge: Randomly concatenating data points can lead to cross-contamination due to the significant difference in their subject matter.
Approach: They propose a method that randomly concatenates data of varying lengths until reaching the designed maximum length to optimize context length and reduce padding.
Outcome: The proposed method significantly improves performance on GSM8K and HumanEval, and also improves fairness and accuracy by 15%.
Dynamic Nonlinear Mixup with Distance-based Sample Selection (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to augment data with mixup are limited by the space of synthetic data and its regularization effect.
Approach: They propose a dynamic nonlinear mixup with distance-based sample selection which generates multiple sample pairs based on the distance between each sample.
Outcome: The proposed method outperforms state-of-the-art methods on multiple public datasets.
Reason Only When Needed: Efficient Generative Reward Modeling via Model-Internal Uncertainty (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to generating reward models rely on voting-based mechanisms to evaluate CoT outputs.
Approach: They propose an efficient generative reward modeling framework grounded in model-internal uncertainty.
Outcome: The proposed framework reduces inference cost while improving answer accuracy.
From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan (2026.acl-long)

Copied to clipboard

Challenge: Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages.
Approach: They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English.
Outcome: The proposed model outperforms open-source and Tibetan-focused models on diverse tasks.
Slot Transferability for Cross-domain Slot Filling (2021.findings-acl)

Copied to clipboard

Challenge: Existing work on slot filling uses labeled data from source domains to train a model for target domains.
Approach: They propose a model-agnostic Slot Transferability Measure (STM) to evaluate the transferability from a source slot to a target slot.
Outcome: The proposed method outperforms state-of-the-art models on multiple datasets and models.
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications.
Approach: They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions.
Outcome: The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions.
Latent Distribution Decouple for Uncertain-Aware Multimodal Multi-label Emotion Recognition (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on improving fusion strategies and modeling modality-to-label dependencies, but they overlook the impact of aleatoric uncertainty, which is inherent noise in multimodal data.
Approach: They propose a latent emotional distribution decomposition with uncertainty perception framework to model aleatoric uncertainty in multimodal data.
Outcome: The proposed framework achieves state-of-the-art performance on the CMU-MOSEI and M3ED datasets, highlighting the importance of uncertainty modeling in MMER.
SenDetEX: Sentence-Level AI-Generated Text Detection for Human-AI Hybrid Content via Style and Context Fusion (2025.emnlp-main)

Copied to clipboard

Challenge: Text generated by Large Language Models (LLMs) now rivals human writing, raising concerns about its misuse.
Approach: They propose a framework for sentence-level AI-generated text detection via style and context fusion.
Outcome: The proposed framework outperforms baseline models in detection accuracy while exhibiting transferability and robustness.
Diagnosing Moral Reasoning Acquisition in Language Models: Pragmatics and Generalization (2025.findings-emnlp)

Copied to clipboard

Challenge: Prior research has shown that LLMs fail to perform satisfactorily on moral cognizance tasks .
Approach: They propose to use curated datasets to improve LLMs' moral cognizance . they find pragmatic dilemma constrains generalization ability of current learning paradigms .
Outcome: The proposed learning paradigms fail to perform on moral cognizance tasks, the authors show . they show that the pragmatic dilemma is the primary bottleneck for moral reasoning acquisition .
Beyond Perception: Evaluating Abstract Visual Reasoning through Multi-Stage Task (2025.findings-acl)

Copied to clipboard

Challenge: Existing AVR benchmarks focus on single-step reasoning, emphasizing the end result but neglecting the multi-stage nature of reasoning process.
Approach: They propose a multi-stage AVR benchmark based on RAVEN to assess reasoning across varying levels of complexity.
Outcome: The proposed metric considers the correctness of intermediate steps in addition to the final outcomes.
Language Generation via Combinatorial Constraint Satisfaction: A Tree Search Enhanced Monte-Carlo Approach (2020.findings-emnlp)

Copied to clipboard

Challenge: Generating natural language under complex constraints is a principled formulation towards controllable text generation.
Approach: They propose a method to specify combinatorial constraints for sentence generation . they use a tree search algorithm embedded into the proposal process of the Markov Chain Monte Carlo .
Outcome: The proposed method achieves consistent and significant improvement on multiple language generation tasks.
KVPR: Efficient LLM Inference with I/O-Aware KV Cache Partial Recomputation (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to inference large language models are limited by CPU capabilities and memory constraints.
Approach: They propose an efficient I/O-aware LLM inference method that overlaps GPU computation with KV cache transfer to minimize idle GPU time.
Outcome: The proposed method reduces the cost of auto-regressive decoding by 35.8% . it also achieves 46.2% higher throughput during decoding compared to state-of-the-art methods.
Smart-Searcher: Incentivizing the Dynamic Knowledge Acquisition of LLMs via Reinforcement Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) are powerful but prone to hallucinations due to static knowledge. Retrieval-augmented generation (RAG) helps by injecting external information, but current methods are costly, generalize poorly, or ignore the model’s internal knowledge.
Approach: They propose a framework to train large language models to leverage both internal and external knowledge sources.
Outcome: The proposed framework outperforms existing methods and achieves efficient retrieval-augmented reasoning.
PACE: Predictive Adaptive Context Extraction for Long-Horizon LLM Agents (2026.acl-long)

Copied to clipboard

Challenge: Large Language Model (LLM) agents struggle with ultra-long-horizon tasks requiring hundreds or thousands of interaction steps.
Approach: They propose a framework that reconceptualizes context management as a Next Step Prediction problem.
Outcome: The proposed framework improves task success rates and robust cross-lingual performance.
S2-MAD: Breaking the Token Barrier to Enhance Multi-Agent Debate Efficiency (2025.naacl-long)

Copied to clipboard

Challenge: Large language models exhibit limitations when handling complex mathematical reasoning and logical inference tasks.
Approach: They propose a sparsification strategy to reduce token costs within Multi-agent Debate (MAD) this strategy minimizes ineffective exchanges of information and unproductive discussions among agents .
Outcome: The proposed approach reduces token costs by up to 94.5% while maintaining performance degradation below 2.0%.
Graph Neural Network Enhanced Retrieval for Question Answering of Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Existing retrieval methods divide reference documents into passages, treating them in isolation. Existing methods only use contiguous passages or keywords.
Approach: They propose a retrieval method that leverages graph neural networks to exploit relatedness between passages to enhance retrieval.
Outcome: The proposed method improves retrieval by exploiting the relatedness between passages.
Act as you think: Reinforcing Consistent Reasoning in Medical Visual Question Answering (2026.acl-long)

Copied to clipboard

Challenge: Recent advances have improved the accuracy of medical visual question answering (Med-VQA) however, the high stakes nature of the medical domain has precipitated a shift towards interpretability and transparency of reasoning processes.
Approach: They propose a reinforcement learning from verifiable rewards framework that rewards internal consistency and logical coherence.
Outcome: The proposed framework rewards internal consistency and logical coherence, and is highly versatile, the authors show.
GRACE: Gradient Harmonized and Cascaded Labeling for Aspect-based Sentiment Analysis (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing studies ignore aspect terms interaction when labeling polarities . aspect terms extraction and aspect sentiment classification are two fundamental tasks .
Approach: They propose a GRadient hArmonized and CascadEd labeling model to solve the imbalance issue . they extend the gradient harmonized mechanism used in object detection to aspect-based sentiment analysis .
Outcome: The proposed model achieves consistency improvement on multiple benchmark datasets and generates state-of-the-art results.
ProReason: Multi-Modal Proactive Reasoning with Decoupled Eyesight and Wisdom (2025.emnlp-main)

Copied to clipboard

Challenge: Large vision-language models often prioritize language knowledge over image information on visual reasoning tasks, incurring performance degradation.
Approach: They propose a visual reasoning framework that decouples vision-reasoning capabilities and multi-run proactive perception.
Outcome: The proposed framework outperforms existing models on benchmarks for open-source and closed-source models with 13.2% performance gain.
Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive Benchmark (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies focus on evaluating large language models in close-ended QA tasks, but many clinical decisions involve answering open-ended questions without pre-set options.
Approach: They construct a benchmark to better understand large language models in the clinic . they use existing datasets to evaluate LLMs in clinical situations .
Outcome: The proposed model outperforms human experts in multiple medical tasks.
Learning Collaborative Agents with Rule Guidance for Knowledge Graph Reasoning (2020.emnlp-main)

Copied to clipboard

Challenge: Walk-based models have shown their advantages in knowledge graph reasoning but are limited by their representations and generalizability.
Approach: They propose a walk-based model that leverages high-quality rules generated by symbolic-based methods to provide reward supervision for walk- based agents.
Outcome: Experiments on benchmark datasets show that RuleGuider improves the performance of walk-based models without losing interpretability.
Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding (2024.emnlp-main)

Copied to clipboard

Challenge: Existing models for GUI understanding ignore a key GUI-referring task: screen reading based on user-indicated points.
Approach: They propose a Tree-of-Lens agent that constructs a Hierarchical Layout Tree based on user input points and a GUI screenshot.
Outcome: The proposed agent can interpret the Screen Point-and-Read task on mobile, web, and operating systems.
Towards Proactive Information Probing: Customer Service Chatbots Harvesting Value from Conversation (2026.findings-acl)

Copied to clipboard

Challenge: a new technology is transforming customer service chatbots into strategic bridges for business intelligence . a recent study shows that customer service bots are increasingly being used as reactive support tools .
Approach: They propose a task of Proactive Information Probing which optimizes when to probe users for pre-specified information while minimizing conversation turns and user friction.
Outcome: The proposed framework outperforms baselines in both information probing and service quality.
Mitigating Cultural Bias in LLMs via Multi-Agent Cultural Debate (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to evaluate large language models fail to address cultural bias in non-Western languages . Chinese prompting shifts bias toward East Asian perspectives rather than eliminating it, authors say .
Approach: They propose a Chinese–English bilingual benchmark and multi-agent vote frameworks that enable explicit "no bias" judgments.
Outcome: The proposed framework achieves 57.6% average No Bias Rate on Chinese-English benchmark and 86.0% on Arabic CAMeL benchmark.
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing large language model evaluation benchmarks focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities.
Approach: They propose a comprehensive benchmark covering 29 languages, built on an English benchmark.
Outcome: The MMLU-ProX is a comprehensive benchmark covering 29 languages, built on an English benchmark.
GATE: Graph-based Adaptive Tool Evolution Across Diverse Tasks (2026.acl-long)

Copied to clipboard

Challenge: Existing toolsets that use large language models are limited to single-task settings.
Approach: They propose a framework that dynamically constructs and evolves a hierarchical graph of reusable tools across multiple scenarios.
Outcome: The proposed framework achieves up to 4.3 faster milestone completion in Minecraft compared to the previous state-of-the-art method and provides an average improvement of 9.23% over existing tool-making methods in code generation tasks and 10.03% in agent tasks.
CAFE: Retrieval Head-based Coarse-to-Fine Information Seeking to Enhance Multi-Document QA Capability (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods to extend context length of Large Language Models (LLMs) still struggle with retrieval and reasoning in long context inputs.
Approach: They propose a coarse-to-fine method to enhance multi-document question-answering capacities by removing background and distracting documents.
Outcome: Experiments show that CAFE outperforms baseline methods on multiple documents.
Retrieval-Augmented Retrieval: Large Language Models are Strong Zero-Shot Retriever (2024.findings-acl)

Copied to clipboard

Challenge: Large-scale retrieval is indispensable in information-seeking tasks such as open-domain question answering and knowledgegrounded dialogue.
Approach: They propose to use a large language model (LLM) to augment a query with its potential answers by prompting LLMs with a composition of the query and the query’s in-domain candidates.
Outcome: The proposed method breaks brute-force combinations of retrievers with LLMs and lifts the performance of zero-shot retrieval to be very competitive on benchmark datasets.
Hard Prompts Made Interpretable: Sparse Entropy Regularization for Prompt Tuning with RL (2024.acl-long)

Copied to clipboard

Challenge: Prompt tuning is an important technique for directing model behaviors and eliciting desired responses.
Approach: They propose to find optimal prompt tokens using soft Q-learning to optimize models for prompt tuning.
Outcome: The proposed method improves on baseline prompt tuning, and the results are more natural and interpretable.
Learning to Select In-Context Demonstration Preferred by Large Language Model (2025.findings-acl)

Copied to clipboard

Challenge: In-context learning (ICL) enables large language models to perform tasks with only a few examples as demonstrations.
Approach: They propose a generative preference learning framework that leverages LLM feedback to directly optimize demonstration selection for ICL.
Outcome: Experiments on 19 datasets across 11 task categories show that GenICL achieves superior performance than existing methods in selecting the most effective demonstrations.
Debiasing with Sufficient Projection: A General Theoretical Framework for Vector Representations (2024.naacl-long)

Copied to clipboard

Challenge: Pre-trained vector representations can inadvertently encode undesirable social biases.
Approach: They propose a framework for reducing bias by transforming vector representations to an unbiased subspace using sufficient projection.
Outcome: The proposed framework mitigates bias across debiasing and fairness tasks and across various vector representation types, including word embeddings and output representations of transformer models.
Simulating Classroom Education with LLM-Empowered Agents (2025.naacl-long)

Copied to clipboard

Challenge: Initial studies have focused on task-specific, independent LLM-empowered agents, but the potential of LLMs within a multi-agent collaborative framework for classroom simulation with real user participation remains unexplored.
Approach: They propose a multi-agent classroom simulation teaching framework that recognizes representative class roles and introduces a novel class control mechanism for automatic classroom teaching.
Outcome: The proposed framework can simulate dynamic learning environment for users with active teacher-student and student-studente interactions.
Aspect Is Not You Need: No-aspect Differential Sentiment Framework for Aspect-based Sentiment Analysis (2022.naacl-main)

Copied to clipboard

Challenge: Existing approaches to classify aspects with aspect sentiment bias are hard to find .
Approach: They propose a no-aspect differential sentiment framework for the ABSA task that eliminates aspect sentiment bias and uses differential sentiment loss instead of cross-entropy loss to better classify the sentiments.
Outcome: The proposed framework can be combined with almost all traditional ABSA methods.
Stratagem: Learning Transferable Reasoning via Trajectory-Modulated Game Self-Play (2026.acl-long)

Copied to clipboard

Challenge: Existing self-play approaches to developing general reasoning in language models rely on terminal game outcomes.
Approach: They propose a game-based reasoning transfer model that addresses two barriers to reasoning transfer.
Outcome: The proposed model improves mathematical reasoning, general reasoning, and code generation benchmarks.
TIGEr: Text-to-Image Grounding for Image Caption Evaluation (D19-1)

Copied to clipboard

Challenge: Existing metrics based on text-level comparisons fail to assess the quality of captions produced by machines.
Approach: They propose to use a machine-learned text-image grounding model to measure the accuracy of machine-generated captions and their correlation with human judgments.
Outcome: The proposed metric has higher consistency with human judgments and is more accurate than existing metrics.
CRYPTOGRU: Low Latency Privacy-Preserving Text Analysis With GRU (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to combine HE and GC in RNNs suffer from long inference latency due to the slow activation functions.
Approach: They propose a hybrid structure of HE and GC gated recurrent unit network, for low-latency secure inferences.
Outcome: The proposed structure improves the secure inference latency by up to 138 over one of the state-of-the-art secure networks on the Penn Treebank dataset.
Learning from Textual Radiology Reports: A Benchmark Dataset for Coronary CT Angiography (2026.acl-industry)

Copied to clipboard

Challenge: CCTA reports provide an assessment of coronary disease severity to guide patient management.
Approach: They propose a pipeline that decouples structuring from classification by an LLM-based parser . CCTA-RADS is the largest publicly available dataset of CCDA reports .
Outcome: The proposed approach improves the F1-score by 6%-13% compared with direct methods.
TrojFSP: Trojan Insertion in Few-shot Prompt Tuning (2024.naacl-long)

Copied to clipboard

Challenge: Prompt tuning on a few data samples presents security issues, e.g., Trojan attacks.
Approach: They propose a method to transfer established data poisoning attacks directly to few-shot prompt tuning, a technique to address the poisoned imbalance issue.
Outcome: The proposed method achieves an ASR of over 99% while maintaining negligible decreases in CDA.
REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning (D19-1)

Copied to clipboard

Challenge: Existing metrics for image captioning evaluation provide an overall quality score, which is difficult to infer specific description errors.
Approach: They propose a fine-grained evaluation method REO for automatically measuring the performance of image captioning systems.
Outcome: The proposed method achieves higher consistency with human judgments and provides more intuitive evaluation results than other metrics.
DELTA: Dynamic Layer-Aware Token Attention for Efficient Long-Context Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Large reasoning models generate long chains of intermediate steps, but their inference cost is dominated by decoding, where each new token must attend to the entire growing sequence.
Approach: They propose a training-free sparse attention mechanism that reduces inference cost by evicting entries from the key-value cache.
Outcome: The proposed model matches or surpasses full attention on reasoning benchmarks . it reduces the number of attended tokens by up to 4.25 and delivers 1.54 speedup .
SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to deep search training lack high-quality training trajectories, prohibitive computational costs and lack of high-fidelity training data.
Approach: They propose a framework that synthesizes high-quality training data by simulating real user interactions in live web search environments.
Outcome: The proposed framework synthesizes high-quality training data by simulating user interactions in live web search environments.
SAVOIR: Learning Social Savoir-Faire via Shapley-based Reward Attribution (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to improve social intelligence of AI systems employ retrospective attributions and lack theoretical grounding.
Approach: They propose a framework that uses Shapley values to ensure fair credit distribution with axiomatic guarantees of efficiency, symmetry, and marginality.
Outcome: The proposed framework matches or exceeds proprietary models including GPT-4o and Claude-3.5-Sonnet.
Task-Oriented Clustering for Dialogues (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for task-oriented dialogue clustering are difficult to apply directly due to inherent differences between them.
Approach: They propose a Dialogue Task Clustering Network model for task-oriented clustering . they use context-aware utterance representations and cross-dialogue utterrance cluster representations .
Outcome: The proposed model outperforms baselines on three public datasets on all metrics.
Fair Text-Attributed Graph Representation Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Text-Attributed Graphs (TAGs) inherit issues from Graph Neural Networks such as fairness.
Approach: They propose to evolve LM-as-encoder to LM as-fair-encoding process to explore fairness in TAGRL.
Outcome: The proposed process can be integrated with fairness-enhancing strategies on the GNNs decoder side.
Hyperlink-induced Pre-training for Passage Retrieval in Open-domain Question Answering (2022.acl-long)

Copied to clipboard

Challenge: Existing methods to train dense passage retrieval have a large data gap between upstream and downstream relevance.
Approach: They propose a method to pre-train the dense retriever with the text relevance induced by hyperlinks within Web documents.
Outcome: The proposed method outperforms existing methods under different scenarios and in the open-domain question answering domain.
A Neural Network Based Model for Loanword Identification in Uyghur (L18-1)

Copied to clipboard

Challenge: Lexical borrowing happens in almost all languages, and we propose a new method to identify loanwords in Uyghur.
Approach: They propose a neural network based loanword identification model for Uyghur that captures past and future information and learns both word level and character level features automatically.
Outcome: The proposed model outperforms baseline models on Chinese, Arabic and Russian loanword detection in Uyghur.
KuiLeiXi: a Chinese Open-Ended Text Adventure Game (2021.acl-demo)

Copied to clipboard

Challenge: Recent advances in pre-trained language models have made it possible to generate human-like text.
Approach: They propose to integrate an open-ended text adventure game in Chinese, named KuiLeiXi, where players interact with the AI until the plot goals are reached.
Outcome: The proposed game lacks incentives and relies on players to explore on their own.
Learning Kernel-Smoothed Machine Translation with Retrieved Examples (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods to update deployed models are prone to overfit . however, non-parametric methods are liable to over-fit the retrieved examples .
Approach: They propose to learn Kernel-Smoothed Translation with Example Retrieval (KSTER) this approach allows users to adapt models to emerging cases without retraining .
Outcome: The proposed approach achieves 1.1 to 1.5 BLEU scores over existing methods without retraining . the proposed model is released on https://github.com/jiangqn/KSTER.
OMGM: Orchestrate Multiple Granularities and Modalities for Efficient Multimodal Retrieval (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for Knowledge-Based Visual Question Answering lack multimodal retrieval . large language models (LLMs) have demonstrated remarkable generalization and reasoning capabilities in text-based systems.
Approach: They propose a multimodal vision-language retrieval-augmented generation system that harmonizes multiple modalities and modality to enhance retrieval.
Outcome: The proposed system achieves state-of-the-art retrieval performance and competitive answers on InfoSeek and Encyclopedic-VQA benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations