Papers by Qi Hu

62 papers
Multiview Clickbait Detection via Jointly Modeling Subjective and Objective Preference (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing clickbait detection models rely on analyzing the objective semantics of posts or correlating posts with article content only, but fail to identify and exploit the manipulation intention of clickbaiting from a user’s subjective perspective.
Approach: They propose a multiview clickbait detection model to model subjective and objective preferences simultaneously to capture clickbaiting from a user's subjective perspective.
Outcome: The proposed model outperforms state-of-the-art models on two real-world datasets and shows that it integrates subjective and objective preferences simultaneously.
VLA-Mark: A cross modal watermark for large vision-language alignment models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing text watermarking methods disrupt visual-textual alignment, leaving semantic-critical concepts vulnerable.
Approach: They propose a vision-aligned framework that embeds detectable watermarks into outputs . they combine localized patch affinity, global semantic coherence, contextual attention patterns .
Outcome: The proposed framework shows lower PPL and higher BLEU than conventional methods with near-perfect detection (98.8% AUC).
Feature Projection for Improved Text Classification (2020.acl-main)

Copied to clipboard

Challenge: In sentiment classification, there are some good features that are indicative of class labels, but there are also many common features that do not discriminate for classification.
Approach: They propose to project existing features into the orthogonal space of the common features and make them more discriminative for classification.
Outcome: The proposed method improves CNN, RNN, Transformer, and Bert based text classification and obtains markedly better results.
MIKE: A New Benchmark for Fine-grained Multimodal Entity Knowledge Editing (2024.findings-acl)

Copied to clipboard

Challenge: Current benchmarks focus on coarse-grained knowledge, leaving the intricacies of fine-grounded knowledge unexplored.
Approach: They propose a benchmark and dataset specifically designed for FG multimodal entity knowledge editing.
Outcome: The proposed benchmark underscoring the complexity of FG knowledge editing in MLLMs.
Context Reasoner: Incentivizing Reasoning Capability for Contextualized Privacy and Safety Compliance via Reinforcement Learning (2025.emnlp-main)

Copied to clipboard

Challenge: Current mitigation strategies fail to preserve contextual reasoning capabilities in risky scenarios, leading to systemic risks for legal compliance.
Approach: They propose to use reinforcement learning with a rule-based reward to incentivize contextual reasoning capabilities while enhancing compliance with safety and privacy norms.
Outcome: The proposed model outperforms Qwen2.5-7B-Instruct model in safety and privacy benchmarks and achieves +8.58% accuracy improvement.
Travel on the ICD Tree: Benchmarking Agentic Reasoning for ICD Coding from Chinese Electronic Medical Records (2026.findings-acl)

Copied to clipboard

Challenge: Accurate International Classification of Diseases (ICD) coding is crucial for hospital management and healthcare data governance.
Approach: They propose a framework to evaluate ICD coding based on complete EMRs . they use a dataset of 560 real clinical records covering 434 common diseases .
Outcome: The proposed framework explores the capability boundaries of large language models under different paradigms.
PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Parallel Coordinated Reasoning (PaCoRe) overcomes a central limitation of contemporary language models: their inability to scale test-time compute (TTC) far beyond sequential reasoning under a fixed context window.
Approach: They propose a training-and-inference framework to overcome a central limitation of language models: their inability to scale test-time compute (TTC) under a fixed context window.
Outcome: The proposed model scales to multi-million-token effective TTC without exceeding context limits.
QiMeng-PRepair: Precise Code Repair via Edit-Aware Reward Optimization (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to program repair are based on correctness alone.
Approach: They propose a framework that mitigates over-editing and improves repair accuracy by generating buggy programs and re-edits.
Outcome: The proposed framework improves repair precision by 31.4% under fix1@1, a metric that considers repair correctness and extent, and significantly increases decoding throughput when combined with speculative editing.
SPIDE: Serial and Parallel Intertwined Speculative Decoding (2026.findings-acl)

Copied to clipboard

Challenge: Speculative decoding (SD) is a training-free SD framework that orchestrates dynamic alternation combining serial dynamic drafting with parallel draft verification.
Approach: They propose a serial and parallel intertwined speculative DEcoding framework that orchestrates dynamic alternation combining serial dynamic drafting and parallel draft verification.
Outcome: The proposed framework accelerates inference while reducing the LLM usage costs.
SAPGraph: Structure-aware Extractive Summarization for Scientific Papers with Heterogeneous Graph (2022.aacl-main)

Copied to clipboard

Challenge: Abstractive and extractive methods are used to condense long text into concise summaries while retaining essential information.
Approach: They propose to use paper structure to extract paper summaries from long text . they provide a large-scale dataset of COVID-19-related papers .
Outcome: The proposed framework generates more comprehensive and valuable summaries compared to previous work on COVID-19-related papers.
CSP:Code-Switching Pre-training for Neural Machine Translation (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods to train neural machine translation models are data-hungry and low-resource . et al., 2018; Radford e.t., 2019; Yang ee.,2019) proposes a new pre-training method for NMT .
Approach: They propose a new pre-training method which randomly replaces some words in the input sentence with their translation words in target language.
Outcome: The proposed method improves on unsupervised and supervised NMT models by making full use of monolingual corpora.
Fine-Grained Data Ordering Improves Fine-Tuning for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Prior work focused on data preprocessing, focusing on filtering and cleaning data . a study aimed to improve fine-grained scheduling of data order in epochs .
Approach: They propose a fine-grained scheduling method of data order in epochs to fill this gap . they define data difficulty based on relevance between data and model .
Outcome: The proposed method improves on pre-training and small-scale fine-tuning experiments 2.4% over baselines.
Dynamic Curriculum Learning for Low-Resource Neural Machine Translation (2020.coling-main)

Copied to clipboard

Challenge: Recent work on neural machine translation (NMT) has demonstrated impressive performance improvements and became the de-facto standard.
Approach: They propose a dynamic curriculum learning method to reorder training samples in training using a Transformer-based system.
Outcome: The proposed method outperforms baselines on three low-resource machine translation benchmarks and different sized data of WMT’16 En-De.
Attribution-Based Analysis and Optimization of Modular Agentic Workflows (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have driven the rise of agentic workflows . yet, how can we attribute performance gains to individual upgrades and their interactions?
Approach: They propose a game-theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values.
Outcome: The proposed framework provides interaction-aware attribution and recommendation for model allocation under a fixed workflow structure.
Mitigating Hallucinations in Large Vision-Language Models by Self-Injecting Hallucinations (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for hallucination mitigation are based on external dependency and require external annotations or auxiliary models for preference data collection.
Approach: a new method is proposed to help model-generated hallucinations without external dependencies.
Outcome: a new method that self-injects hallucinations into a generated response improves halluuutations mitigation.
UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Model (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies for visually-situated language understanding have shown shallow zero-shot visual text recognition ability when fed a low-resolution image with salient text information.
Approach: They propose a model for universal OCR-free visually-situated language understanding based on the Multimodal Large Language Model (MLLM) their model is jointly finetuned on a wide range of visually situated language understanding tasks via a unified instruction format.
Outcome: The proposed model achieves state-of-the-art ocr-free performance in 8 out of 10 visually-situated language understanding tasks across 5 domains: documents, tables, charts, natural images, and webpage screenshots.
Detecting Hallucinations in Retrieval-Augmented Generation via Semantic-level Internal Reasoning Graph (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for detecting faithfulness hallucinations are coarse or do not capture the models’ internal reasoning processes, making it difficult to learn.
Approach: They propose a semantic-level internal reasoning graph-based method for detecting faithfulness hallucination using Large language models.
Outcome: The proposed method achieves better overall performance compared to state-of-the-art baselines on RAGTruth and Dolly-15k.
MovieUN: A Dataset for Movie Understanding and Narrating (2022.findings-emnlp)

Copied to clipboard

Challenge: Automatic movie narration generation and narration grounding are important to provide a true movie experience for the blind and visually impaired.
Approach: They propose to use movie clips as a benchmark to support automatic movie narration generation and narration grounding tasks.
Outcome: The proposed methods are effective in supporting two movie-based tasks for the blind and visually impaired.
LitVISTA: A Benchmark for Narrative Orchestration in Literary Text (2026.acl-long)

Copied to clipboard

Challenge: Existing large language models focus on causal coherence, neglecting the complex story arcs and orchestration inherent in human narratives.
Approach: They propose a high-dimensional framework for narrative orchestration that unifies human and model perspectives while jointly characterizing narrative function and structure in a common space.
Outcome: The proposed framework unifies human and model perspectives while jointly characterizing narrative function and structure in a common space.
SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented Generation (2025.acl-long)

Copied to clipboard

Challenge: Adaptive Retrieval-Augmented Generation (RAG) is an effective strategy to alleviate hallucination of large language models (LLMs).
Approach: They propose a novel adaptive RAG model that extracts self-aware uncertainty of large language models from their internal states and invokes retrieval accordingly.
Outcome: The proposed model outperforms existing adaptive RAG methods on complex and simple Question Answering datasets.
Causal Intervention for Abstractive Related Work Generation (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing models ignore the inherent causality during related work generation, leading to spurious correlations which downgrade the models’ generation quality and generalizability.
Approach: They propose a Causal Intervention Module for Related Work Generation (CaM) that captures causal relationships in related work generation and implements causal interventions to mitigate the negative impact of spurious correlations.
Outcome: The proposed framework improves the quality and coherence of generated related work by capturing causalities in the generation process.
Advancing Fine-Grained Visual Understanding with Multi-Scale Alignment in Multi-Modal Models (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in multi-modal large language models have demonstrated remarkable capabilities in multimodal understanding, reasoning, and interaction.
Approach: They propose a method that effectively aligns and integrates multi-scale knowledge of objects . they use a pipeline that provides over 300K essential training data to enhance alignment .
Outcome: The proposed method effectively aligns and integrates multi-scale knowledge of objects, including texts, coordinates, and images.
TEF: Causality-Aware Taxonomy Expansion via Front-Door Criterion (2025.coling-main)

Copied to clipboard

Challenge: Existing research still faces spurious query-anchor matching due to unobserved factors.
Approach: They propose a model that uses the front-door criteria to decompose the expansion process into a parser module and a connector to isolate confounding effects.
Outcome: Extensive experiments on three benchmarks validate the effectiveness of the proposed model.
DiffZOO: A Purely Query-Based Black-Box Attack for Red-teaming Text-to-Image Generative Model via Zeroth Order Optimization (2025.findings-naacl)

Copied to clipboard

Challenge: Existing text-to-image (T2I) synthesis diffusion models raise misuse concerns, particularly in creating prohibited or not-safe-for-work (NSFW) images.
Approach: They propose a method which uses zeroth order optimization to procure gradient approximations and harnesses both C-PRV and D-PRv to enhance attack prompts within a discrete prompt space.
Outcome: The proposed method achieves an 8.5% higher average attack success rate than previous works on multiple state-of-the-art safety mechanisms.
An End-to-end Approach for Handling Unknown Slot Values in Dialogue State Tracking (P18-1)

Copied to clipboard

Challenge: a dialogue state tracker is a core component in most of today's spoken dialogue systems . slot-filling dialogues are composed of a predefined set of slots that need to be filled through the conversation .
Approach: They propose an E2E architecture that extracts unknown slot values while still achieving state-of-the-art accuracy on the standard DSTC2 benchmark.
Outcome: The proposed architecture achieves state-of-the-art accuracy on the DSTC2 benchmark while retaining predefined slot values.
LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing (2026.findings-acl)

Copied to clipboard

Challenge: Large language model (LLM) routing assigns each query to the best suitable model from an ensemble.
Approach: They introduce a large-scale benchmark and unified framework for LLM routing . they find that many routing methods exhibit similar performance under unified evaluation .
Outcome: The proposed benchmark provides comprehensive metrics for both performance-oriented and performance-cost trade-off routing.
Low-Resource Dialogue Summarization with Domain-Agnostic Multi-Source Pretraining (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for low-resource dialogue summarization neglect the difference between dialogues and conventional articles.
Approach: They propose a multi-source pretraining paradigm to leverage external summary data . they exploit large-scale in-domain non-summary data to separate dialogue encoder and summary decoder .
Outcome: The proposed model can be used to better leverage external summary data.
ALPS: Attention Localization and Pruning Strategy for Efficient Adaptation of Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Prior research has focused on optimizing general-purpose large language models to downstream tasks . however, these approaches inherently introduce data dependency, which hinders generalization and reusability.
Approach: They propose an algorithm that localizes the most task-sensitive attention heads and prunes by restricting attention training updates to these heads, thereby reducing alignment costs.
Outcome: The proposed algorithm achieves 2% performance improvement over baselines on three tasks while localizing the most task-sensitive attention heads.
Geo-BERT Pre-training Model for Query Rewriting in POI Search (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to solve the word mismatch between queries and documents are often inadequate to integrate geographic information into the pre-training model.
Approach: They propose to train a pre-training model to integrate semantics and geographic information in the pre-trained representations of POIs.
Outcome: The proposed model achieves excellent accuracy on a wide range of real-world datasets of map services.
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders (2021.acl-long)

Copied to clipboard

Challenge: End-to-end Speech Translation (E2E ST) encoders lack global context representation, whereas MT encoder lacks it.
Approach: They propose a Stacked Acoustic-and-Textual Encoding method for speech translation . they propose an adaptor module to alleviate representation inconsistency .
Outcome: The proposed method achieves state-of-the-art BLEU scores of 18.3 and 25.2 on two ST tasks.
Controllable Contamination Detection for Reliable LLM Evaluation with Statistical Guarantees (2026.acl-long)

Copied to clipboard

Challenge: Existing training data detectors fail to detect clean samples from contaminated test sets . existing methods fail to identify clean samples due to black-box nature of LLMs .
Approach: They propose a framework that detects and filters contaminated evaluation data . they propose 'failure detection' to reduce the proportion of contaminated samples mistakenly retained .
Outcome: The proposed framework reduces false discovery rate (FDR) under valid FDR control while maintaining evaluation consistency.
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage.
Approach: They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas.
Outcome: The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality.
LM-Searcher: Cross-domain Neural Architecture Search with LLMs via Unified Numerical Encoding (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models have opened new avenues for solving complex optimization problems, including Neural Architecture Search (NAS).
Approach: They propose a framework that leverages LLMs for cross-domain neural architecture optimization without extensive domain-specific tuning.
Outcome: The proposed framework achieves competitive performance in both in-domain and out-of-domain tasks.
DUET: Joint Exploration of User–Item Profiles in Recommendation System (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs are opaque and difficult to interpret, resulting in limited interpretability.
Approach: They propose an interaction-aware profile generator that jointly produces user and item profiles conditioned on both user history and item evidence.
Outcome: The proposed model outperforms baselines on three real-world datasets.
Using the Past Knowledge to Improve Sentiment Classification (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing model retains knowledge learned from past tasks and selectively transfers it to new task to help it learn better.
Approach: They propose a lifelong learning model that can retain and selectively transfer the knowledge learned in the past to help learn the new task.
Outcome: The proposed model outperforms strong baselines, including even multiple task learning.
OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) and Large Multimodal Models have exceeded general human capabilities in various tasks.
Approach: They present an Olympiad-level bilingual multimodal scientific benchmark featuring 8,476 problems from Olympiad level mathematics and physics competitions.
Outcome: The best performing model, GPT-4V, attains an average score of 17.97% on OlympiadBench, with a mere 10.74% in physics, highlighting the benchmark rigor and the intricacy of physical reasoning.
Improving the Language Understanding Capabilities of Large Language Models Using Reinforcement Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: Instruction-fine-tuned large language models (LLMs) under 14B parameters underperform on NLU tasks . we explore a framework to improve the NLU capabilities of LLMs .
Approach: They propose to use Proximal Policy Optimization to improve NLU capabilities . they frame NLU as a reinforcement learning environment and optimize for reward signals .
Outcome: The proposed framework outperforms supervised fine-tuning on GLUE and superGLUE tasks.
Thinking Clearly, Talking Fast: Concept-Guided Non-Autoregressive Generation for Open-Domain Dialogue Systems (2021.emnlp-main)

Copied to clipboard

Challenge: Existing models with seq2seq framework lack ability to effectively manage concept transitions . lack of concept management strategies might lead to incoherent dialogue due to loosely connected concepts .
Approach: They propose a concept-guided non-autoregressive model for open-domain dialogue generation that learns to identify multiple associated concepts from a conceptual graph and a customized Insertion Transformer to perform concept-directed generation to complete a response.
Outcome: The proposed model outperforms state-of-the-art models in automatic and human evaluations with substantially faster inference speed.
Movie101: A New Movie Understanding Benchmark (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to narrate movies with no actors are difficult to implement in real situations . a new metric is proposed to provide the best correlation with human evaluation .
Approach: They propose a large-scale Chinese movie benchmark to help visually impaired enjoy movies . they propose metric called Movie Narration Score (MNScore) which achieves best correlation with human evaluation.
Outcome: The proposed method outperforms baselines and the existing methods.
Dynamic Multi-granularity Attribution Network for Aspect-based Sentiment Analysis (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for predicting sentiment polarity of aspects are susceptible to interference caused by irrelevant contexts and lack sentiment knowledge at a data-specific level.
Approach: They propose a novel Aspect-based sentiment analysis method that leverages attention scores to model the relationships between aspects and contexts.
Outcome: The proposed method is able to predict sentiments from a set of five benchmark datasets.
CoTKR: Chain-of-Thought Enhanced Knowledge Rewriting for Complex Knowledge Graph Question Answering (2024.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge rewriting methods may include irrelevant information, omit crucial details, or fail to align with the question’s semantics.
Approach: They propose a new rewriting method CoTKR for generating reasoning traces and corresponding knowledge in an interleaved manner, thereby mitigating the limitations of single-step knowledge rewrite.
Outcome: The proposed method mitigates the limitations of single-step knowledge rewriting and bridges the preference gap between the knowledge reactor and the question answering (QA) model.
MM-Doc-R1: Training Agents for Long Document Visual Question Answering through Multi-turn Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Existing work on long document visual question answering is based on Retrieval-Augmented Generation (RAG) where textual or visual content is encoded into embeddings and relevance is determined by similarity scores with respect to the original query.
Approach: They propose a framework that employs an agentic, vision-aware workflow to address long document visual question answering through iterative information discovery and synthesis.
Outcome: The proposed framework outperforms existing RL systems by 10.4% on the MMLongbench-Doc benchmark and demonstrates superior training performance over GRPO.
LLMEval-Med: A Real-world Clinical Benchmark for Medical LLMs with Physician Validation (2025.findings-emnlp)

Copied to clipboard

Challenge: Current medical benchmarks have limitations in question design, data sources and evaluation methods.
Approach: They propose a new benchmark covering five core medical areas . it includes 2,996 questions created from real-world electronic health records .
Outcome: The proposed model covers five core medical areas and includes 2,996 questions created from real-world electronic health records and expert-designed clinical scenarios.
Language Agnostic Multilingual Information Retrieval with Contrastive Learning (2023.findings-acl)

Copied to clipboard

Challenge: Annotated training data is costly to obtain in many languages .
Approach: They propose a semantic contrastive loss to align parallel sentences that share the same semantics in different languages and a language contrastive gain to leverage parallel sentence pairs to remove language-specific information from non-parallel corpora.
Outcome: The proposed model improves retrieval performance while requiring less computational effort.
A Survey on Proactive Defense Strategies Against Misinformation in Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for detection of misinformation generated by large language models fail to mitigate societal risks . authors propose a paradigm shift from passive detection to anticipatory mitigation strategies . existing defenses remain reactionary in an era demanding proactive defense, authors say .
Approach: They propose a three-pillar approach to prevent misinformation by fortifying integrity of training data and inference reliability by embedding self-corrective mechanisms during reasoning.
Outcome: The proposed framework improves existing methods in misinformation prevention by 63% . it demonstrates that existing methods exhibit false negative rates against misinformation .
RAPO: An Adaptive Ranking Paradigm for Bilingual Lexicon Induction (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches focus on minimizing distances between words in aligned pairs, while suffering from low discriminative capability to distinguish the relative orders between positive and negative candidates.
Approach: They propose a ranking-oriented induction model to learn personalized mapping function for each word.
Outcome: The proposed model can learn personalized mapping function for each word on public datasets including rich-resource and low-resourced languages.
MCIP: Protecting MCP Safety via Model Contextual Integrity Protocol (2025.emnlp-main)

Copied to clipboard

Challenge: Model Context Protocol (MCP) introduces an easy-to-use ecosystem for users and developers, but it also brings underexplored safety risks.
Approach: They propose a framework that addresses the missing safety mechanisms in MCP and a taxonomy that captures diverse range of unsafe behaviors observed in MMP scenarios.
Outcome: The proposed framework improves safety performance on state-of-the-art LLMs by capturing unsafe behaviors and analyzing the results.
Incorporating Argument-Level Interactions for Persuasion Comments Evaluation using Co-attention Model (C18-1)

Copied to clipboard

Challenge: Existing research explores different text features of reply comments on word level and ignores interactions between participants.
Approach: They propose a co-attention mechanism based neural network to capture interactions between participants on argument level to better model dialogical argumentation.
Outcome: The proposed model outperforms state-of-the-art methods on a publicly available dataset showing that it extracts interactive argument pairs from the original post and the reply.
ESF: Efficient Sensitive Fingerprinting for Black-Box Tamper Detection of Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are increasingly utilized in diverse applications, including code generation, legal document analysis, medical diagnosis, and decision-making.
Approach: They propose a fingerprinting method tailored for black-box tamper detection of large language models.
Outcome: The proposed method detects tampering with a 99.2% detection rate using 5 fingerprint samples across state-of-the-art LLMs.
Cognitive Alpha Mining via LLM-Driven Code-Based Evolution (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to finding effective predictive signals from financial data are limited by their complexity and low signal-to-noise ratio.
Approach: They propose a framework that combines code-level alpha representation with LLM-driven reasoning and evolutionary search.
Outcome: The proposed framework combines code-level alpha representation with LLM-driven reasoning and evolutionary search.
Can LLMs Evaluate Complex Attribution in QA? Automatic Benchmarking using Knowledge Graphs (2025.acl-long)

Copied to clipboard

Challenge: Attributed Question Answering (AQA) has attracted wide attention, but there are several limitations in evaluating the attributions.
Approach: They propose a large-scale benchmark containing comprehensive attribution categories . they compare 25 automatic evaluators with human evaluers and tested LLM evalators .
Outcome: The proposed method can compare attributions with subtle differences and provide feedback to improve them.
UAlign: Leveraging Uncertainty Estimations for Factuality Alignment on Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) often struggle to accurately express factual knowledge, especially in cases where the knowledge boundaries are ambiguous.
Approach: They propose a framework that leverages Uncertainty estimations to represent knowledge boundaries and incorporates these representations into prompts for LLMs to Align with factual knowledge.
Outcome: The proposed framework significantly improves the LLMs’ capacities to confidently answer known questions and refuse unknown questions on both in-domain and out-of-domain tasks.
LeTS: Learning to Think-and-Search via Process-and-Outcome Reward Hybridization (2025.emnlp-main)

Copied to clipboard

Challenge: Recent research focuses on integrating reasoning capabilities into the realm of retrieval-augmented generation (RAG) via outcome-supervised reinforcement learning (RL).
Approach: They propose a process-level reward module to mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation.
Outcome: The proposed framework can boost LLMs’ reasoning ability by integrating external knowledge sources through retrieval-augmented generation (RAG) The proposed model can mitigate the unawareness of intermediate reasoning steps in outcome-level supervision without additional annotation.
PerSphere: A Comprehensive Framework for Multi-Faceted Perspective Retrieval and Summarization (2025.acl-long)

Copied to clipboard

Challenge: Experimental results show that the main challenge lies in long context and perspective extraction.
Approach: They propose a benchmark to facilitate multi-faceted perspective retrieval and summarization . they propose measurable metrics to evaluate the comprehensiveness of the retrieval pipeline .
Outcome: The proposed system breaks free from information silos by combining two opposing claims . it can be used to extract multiple perspectives and improve performance on the platform .
Mutual Reinforcement of LLM Dialogue Synthesis and Summarization Capabilities for Few-Shot Dialogue Summarization (2025.findings-naacl)

Copied to clipboard

Challenge: Empirical results demonstrate that our method improves dialogue summarization, achieving a 1.5% increase in ROUGE scores and a 0.3% improvement in BERT scores in few-shot settings.
Approach: They propose Mutual Reinforcing Data Synthesis (MRDS) within large language models to enhance few-shot dialogue summarization task.
Outcome: Empirical results show that the proposed method improves dialogue summarization, achieving a 1.5% increase in ROUGE scores and a 0.3% improvement in BERT scores in few-shot settings.
AlphaQT-Bench: Diagnosing the Gap between Financial Code Generation and Quantitative Reasoning in LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks rely on outcome-driven metrics such as profitability and look-ahead bias.
Approach: They propose a diagnostic benchmark for instruction-grounded financial code generation under strict semantic and temporal constraints.
Outcome: The proposed benchmarks show that the models fail under causal, structural, or functional constraints.
No Free Lunch: Retrieval-Augmented Generation Undermines Fairness in LLMs, Even for Vigilant Users (2025.findings-emnlp)

Copied to clipboard

Challenge: Retrieval-augmented generation is widely adopted for its effectiveness and cost-efficiency in mitigating hallucinations.
Approach: They propose a practical three-level threat model from the perspective of user fairness awareness.
Outcome: The proposed model shows that RAG can undermine fairness alignment without fine-tuning or retraining.
PrivLM-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models (2024.acl-long)

Copied to clipboard

Challenge: generative large language models (LLMs) exhibit surprising capability and integrate previous tasks into a unified text generation formulation.
Approach: They propose a privacy evaluation benchmark to quantify the privacy leakage of language models.
Outcome: The proposed benchmark compares PPLMs with different privacy implementations to find out how privacy leakage is handled.
TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing (2021.acl-demo)

Copied to clipboard

Challenge: Existing approaches to textual robustness evaluation focus on slightly modifying the input data, which maintains the original meaning and results in a different prediction.
Approach: They propose a multilingual robustness evaluation toolkit for NLP that integrates universal text transformations, task-specific transformations and adversarial attack.
Outcome: The toolkit includes universal text transformation, task-specific transformation, adversarial attack, subpopulation, and their combinations to provide comprehensive robustness analyses.
PrivaCI-Bench: Evaluating Privacy with Contextual Integrity and Legal Compliance (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in generative large language models (LLMs) have enabled wider applicability, accessibility, and flexibility.
Approach: They propose a contextual privacy evaluation benchmark that covers the entire relevant social context through private information flows.
Outcome: The proposed benchmarks cover legal compliance, real court cases, privacy policies, and synthetic data.
DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation (2022.acl-long)

Copied to clipboard

Challenge: Existing pre-trained dialog models shed light on various downstream tasks in natural language processing (NLP).
Approach: They propose a dialog pre-training framework that introduces latent variables into the enhanced encoder-decoder pre-train framework to increase relevance and diversity of responses.
Outcome: The proposed model achieves state-of-the-art on personaChat, DailyDialog, and DSTC7-AVSD datasets.
Rhombus: Incentivizing Coordination in Parallel Thinking through Reinforcement Learning (2026.findings-acl)

Copied to clipboard

Challenge: Parallel thinking is a promising avenue for scaling test-time compute in Large Language Models . however, coordinating the exploration and aggregation stages remains challenging .
Approach: They propose a parallel thinking framework that explicitly incentivizes coordination between components via end-to-end reinforcement learning.
Outcome: The proposed framework improves accuracy by 6.0% over long chain-of-thought baselines while reducing wall-clock latency by 39.4% under matched token budgets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations