Papers by Liang Wen

55 papers
Backdoor Collapse: Eliminating Unknown Threats Via Known Backdoor Aggregation In Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing defenses rely on impractical assumptions about trigger settings to mitigate backdoor attacks . a recent study found that small amounts of training data can systematically induce harmful behaviors in large language models.
Approach: They propose a backdoor defense framework that requires no prior knowledge of trigger settings . they use a two-stage process to aggregate backdoor representations and fine-tune recovery .
Outcome: The proposed defense reduces the average Attack Success Rate to 4.41% across multiple benchmarks . the proposed framework generalizes across different types of backdoors, confirming its robustness in practical deployment scenarios.
Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Models (2026.acl-long)

Copied to clipboard

Challenge: Reinforcement learning (RL) has improved text- and vision-language models, but its application in SDMs is hindered.
Approach: They propose a dual-axis Generative Reward Model that provides semantic quality and interaction timing for SDMs.
Outcome: The proposed model achieves state-of-the-art performance on interaction-quality assessment across a wide spectrum of datasets.
Two Pathways to Truthfulness: On the Intrinsic Encoding of LLM Hallucinations (2026.acl-long)

Copied to clipboard

Challenge: Previous work shows that large language models generate hallucinations, yet the origins and mechanisms of these signals remain unclear.
Approach: They propose to validate and disentangle two different pathways for truthfulness cues . they also propose to use the same mechanism to derive self-contained evidence from the generated answer .
Outcome: The proposed applications improve hallucination detection performance by integrating two different inputs.
RTQA : Recursive Thinking for Complex Temporal Knowledge Graph Question Answering with Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Current temporal knowledge graph question answering methods focus on implicit temporal constraints and lack the capability to handle complex temporal queries.
Approach: They propose a temporal knowledge graph question answering framework that recursively decomposes questions into sub-problems and employs multi-path answer aggregation to improve fault tolerance.
Outcome: The proposed framework outperforms existing methods on multiTQ and TimelineKGQA benchmarks.
SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness (2026.acl-long)

Copied to clipboard

Challenge: SDiaReward is an end-to-end spoken dialogue system that integrates paralinguistic nuances and spontaneous nature of human conversation.
Approach: They propose an end-to-end multi-turn reward model trained on SDiaReward-Dataset . it is a collection of episode-level preference pairs targeting modality and colloquiality gaps .
Outcome: The proposed model outperforms general-purpose audio LLMs in episode-level evaluation.
SKA-Bench: A Fine-Grained Benchmark for Evaluating Structured Knowledge Understanding of LLMs (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing evaluations for Structured Knowledge (SK) understanding are non-rigorous and focus on a single type of SK.
Approach: They propose a structured knowledge understanding benchmark that includes four widely used structured knowledge forms.
Outcome: The proposed benchmark is based on four widely used structured knowledge forms . it includes a question, an answer, positive knowledge units, and noisy knowledge units .
Temp-R1: A Unified Autonomous Agent for Complex Temporal KGQA via Reverse Curriculum Reinforcement Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing methods rely on fixed workflows and expensive closed-source APIs, limiting flexibility and scalability.
Approach: They propose a temporal reasoning agent that trains on difficult questions first . they expand the action space with specialized internal actions alongside external action .
Outcome: The proposed agent improves 19.8% over baselines on complex questions and multi-tasks.
Collaboration of Fusion and Independence: Hypercomplex-driven Robust Multi-Modal Knowledge Graph Completion (2026.acl-long)

Copied to clipboard

Challenge: Existing multi-modal knowledge graphs lack modality-specific information and are limited in their ability to capture nuanced semantic interplay between modalities.
Approach: They propose a multi-modal knowledge graph completion method which integrates both paradigms . they use a fine-grained Entity Representation Factorization module and a Robust Relation-aware Modality Fusion module to obtain robust representations for three independent modalities and one fused modality.
Outcome: The proposed method achieves coexistence and collaboration of fused and independent modality representations while maintaining modality-specific information.
Cocktail: A Comprehensive Information Retrieval Benchmark with LLM-Generated Documents Integration (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have led to an influx of AI-generated content on the internet, transforming corpus of Information Retrieval (IR) systems from human-written to a coexistence with LLM-generated contents.
Approach: They propose a benchmark named Cocktail that compares IR models with LLMs to find relevant documents and passages from a corpus.
Outcome: The proposed benchmark aims to evaluate IR models in the mixed-sourced data landscape of the LLM era.
Contrastive Token Learning with Similarity Decay for Repetition Suppression in Machine Translation (2024.findings-emnlp)

Copied to clipboard

Challenge: Neural machine translation (NMT) is pivotal for crosslingual conversation and trade . traditional solutions that penalize text redundancy or token reoccurrence have shown limited efficacy .
Approach: They propose an algorithm that modulates suppression of tokens dynamically, informed by attention weights and inter-token distances.
Outcome: The proposed algorithm outperforms existing methods in precision and generalizability.
AutoScraper: A Progressive Understanding Web Agent for Web Scraper Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for web scraping suffer from limited adaptability and scalability when faced with a new website.
Approach: They propose a framework that generates web scrapers with large language models and a new executability metric to measure the performance of web scraper generation tasks.
Outcome: The proposed framework can handle diverse web environments more efficiently.
GenPilot: A Multi-Agent System for Test-Time Prompt Optimization in Image Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for text-to-image synthesis lack systematic error analysis and refinement strategies, resulting in limited reliability and effectiveness.
Approach: They propose a plug-and-play multi-agent system called GenPilot that integrates error analysis, clustering-based adaptive exploration, fine-grained verification and a memory module for iterative optimization.
Outcome: The proposed method improves text consistency and structural coherence on images with a plug-and-play system.
Know the Known and the Unknown: Reasonable Answer Generation with Knowledge-Informed Citations (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches focus on generating multi-level citations linked to specific references, making it verifiable and trustworthy.
Approach: They propose a new data construction pipeline and a benchmark to improve citation granularity and awareness of unknown information.
Outcome: The proposed model improves on the existing benchmark and data construction pipeline and provides citation granularity and awareness of unknown information.
M3: A Multi-View Fusion and Multi-Decoding Network for Multi-Document Reading Comprehension (2022.emnlp-main)

Copied to clipboard

Challenge: Existing methods for multi-document reading comprehension cannot make full of the advantages of both approaches.
Approach: They propose a multi-view fusion and multi-decoding method that integrates multiple documents for answering questions.
Outcome: The proposed method improves on two mainstream multi-document reading comprehension datasets.
Light-R1: Curriculum SFT, DPO and RL for Long COT from Scratch and Beyond (2025.acl-industry)

Copied to clipboard

Challenge: Experimental results show that opensource curriculum training is more effective when distinct datasets are available for different training stages.
Approach: They propose an opensource suite for training long reasoning models using publicdata and models.
Outcome: The proposed model outperforms DeepSeek-R1-DistillQwen-32B models in math reasoning.
POMP: Probability-driven Meta-graph Prompter for LLMs in Low-resource Unsupervised Neural Machine Translation (2024.acl-long)

Copied to clipboard

Challenge: Low-resource languages (LRLs) face challenges in supervised neural machine translation due to limited parallel data.
Approach: They propose a method that uses a dynamic graph to organize auxiliary languages in prompts to improve LRL translations.
Outcome: The proposed method improves translation accuracy in low-resource languages (LRLs) using auxiliary language pairs and synthetic pseudo-parallel data.
MENTOR: Efficient Autoregressive Image Generation with Balanced Multimodal Control (2026.findings-acl)

Copied to clipboard

Challenge: Recent text-to-image models achieve impressive visual quality but still face challenges in precise controllability, balancing multimodal inputs, and high training cost for multimodal image generation.
Approach: They propose an autoregressive framework with a two-stage training paradigm for controllable multimodal image generation.
Outcome: Extensive experiments on DreamBench++ and DreamBech show that the proposed framework achieves a strong balance between textual and visual guidance for controllable image generation.
DoTAT: A Domain-oriented Text Annotation Tool (2022.acl-demo)

Copied to clipboard

Challenge: DoTAT is a domain-oriented text annotation tool that can reduce the time for event annotation by 19.7% . the tool supports multi-person collaborative process with automatically merging and review .
Approach: They propose a domain-oriented text annotation tool called DoTAT . it provides multi-person collaborative process with automatic merging and review .
Outcome: The proposed tool can reduce the time for event annotation by 19.7% compared with existing tools.
Learning Invariant Representation Improves Robustness for MRC Models (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to improve machine reading comprehension models are vulnerable and not robust to adversarial examples.
Approach: They propose to construct positive example pairs which have same answer by augmentation and then introduce stability and contrastive loss to improve invariance of representation.
Outcome: The proposed approach boosts the robustness of QA models across different tasks and attack sets significantly and consistently.
Wasserstein Distance Regularized Sequence Representation for Text Matching in Asymmetrical Domains (2020.emnlp-main)

Copied to clipboard

Challenge: Asymmetrical text matching is a fundamental problem in information retrieval and natural language processing.
Approach: They propose a method that regularizes features vectors projected from different domains . WD-Match can be used to improve different text matching methods .
Outcome: The proposed method outperforms existing methods and benchmarks on four datasets.
LLM Agents for Education: Advances and Applications (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Model (LLM) agents are transforming education by automating complex tasks and enhancing both teaching and learning processes.
Approach: This survey analyzes recent advances in applying Large Language Model agents to educational settings . it highlights ethical issues, hallucination and overreliance, and integration with existing ecosystems .
Outcome: The authors analyze the technologies enabling LLM agents and highlight key challenges in deploying them in educational settings.
Improve Interpretability of Neural Networks via Sparse Contrastive Coding (2022.findings-emnlp)

Copied to clipboard

Challenge: XAI has achieved remarkable advances, but few efforts have been devoted to solving the problem.
Approach: They propose a model-agnostic explanation method termed Sparse Contrastive Coding . they use model-based explanations to explain the black-box in a more model-oriented way .
Outcome: The proposed method outperforms five state-of-the-art methods in interpretability and classification metrics.
CRAFTQA: A Code-Driven Adaptive Framework for Complex Structured Data Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing unified structured data question answering methods rely on a set of predefined functions, which restricts their ability to perform complex reasoning beyond these predefined operations.
Approach: They propose a novel adaptive code-driven framework that generates code-based reasoning operations based on a question.
Outcome: The proposed framework improves on multiple structured datasets on real-world scenarios.
Logic-Thinker: Teaching Large Language Models to Think more Logically. (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent Large Reasoning Models (LRMs) have demonstrated the ability to generate long chains of thought (LongCoT) LongCoT still faces challenges such as redundancy and logical incoherence.
Approach: They propose a neural-symbolic reasoning framework that generates chains of thought . they propose Logic-Thinker, which transforms symbolic solvers into chains of thoughts .
Outcome: The proposed framework outperforms models fine-tuned with ThinkerCoT on logic reasoning tasks.
Strength Lies in Differences! Improving Strategy Planning for Non-collaborative Dialogues via Diversified User Simulation (2024.emnlp-main)

Copied to clipboard

Challenge: Non-collaborative dialogue agents are expected to engage in strategic conversations with diverse users, and this poses two main challenges for existing dialogue agents: 1) the inability to integrate user-specific characteristics into the strategic planning; 2) the difficulty of training strategic planners that can be generalized to diverse users.
Approach: They propose to integrate a user-aware strategic planning module and a population-based training paradigm into a non-collaborative dialogue agent for securing a mutual agreement that leans favorably towards the system's objectives.
Outcome: The proposed model can be used to achieve a mutual agreement that leans favorably towards the system's objectives.
Original Content Is All You Need! an Empirical Study on Leveraging Answer Summary for WikiHowQA Answer Selection Task (2022.coling-1)

Copied to clipboard

Challenge: Existing answer selection approaches for community question answering lack additional answer summaries due to redundancy and lengthiness issues of crowdsourced answers.
Approach: They constructed a dataset which contains a corresponding reference summary for each original lengthy answer.
Outcome: The proposed model improves the performance of a question and candidate answer on a WikiHowQA dataset.
MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in open-source Large Language Models (LLMs) have achieved notable successes in natural language processing.
Approach: They propose a Parameter Efficient Fine-Tuning paradigm for improved fine-tuning and parameter efficiency in multi-task learning.
Outcome: The proposed model outperforms existing methods on multi-task learning while reducing training costs by over 80% without losing general capability.
Prompt-fused Framework for Inductive Logical Query Answering (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for addressing logical queries on knowledge graphs neglect missing edges in KGs . Existing approaches focus on addressing missing edges, thereby neglecting the emergence of new entities .
Approach: They propose a query-aware prompt-fused framework that addresses embedding of emerging entities . they propose to use a symbolic query to gather information relevant to the query .
Outcome: The proposed framework addresses embedding of emerging entities through contextual information aggregation.
Bayesian Active Learning with Gaussian Processes Guided by LLM Relevance Scoring for Dense Passage Retrieval (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches passively rely on first-stage dense retrievers, which leads to two limitations: failing to retrieve relevant passages in semantically distinct clusters and failing to propagate relevance signals to the broader corpus.
Approach: They propose a framework that propagates sparse LLM relevance signals across the embedding space to guide global exploration.
Outcome: Experiments show that the proposed framework outperforms existing approaches under the same budget on all four datasets.
Learning Intrinsic Dimension via Information Bottleneck for Explainable Aspect-based Sentiment Analysis (2024.lrec-main)

Copied to clipboard

Challenge: Gradient-based explanation methods are increasingly used to interpret neural models in natural language processing (NLP) however, in the context of Aspect-based Sentiment Analysis, only specific dimensions are pertinent.
Approach: They propose a Gradient-based explanation framework that leverages an information bottleneck to refine word embeddings into a concise intrinsic dimension, maintaining essential features and omitting unrelated information.
Outcome: The proposed framework improves both the models’ performance and explanations’ clarity by identifying sentiment-aware features.
Extracting and Combining Abilities For Building Multi-lingual Ability-enhanced Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing work relies on training with multi-lingual ability-related data, which may not be available for low-resource languages.
Approach: They propose a multi-lingual ability-enhanced LLM that extracts language-agnostic ability-related weights from LLMs and combine them across different languages by simple addition and subtraction operations without training.
Outcome: The proposed approach extracts language-agnostic ability-related weights from LLMs and combine them across different languages without training.
Have We Designed Generalizable Structural Knowledge Promptings? Systematic Evaluation and Rethinking (2025.acl-long)

Copied to clipboard

Challenge: Existing methods to integrate external knowledge into LLMs focus on specific problems, lacking a comprehensive exploration of the generalization and capability boundaries of SKP.
Approach: They propose a new paradigm for structural knowledge prompting to integrate external structural knowledge into LLMs by incorporating structural representations.
Outcome: The proposed benchmark SUBARU enables the evaluation of the generalization capabilities of SKP from four perspectives.
AssoCiAm: A Benchmark for Evaluating Association Thinking while Circumventing Ambiguity (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in multimodal large language models (MLLMs) have garnered significant attention, offering a promising pathway toward artificial general intelligence (AGI).
Approach: They propose a benchmark to evaluate associative ability while circumventing the inherent ambiguity in association tasks by decomposing ambiguities into two types and propose 'assoCiAm' they conduct extensive experiments on MLLMs, revealing a strong positive correlation between cognition and association.
Outcome: The proposed method shows that ambiguity in association evaluations makes MLLMs more random-like and the model's behavior more random.
Unilaw-R1: A Large Language Model for Legal Reasoning with Reinforcement Learning and Iterative Inference (2025.emnlp-main)

Copied to clipboard

Challenge: Reasoning-focused large language models (LLMs) are rapidly evolving across various domains, yet their capabilities in handling complex legal problems remain underexplored.
Approach: They propose a large language model tailored for legal reasoning with a 7-billion parameter scale and a two-stage training strategy combining Supervised Fine-Tuning and Reinforcement Learning.
Outcome: The proposed model outperforms all models of similar scale on authoritative benchmarks and outperformed Qwen-2.5-7B-Instruct (46.6%) by an average margin of 6.6%.
Toolscaler: Scalable Generative Tool Calling via Structure-Aware Semantic Tokenization (2025.findings-emnlp)

Copied to clipboard

Challenge: Extensive experiments demonstrate the effectiveness of SGTC across various tasks.
Approach: They propose a generative tool invocation framework that introduces structure-aware semantic tokenization to encode tools as discrete code sequences.
Outcome: The proposed framework reduces the size of the representation space and underutilizes collaborative signals among tools in downstream tasks.
Filter-And-Refine: A MLLM Based Cascade System for Industrial-Scale Video Content Moderation (2025.acl-industry)

Copied to clipboard

Challenge: Effective content moderation is essential for video platforms to safeguard user experience and uphold community standards.
Approach: They propose a method to transform a generative MLLM into a multimodal classifier using minimal discriminative training data.
Outcome: The proposed method improves F1 score by 66.50% over traditional classifiers while requiring only 2% of the fine-tuning data.
RLSeek: Evidence-Grounded Reasoning for RAG Hallucination Detection (2026.acl-long)

Copied to clipboard

Challenge: Recent work addresses this problem by training span-level hallucination detectors using reinforcement learning and chain-of-thought reasoning.
Approach: They propose a framework that explicitly enforces active evidence seeking during CoT reasoning by requiring quotation of relevant source segments at each verification step.
Outcome: The proposed framework improves hallucination span detection performance with limited reasoning overhead and improved robustness in out-of-domain settings.
HearSay Benchmark: Do Audio LLMs Leak What They Hear? (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in audio large language models have led to their potential privacy implications unexplored.
Approach: They propose a benchmark to examine whether ALLMs leak user privacy through acoustic voiceprints.
Outcome: The proposed benchmark is constructed from over 22,000 real-world audio clips.
Optimal Partial Transport Based Sentence Selection for Long-form Document Matching (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for document matching are limited by the partial nature of the sentence-level matching signals.
Approach: They propose a matching approach that equips existing document matching models with an Optimal Partial Transport component, namely OPT-Match, which selects the key sentences that play a major role in matching.
Outcome: The proposed approach outperforms existing models on four publicly available datasets and the key sentences selected by it are consistent with human-provided rationales.
Adaptive Schema-aware Event Extraction with Retrieval-Augmented Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Event extraction is a task in natural language processing that involves identifying and extracting event information from unstructured text.
Approach: They propose a paradigm that combines schema paraphrasing with schema retrieval-augmented generation.
Outcome: The proposed paradigm retrieves paraphrased schemas and accurately generates targeted structures.
Efficient Hyperparameter Optimization for LLM Reinforcement Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing hyperparameter optimization methods are inefficient in reinforcement learning due to model scale and resource-intensive training cycles.
Approach: They propose a hyperparameter optimization method that adapts both model size and training budget as fidelity.
Outcome: The proposed method significantly improves the computational efficiency of each trial (up to 14.9) over existing HPO methods.
Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completion (2024.lrec-main)

Copied to clipboard

Challenge: Existing MMKGC methods overlook the imbalance problem of modality information among entities, resulting in inadequate modal fusion and inefficient utilization of the raw modality.
Approach: They propose to integrate structural, visual, and textual information of entities into the discriminant models to predict the missing triples.
Outcome: The proposed model outperforms 19 recent methods and achieves state-of-the-art results on three public MMKGC benchmarks.
Speeding Up Neural Machine Translation Decoding by Cube Pruning (D18-1)

Copied to clipboard

Challenge: Neural machine translation suffers from slow translation speed due to the large search space . a trade-off has to be made between translation quality and speed, argues a new study .
Approach: They apply cube pruning technique to speed up dynamic programming into neural machine translation to speed it up.
Outcome: The proposed method can translate faster on GPUs and CPUs with better translation quality than naive beam search.
Knowing-how & Knowing-that: A New Task for Machine Comprehension of User Manuals (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for machine reading comprehension of user manuals have trouble answering complex questions.
Approach: They propose a knowing-how & knowing-that task that requires the model to answer factoid-style, procedure-style and inconsistent questions about user manuals.
Outcome: The proposed model can answer factoid-style, procedure-style and inconsistent questions about user manuals.
Towards Effective Automatic Debt Collection with Persona Awareness (2023.emnlp-industry)

Copied to clipboard

Challenge: Existing debt collection agents fail to tailor strategies to debtor personas, leading to ineffective collection.
Approach: They present a commercial practice on debt collection agents that organizes debtor personas into a taxonomy and constructs a persona-aware conversation dataset.
Outcome: The proposed agent increases recovery rate by 3.31% and collects additional 100K RMB after two months of testing.
Croppable Knowledge Graph Embedding (2025.acl-long)

Copied to clipboard

Challenge: Knowledge Graph Embedding (KGE) is a common approach for Knowledge Grasse (KGs) in AI tasks.
Approach: They propose a new KGE training framework MED that allows one training to obtain a croppable KGE model for multiple scenarios with different dimensional needs.
Outcome: The proposed framework improves low-dimensional sub-models and makes high-dimensional models retain the low-dimension sub-modells’ capacity.
CARE: A Clue-guided Assistant for CSRs to Read User Manuals (2024.acl-long)

Copied to clipboard

Challenge: Current solutions don't fit the online custom service scenarios well due to the lack of attention to user questions and possible responses.
Approach: They propose to build a clue-guided assistant for customer service representations (CSRs) that can provide accurate responses and explicitly show explainable paths about how to arrive at these responses.
Outcome: The proposed assistant can reduce CSRs' reading burden and keep high service quality, in particular with >35% decrease in time spent and keeping a >0.75 ICC score.
Document Modeling with Graph Attention Networks for Multi-grained Machine Reading Comprehension (2020.acl-main)

Copied to clipboard

Challenge: Existing approaches to machine reading comprehension treat documents at their hierarchical nature, ignoring their dependencies.
Approach: They propose a machine reading comprehension benchmark with two-grained answers . they use graph attention networks to model documents at their hierarchical nature .
Outcome: The proposed framework outperforms existing systems at long and short answer criteria.
Quantification of Large Language Model Distillation (2025.acl-long)

Copied to clipboard

Challenge: Existing studies have revealed the robustness degra-dation caused by data distillation.
Approach: They propose a framework to evaluate and quantify model distillation . they aim to identify identity cognition contradictions and analyse multi-granularity response similarities across models to measure the extent of homogenization.
Outcome: The proposed framework addresses two key aspects: (1) Identifying identity cognition contradictions to assess discrepancies in how models perceive and represent identity-related information; (2) Analyzing multi-granularity response similarities across models to measure the extent of homogenization.
WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Training (2026.findings-acl)

Copied to clipboard

Challenge: End-to-end spoken dialogue models have higher potential ceiling in expressiveness and perceptual ability than cascaded systems.
Approach: They propose a modality-aware adaptive post-training recipe that constrains preference updates to the semantic channel and improves acoustic behavior via explicit anchoring.
Outcome: The proposed model improves speech quality and expressiveness across spoken dialogue benchmarks and architectures.
An Empirical Study of LLM Reasoning Ability Under Strict Output Length Constraint (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are a powerful tool for test-time scaling, but they are often used under time constraints.
Approach: They propose to use LLMs to make models think before answering questions . they also use self-correction and best-of-N decoding to encourage deeper thinking .
Outcome: The proposed models are able to achieve higher inference accuracy with extra inference computation under time constraints.
MA-DPR: Manifold-aware Distance Metrics for Dense Passage Retrieval (2025.emnlp-main)

Copied to clipboard

Challenge: Empirical evidence suggests that manifold-aware distance allows DPR to leverage context from related neighboring passages.
Approach: They propose a "manifold-aware" distance metric that measures query–passage distance . they propose to model the intrinsic manifold structure of passages using a nearest-neighbor graph .
Outcome: Empirical evidence suggests MA-DPR outperforms Euclidean and cosine distances on OOD . it can be applied to a wide range of dense embedding and retrieval tasks .
Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks (2020.acl-main)

Copied to clipboard

Challenge: Existing graph-based methods for text classification cannot capture contextual word relationships within each document nor can they produce inductive learning of new words.
Approach: They propose to use Graph Neural Networks to learn the local word representations and then aggregate the word nodes as the document embeddings.
Outcome: The proposed method outperforms state-of-the-art methods on four benchmark datasets.
Scaling Law for Multimodal Large Language Model Supervised Fine-Tuning (2026.acl-long)

Copied to clipboard

Challenge: supervised fine-tuning (SFT) is crucial for multimodal large language models, yet a comprehensive scaling law is lacking . et al.: scaling laws focus on model size, pre-training tokens, and MLLM SFT data volumes .
Approach: They propose two scaling laws to guide optimal model-data configuration . they propose one applicable when training data volumes are well defined by researchers .
Outcome: The proposed scaling laws provide valuable recommendations for optimal resource allocation . they show that the proposed laws are more accurate than existing models .
Multimodal Item Scoring for Natural Language Recommendation via Gaussian Process Regression with LLM Relevance Judgments (2026.findings-acl)

Copied to clipboard

Challenge: Existing NLRec approaches use Dense Retrieval to compute item relevance scores . DR views the request as the sole relevance label, leading to a weak proxy for query relevance.
Approach: They propose to use Gaussian Process Regression to model item relevance . they propose to combine LLM with a Gauss-based kernel to model multimodal relevance judging .
Outcome: The proposed approach outperforms simpler unimodal kernels and baseline methods by up to 65% on four NLRec datasets and two LLM backbones.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations