Papers by Yuxuan Wang

79 papers
GraphCache: Message Passing as Caching for Sentence-Level Relation Extraction (2022.findings-naacl)

Copied to clipboard

Challenge: Existing work only encodes entity types and textual context within individual instances, which limits the performance of sentence-level relation extraction (RE).
Approach: They propose a module that aggregates the features from sentences to learn global representations of properties and augments local features within individual sentences.
Outcome: The proposed module can learn global representations of properties from sentences and augment local features within individual sentences.
Collaborative Reasoning on Multi-Modal Semantic Graphs for Video-Grounded Dialogue Generation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for video-grounded dialogue generation do not allow information from different modalities to complement each other.
Approach: They propose a video-grounded dialogue generation model that integrates video data into pre-trained language models to allow information from different modalities to complement each other.
Outcome: The proposed model outperforms state-of-the-art models on automatic and human evaluations on two public datasets.
Sparse-RL: Breaking the Memory Wall in LLM Reinforcement Learning via Stable Sparse Rollouts (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for storing key-value caches during long-horizon rollouts cause performance collapses.
Approach: They propose a new training paradigm that empowers stable RL training under sparse rollouts.
Outcome: The proposed model reduces rollout overhead while maintaining the performance.
An Information Bottleneck Perspective for Effective Noise Filtering on Retrieval-Augmented Generation (2024.acl-long)

Copied to clipboard

Challenge: Experimental results show that retrieval-augmented generation improves accuracy and relevance of large language models.
Approach: They propose to introduce the information bottleneck theory into retrieval-augmented generation by maximizing mutual information between compression and ground output while minimizing mutual information .
Outcome: The proposed approach improves accuracy and correctness of answer generation and conciseness with 2.5% compression rate.
v-HUB: A Benchmark for Video Humor Understanding from Vision and Sound (2026.acl-long)

Copied to clipboard

Challenge: Humor enriches our daily lives and appears in many forms, from jokes and cartoons to comedies and viral videos.
Approach: They introduce a video humor understanding benchmark to test their ability to understand humor from visual cues.
Outcome: The proposed video humor understanding benchmark is based on a collection of short videos . it features rich annotations and a study of environmental sound that can enhance humor .
Neural Topic Modeling with Cycle-Consistent Adversarial Training (2020.emnlp-main)

Copied to clipboard

Challenge: Recent advances on deep generative models have attracted significant interest in neural topic modeling.
Approach: They propose an adversarial-neural topic model which uses Dirichlet prior to capture the semantic patterns in latent topics.
Outcome: The proposed models outperform competing models on unsupervised/supervised topic modeling and text classification.
SURE: Mutually Visible Objects and Self-generated Candidate Labels For Relation Extraction (2025.coling-main)

Copied to clipboard

Challenge: Joint relation extraction models face high computational complexity, complex network architectures, difficult parameter tuning and limited interpretability.
Approach: They develop a candidate label marker mechanism that prioritizes strategic label selection over simple label generation.
Outcome: The proposed candidate label marks improve the SOTA methods by 2.5%, 1.9%, 1.2% . the proposed candidate labels improve the performance of the proposed methods .
TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators (2025.findings-acl)

Copied to clipboard

Challenge: Triton is a high-level Python-like programming language for building efficient GPU kernels.
Approach: They propose a TritonBench benchmark that provides a comprehensive evaluation of Tritonic operators on widely deployed GPUs.
Outcome: The proposed benchmarks show that current LLMs struggle to generate efficient Triton operators on widely deployed GPUs aligned with industry applications.
Law in Silico: Simulating Legal Society with LLM-Based Agents (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are powerful tools for legal simulation, but their application remains underexplored.
Approach: They propose a unified LLM-based agent framework for simulating legal scenarios . they calibrate agent behaviors against real-world crime data .
Outcome: The proposed framework calibrates agent behaviors against real-world crime data.
Interesting Culture: Social Relation Recognition from Videos via Culture De-confounding (2025.findings-emnlp)

Copied to clipboard

Challenge: a culturally-specific cultural context can be used to train relationship recognition models . cultural confounding factors can be learned, limiting ability to recognize social relationships in different cultures.
Approach: They propose a culturally-based model that mitigates the influence of culture . they also construct a video social relation recognition dataset to facilitate discussion .
Outcome: The proposed model surpasses state-of-the-art methods on several datasets.
On LLM-Based Scientific Inductive Reasoning Beyond Equations (2025.emnlp-main)

Copied to clipboard

Challenge: Existing research on inductive reasoning models emphasizes rule design without grounding them in specific scenarios.
Approach: They propose to use LLMs to learn underlying patterns from limited examples in entirely new environments.
Outcome: The proposed benchmark evaluates the inductive reasoning abilities of large language models in scientific settings.
Spiral of Silence in Large Language Model Agents (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing theories of Spiral of Silence do not apply to large language models .
Approach: They propose an evaluation framework for examining SoS in large language models . they consider four controlled conditions that vary the availability of "History" and "Persona" signals .
Outcome: The proposed framework examines the SoS-like dynamics in large language models . it shows that history and persona together produce strong majority dominance .
Towards Reliable Large Audio Language Model (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in large audio language models (LALMs) have demonstrated impressive results and promising prospects in universal understanding and reasoning across speech, music, and general sound.
Approach: They propose to use training-free and training-based methods to enhance LALM reliability to different extents.
Outcome: The proposed methods improve the reliability of large audio language models to different extents.
Primacy Effect of ChatGPT (2023.emnlp-main)

Copied to clipboard

Challenge: Existing machine learning models may lead to poor performance in discriminative natural language understanding tasks.
Approach: They propose to use ChatGPT to query large amounts of human-written text to find the answer to a question.
Outcome: The proposed model has a high chance to select labels at earlier positions as the answer.
Xiaomingbot: A Multilingual Robot News Reporter (2020.acl-demos)

Copied to clipboard

Challenge: Xiaomingbot is a multilingual and multimodal software robot with four capabilities: news generation, news translation, news reading and avatar animation.
Approach: They propose to build a multilingual and multimodal software robot with four inte- gal capabilities: news generation, news translation, news reading and avatar animation.
Outcome: The proposed system generates Chinese news, then reads it in multiple languages and generates an animated avatar reading it.
Semantic-Aware Action Space Compression via LLM-DRL Synergy for Efficient Task-oriented Dialogue Policy Exploration (2025.findings-emnlp)

Copied to clipboard

Challenge: Pre-trained large language models (LLMs) with world knowledge and semantic understanding are promising for task-oriented dialogue systems.
Approach: a framework that synergizes pre-trained large language models with DRL is proposed . a lightweight action pruning mechanism is employed to eliminate implausible actions .
Outcome: a new framework synergizes pre-trained large language models with DRL to guide decision-making . the proposed framework eliminates semantically implausible or low-potential actions from multi-turn dialogue context .
Simple and Effective Graph-to-Graph Annotation Conversion (2022.coling-1)

Copied to clipboard

Challenge: Existing work on graph-structured annotation conversions has focused on feature-based models which are not easily applicable to new conversions.
Approach: They propose two graph-to-graph conversion approaches which use pseudo data and inherit parameters to guide conversions respectively.
Outcome: The proposed approaches outperform strong baselines with higher conversion score on a graph-structured dataset and other datasets.
Deep Reinforcement Learning-based Dialogue Policy with Graph Convolutional Q-network (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for deep reinforcement learning lack the ability to learn the relationship between dialogue states and actions.
Approach: They propose a graph-structured dialogue policy framework for task-oriented dialogue systems that uses bipartite graphs to construct two different bipartites and generate user-related and knowledge-related subgraphs.
Outcome: The proposed framework significantly improves the effectiveness and stability of dialogue policies.
StorySparkQA: Expert-Annotated QA Pairs with Real-World Knowledge for Children’s Story-Based Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Existing story reading systems fail to capture the nuances of how education experts think when conducting interactive story reading activities.
Approach: They propose to use existing question-answering (QA) datasets to capture experts' annotations and thinking process to construct a story-based annotation framework.
Outcome: The proposed framework captures experts’ annotations and thinking process and can be used to generate 5, 868 expert-annotated QA pairs with real-world knowledge.
KBAlign: Efficient Self Adaptation on Specific Textual Knowledge Bases (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for retrieval-augmented generation (RAG) are limited and fine-tuning incurs prohibitive costs of external signals.
Approach: They propose a self-supervised framework that enhances RAG systems through efficient model adaptation.
Outcome: The proposed framework achieves 90% of the performance gain obtained through GPT-4-supervised adaptation while relying entirely on self-annotation of much smaller models.
MAGI: Multi-Agent Guided Interview for Psychiatric Assessment (2025.findings-acl)

Copied to clipboard

Challenge: Existing large language models (LLMs) do not align with psychiatric diagnostic protocols.
Approach: They propose a framework that transforms the Mini International Neuropsychiatric Interview into automatic computational workflows through coordinated multi-agent collaboration.
Outcome: The proposed framework transforms the gold-standard Mini International Neuropsychiatric Interview (MINI) into automatic computational workflows through coordinated multi-agent collaboration.
QA-MoE: Towards a Continuous Reliability Spectrum with Quality-Aware Mixture of Experts for Robust Multimodal Sentiment Analysis (2026.acl-long)

Copied to clipboard

Challenge: Existing models that use multimodal inputs are often noisy or incomplete.
Approach: They propose a Quality-Aware Mixture-of-Experts framework that quantifies modality reliability via aleatoric uncertainty.
Outcome: The proposed framework is competitive or state-of-the-art across diverse degradation scenarios and exhibits a promising One-Checkpoint-for-all property in practice.
MTP-RL: Acceleration of Reinforcement Learning Rollouts with Policy-Aligned Multi-Token Prediction (2026.findings-acl)

Copied to clipboard

Challenge: Reinforcement learning (RL) is widely applied to boost the performance of pretrained models, yet its training efficiency is severely constrained by rollout generation.
Approach: They propose a framework that accelerates the rollout phase for diverse models by equipping a pipeline to equip the multi-layer parameter-sharing MTP for all models and an advantage-aware MTP optimization strategy.
Outcome: The proposed framework achieves stable growth of acceptance length during RL training, and also accelerates RL rollouts, achieving an average 23.1%–55.3% reduction in rollout time compared to baselines.
From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems (2025.findings-emnlp)

Copied to clipboard

Challenge: rapid development of artificial intelligence (AI) technologies has inspired researchers to explore how AI can accelerate and enhance research.
Approach: They organize the relevant studies into three main categories: hypothesis formulation, hypothesis validation, and manuscript publication.
Outcome: The authors summarize the current state of research in three main areas: hypothesis formulation, hypothesis validation, and manuscript publication.
LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: LogicAsker examines and improves the reasoning abilities of large language models such as ChatGPT and GPT-4.
Approach: They propose a set of atomic reasoning skills grounded in propositional and predicate logic to examine and improve the reasoning abilities of large language models such as ChatGPT and GPT-4.
Outcome: The proposed approach improves reasoning abilities in large language models such as ChatGPT and GPT-4 by up to 5%.
Alleviating Hallucinations from Knowledge Misalignment in Large Language Models via Selective Abstention Learning (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) suffer from severe hallucination issues due to the knowledge misalignment between the pre-training stage and the supervised fine-tuning stage.
Approach: They propose a training objective with an abstention mechanism that selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.
Outcome: The proposed model selectively rejects tokens that misalign with the desired knowledge distribution via a special [REJ] token.
ToolPRM: Fine-Grained Inference Scaling of Structured Outputs for Function Calling (2026.acl-long)

Copied to clipboard

Challenge: Existing research on inference scaling focuses on unstructured output generation tasks, such as mathematical problems.
Approach: They propose an inference-scaling framework that combines fine-grained beam search with ToolPRM, a process reward model scoring each intra-call decision.
Outcome: The proposed framework outperforms outcome and coarse-grained reward models in predictive accuracy and yields consistent test-time gains on multiple function-calling benchmarks.
Cross-Lingual Knowledge Editing in Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Knowledge editing is a promising technique to adapt large language models to new knowledge without retraining from scratch.
Approach: They propose to use a multilingual dataset to translate a large-scale cross-lingual synthetic dataset from English to Chinese and then to evaluate their performance in Chinese.
Outcome: The proposed method can change model performance on several special cases without retraining from scratch.
Outcome Accuracy is Not Enough: Aligning the Reasoning Process of Reward Models (2026.acl-long)

Copied to clipboard

Challenge: Recent studies observe a phenomenon where reward models achieve high accuracy on static datasets but fail to generalize effectively during RLHF.
Approach: They propose a method that combines rationale consistency with outcome accuracy to improve performance on RM-Bench and JudgeBench.
Outcome: The proposed method surpasses baselines on RM-Bench and JudgeBench by an average of 5% and improves creative writing tasks by 7%.
Democratizing Reasoning Ability: Tailored Learning from Large Language Model (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) exhibit impressive emergent abilities in natural language processing, but their democratization is hindered due to huge computation requirements and closed-source nature.
Approach: They propose a tailored learning approach to distill the exclusive reasoning ability to smaller LMs to facilitate democratization.
Outcome: The proposed approach enables the democratization of the exclusive reasoning ability by leveraging the black-box model as a reasoning teacher.
Should We Rely on Entity Mentions for Relation Extraction? Debiasing Relation Extraction with Counterfactual Analysis (2022.naacl-main)

Copied to clipboard

Challenge: Existing studies rely on entity information for sentence-level relation extraction (RE) but this can leak superficial and spurious clues of relations.
Approach: They propose to use entity mentions to extract relations from textual context . they use a causal graph to model dependencies between variables in RE models .
Outcome: The proposed method yields significant gains on both effectiveness and generalization for RE.
Augur: Modeling Covariate Causal Associations in Time Series via Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have emerged as a promising avenue for time series forecasting . existing approaches face limitations such as marginalized role in model architectures and lack of interpretability.
Approach: They propose a framework that exploits LLM causal reasoning to discover and use directed causal associations among covariates.
Outcome: The proposed model improves predictive accuracy while yielding transparent, traceable reasoning about variable interactions.
Beyond Labels: Empowering Human Annotators with Natural Language Explanations through a Novel Active-Learning Architecture (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing low-resource learning techniques focus on label annotation while neglecting the natural language explanation of a data point.
Approach: They propose a novel architecture that leverages an explanation-generation model to produce explanations guided by human explanations and a prediction model that utilizes generated explanations toward prediction faithfully.
Outcome: The proposed architecture produces explanations guided by human explanations, a prediction model that utilizes generated explanations toward prediction faithfully, and a data diversity-based AL sampling strategy that benefits from the explanation annotations.
SocialEval: Evaluating Social Intelligence of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing work on LLMs does not address their social intelligence (SI) and their discrepancy with humans.
Approach: They propose a script-based bilingual SI benchmark that integrates outcome-oriented goal achievement evaluation and process-oriented interpersonal ability evaluation by manually crafting narrative scripts.
Outcome: The proposed model is based on a script-based bilingual evaluation paradigm that integrates outcome- and process-oriented evaluation by manually crafting narrative scripts.
Trajectory2Task: Training Robust Tool-Calling Agents with Synthesized Yet Verifiable Data for Complex User Intents (2026.acl-long)

Copied to clipboard

Challenge: Tool-calling agents are increasingly deployed in real-world customer-facing workflows . but most studies on tool-callers focus on idealized settings with general, fixed, and well-specified tasks.
Approach: They propose a tool-calling agent-based data pipeline that converts trajectories into user-facing tasks with controlled intent adaptations.
Outcome: The proposed pipeline can be used to study tool use under three scenarios.
Attribution-Based Analysis and Optimization of Modular Agentic Workflows (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have driven the rise of agentic workflows . yet, how can we attribute performance gains to individual upgrades and their interactions?
Approach: They propose a game-theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values.
Outcome: The proposed framework provides interaction-aware attribution and recommendation for model allocation under a fixed workflow structure.
Temporal Leakage in Search-Engine Date-Filtered Web Retrieval: A Retrospective Forecasting Case Study (2026.acl-short)

Copied to clipboard

Challenge: Search-engine date filters are widely used to enforce pre-cutoff retrieval in retrospective evaluations of search-augmented forecasters.
Approach: They propose stronger retrieval safeguards or evaluation on frozen, time-stamped web snapshots to prevent post-cutoff leakage.
Outcome: The proposed approach is unreliable across two major search engines, and the results are inflated.
MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to visual chain-of-thought are limited by external tools or fail to generate high-fidelity diagrams.
Approach: They propose a framework to enable large multimodal models with VCoT capabilities . they pre-train a model on a 15.2M-pair corpus and teach it how to leverage visual aids .
Outcome: The proposed framework unlocks complex, human-like visual reasoning in large language models . it pre-trains the model on a 15.2M-pair corpus and fine-tunes it on MathCanvas-Instruct .
LLMs for Now, Fine-Tuning for Later: An Ensemble Approach to Data Drift in Domain-Specific Tasks (2026.acl-srw)

Copied to clipboard

Challenge: Deploying machine learning models in domain-specific scenarios is challenged by data drift and the scarcity of expert annotations.
Approach: They propose a system that combines an LLM, an AL-assisted compact model and an automatic switch module to assist the active learning process.
Outcome: The proposed system achieves 96–98% switch accuracy and outperforms both models used alone.
FR-Spec: Accelerating Large-Vocabulary Language Models via Frequency-Ranked Speculative Sampling (2025.acl-long)

Copied to clipboard

Challenge: Speculative sampling is an efficient way to accelerate the auto-regressive generation process of large language models.
Approach: They propose a frequency-ranked speculative sampling framework that optimizes draft candidate selection through vocabulary space compression.
Outcome: Experiments show that FR-Spec reduces LM Head computation overhead by 75% while ensuring the equivalence of the final output distribution.
AutoReproduce: Automatic AI Experiment Reproduction with Paper Lineage (2026.acl-long)

Copied to clipboard

Challenge: Efficient reproduction of research papers requires deep domain expertise.
Approach: They propose a framework that systematically mines implicit knowledge from the cited literature to reproduce experimental code in a complete, end-to-end manner.
Outcome: The proposed framework surpasses baselines across all metrics and reproduces experimental code in a complete, end-to-end manner.
MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in multimodal large language models have led to progress in tackling complex reasoning tasks that combine textual and visual information.
Approach: They introduce a robust version of the Massive Multi-discipline Multimodal Understanding and Reasoning (MMMU) benchmark.
Outcome: The proposed model performs lower on MMMU-Pro than on the previous benchmark, ranging from 16.8% to 26.9%.
Can LLM Agents Simulate Multi-Turn Human Behavior? Evidence from Real Online Customer Behavior Data (2026.acl-long)

Copied to clipboard

Challenge: Recent research shows that LLM Agents can generate “believable” human behaviors via prompt-only methods, leaving open questions of whether they can accurately generate step-by-step actions in multi-turn interaction tasks.
Approach: They propose to use shopping data to evaluate LLMs' ability to accurately generate step-by-step actions in a multi-turn interaction task.
Outcome: The proposed model achieves 17.26% action generation accuracy and 33.86% F1 score on final purchase prediction, representing improvements of 5.4% and 13.85% over baselines.
Huatuo-26M, a Large-scale Chinese Medical QA Dataset (2025.findings-naacl)

Copied to clipboard

Challenge: Large Language Models are a powerful tool for medical research, but the data is a bottleneck.
Approach: They propose to use the largest ever medical Question Answering dataset with 26 Million QA pairs as a fine-tuning data for training large language models.
Outcome: The proposed dataset demonstrates that it can be used to train large language models and improves zero-shot performance on other datasets.
VideoLLM Knows When to Speak: Enhancing Time-Sensitive Video Comprehension with Video-Text Duet Interaction Format (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent studies on video large language models focus on model architectures and training datasets . interaction format between user and model is unsatisfactory for time-sensitive tasks .
Approach: They propose a video-text duet interaction format that allows for continuous playback of the video . when a text message ends, the video continues to play, similar to the alternative of two performers in a duet.
Outcome: The proposed format improves performance on time-sensitive tasks with minimal training efforts.
A Closer Look into the Robustness of Neural Dependency Parsers Using Better Adversarial Examples (2021.findings-acl)

Copied to clipboard

Challenge: Neural network-based models have been successful in a wide range of NLP tasks, but their performance is undermined by adversarial examples that would pose no confusion for humans.
Approach: They propose a method to generate high-quality adversarial examples with a higher number of candidate generators and stricter filters and then verify their quality using automatic and human evaluations.
Outcome: The proposed method improves the robustness of English parsing models by relying on adversarial training and model ensembling.
LM-Searcher: Cross-domain Neural Architecture Search with LLMs via Unified Numerical Encoding (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models have opened new avenues for solving complex optimization problems, including Neural Architecture Search (NAS).
Approach: They propose a framework that leverages LLMs for cross-domain neural architecture optimization without extensive domain-specific tuning.
Outcome: The proposed framework achieves competitive performance in both in-domain and out-of-domain tasks.
OPeRA: A Dataset of Observation, Persona, Rationale, and Action for Evaluating LLMs on Human Online Shopping Behavior Simulation (2026.acl-long)

Copied to clipboard

Challenge: evaluating LLMs' ability to mimic real user behavior remains an open challenge due to the lack of high-quality, publicly available datasets that capture both the observable actions and the internal reasoning of an actual user.
Approach: They propose a dataset of Observation, Persona, Rationale, and Action collected from real human participants during online shopping sessions.
Outcome: The proposed dataset is the first to evaluate how well current LLMs can accurately simulate the next web action of a specific user.
An Empirical Study of Many-to-Many Summarization with Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Recent studies have shown that large language models (LLMs) have strong multilingual abilities, giving them the potential to perform M2MS in real applications.
Approach: They propose to use many-to-many summarization (M2MS) to generate a brief summary in any language given a document also in any other language.
Outcome: The proposed model outperforms zero-shot LLMs in terms of automatic evaluations.
RIVA: A Pre-trained Tweet Multimodal Model Based on Text-image Relation for Multimodal NER (2020.coling-main)

Copied to clipboard

Challenge: Named entity recognition (MNER) for tweets is a key task of many applications.
Approach: They propose a pre-trained multimodal named entity recognition model based on Relationship Inference and Visual Attention (RIVA) for tweets.
Outcome: The proposed model improves on the multimodal named entity recognition (MNER) task on tweets with the aid of visual clues.
SWE-Mutation: Can LLMs Generate Reliable Test Suites in Software Engineering? (2026.findings-acl)

Copied to clipboard

Challenge: Evaluating software engineering capabilities is a core component of large language models (LLMs).
Approach: They propose a benchmark to evaluate LLM-generated test suites that introduces mutated solutions that attempt to "fool" them.
Outcome: The proposed test suites are based on 2,636 mutated variants derived from 800 original instances and include a multilingual subset spanning nine programming languages.
Enhancing Key-Value Memory Neural Networks for Knowledge Based Question Answering (N19-1)

Copied to clipboard

Challenge: Existing Key-value Memory Neural Networks are effective for shallow reasoning over documents . but extending them to Knowledge Based Question Answering is not trivial .
Approach: They propose a mechanism to enable conventional KV-MemNNs models to perform interpretable reasoning for complex questions.
Outcome: The proposed solution provides better reasoning abilities on complex questions and achieves state-of-the-art performance.
Length Controlled Generation for Black-box LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing length control methods involve fine-tuning the parameters of LLMs, which is inefficient and suboptimal for practical use.
Approach: They propose an iterative sampling framework that regulates LLMs to generate length-constrained text without modifying the underlying parameters.
Outcome: The proposed method achieves 100% success rates on Llama3.1 tasks with minimal additional computational overhead.
Efficient Temporal Extrapolation of Multimodal Large Language Models with Temporal Grounding Bridge (2024.emnlp-main)

Copied to clipboard

Challenge: despite advances in multimodal large language models, the challenge of interpreting long-form videos remains a challenge . despite advancements in video-language benchmarks, the inefficiency in temporal grounding and limited pre-trained context window size remains .
Approach: They propose a framework that bootstraps MLLMs with advanced temporal grounding capabilities and broadens their contextual scope.
Outcome: The proposed framework significantly enhances the temporal capabilities of existing MLLMs.
Rethinking Dictionaries and Glyphs for Chinese Language Pre-training (2023.findings-acl)

Copied to clipboard

Challenge: Large-scale pre-trained language models (PLMs) such as BERT and GPT have revolutionized various research fields in natural language processing (NLP)
Approach: They propose a new learning paradigm that enhances the semantics understanding ability of Chinese PLMs with dictionary knowledge and structure of Chinese characters.
Outcome: The proposed model improves on both modern Chinese understanding benchmark CLUE and ancient Chinese understanding.
More Samples or More Prompts? Exploring Effective Few-Shot In-Context Learning for LLMs with In-Context Sampling (2024.findings-naacl)

Copied to clipboard

Challenge: Existing studies on LLM prompting focus on selecting a better set of data samples inside one single prompt input, but why not design and leverage multiple ICL prompts together to further improve the LLM’s performance?
Approach: They propose a low-resource LLM prompting technique to optimize the construction of multiple ICL prompt inputs to produce confident predictions.
Outcome: The proposed technique can produce confident predictions by optimizing the construction of multiple ICL prompt inputs on four NLI datasets and one QA dataset.
MERIT: Multi-Agent Collaboration for Unsupervised Time Series Representation Learning (2025.findings-acl)

Copied to clipboard

Challenge: Existing approaches to time series representation learning are time-consuming and expert-dependent, which are difficult to generalize across different tasks.
Approach: They propose to use large language model agent to guide unsupervised time series representation learning and a framework to integrate three LLM agents to collaboratively generate positive views for time series data.
Outcome: The proposed framework integrates large language model (LLM) agent to guide unsupervised time series representation learning and compares it with state-of-the-art baselines on multiple time series datasets.
Medical Dialogue System: A Survey of Categories, Methods, Evaluation and Challenges (2024.findings-acl)

Copied to clipboard

Challenge: Existing medical dialogue systems have significant potential to simplify diagnostic procedure and reduce the cost of collecting information from patients.
Approach: They analyze 325 papers from well-known computer science, natural language processing conferences and journals to find out the major challenges of medical dialog systems.
Outcome: The proposed systems have been surveyed in the medical community but have not been evaluated from a technical perspective.
Well Begun is Half Done: Low-resource Preference Alignment by Weak-to-Strong Decoding (2025.findings-acl)

Copied to clipboard

Challenge: Low-resource methods for LLM alignment have been popular, but still face challenges in obtaining high-quality and aligned content.
Approach: They propose a framework to enhance alignment ability of base models by the guidance of a small aligned model.
Outcome: The proposed framework outperforms baseline methods while avoiding degradation on downstream tasks.
Synergizing Multimodal Temporal Knowledge Graphs and Large Language Models for Social Relation Recognition (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have limited capacity to model complex graph-structured relationships.
Approach: They propose a low-coupling method synergizing multimodal temporal Knowledge Graphs and Large Language Models for social relation reasoning.
Outcome: The proposed method exhibits state-of-the-art performance in social relation recognition . it bridges the gap between KGs and LLMs and will be released after acceptance .
Predicate Debiasing in Vision-Language Models Integration for Scene Graph Generation Enhancement (2024.emnlp-main)

Copied to clipboard

Challenge: Existing researches in Scene Graph Generation (SGG) focus on refining model architectures that are trained from scratch with datasets like Visual Genome or Open Images.
Approach: They propose to integrate pretrained Vision-language Models into SGG to improve representation by estimating the unattainable predicates distribution.
Outcome: The proposed method significantly improves the performance of the debiased VLMs with SGG models.
LLM Sensitivity Evaluation Framework for Clinical Diagnosis (2025.coling-main)

Copied to clipboard

Challenge: Existing studies on the sensitivity of Large Language Models (LLMs) to irrelevant contexts neglect the importance of key information.
Approach: They investigate the sensitivity of large language models to key medical information by introducing different perturbation strategies to investigate their sensitivity.
Outcome: The proposed models are based on three LLMs, namely GPT-3.5, GPT-4, Gemini, Claude3 and LLaMA2-7b, and demonstrate their reliability and sensitivity to medical information.
AssistSR: Task-oriented Video Segment Retrieval for Personal AI Assistant (2022.findings-emnlp)

Copied to clipboard

Challenge: Currently, personal AI assistants on the phone and AR glasses can assist our daily life in addressing our questions like "how to adjust the date for this watch?"
Approach: They propose a task that asks a question about affordance of items in our daily life . they construct a dataset that contains 3.2k multimodal questions on 1.6k video segments .
Outcome: The proposed task outperforms baseline methods while still having room for improvement in the future.
VSTAR: A Video-grounded Dialogue Dataset for Situated Semantic Understanding with Scene and Topic Transitions (2023.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for video-grounded dialogues neglect the intrinsic attributes of multimodal dialogues, such as scene and topic transitions.
Approach: They propose to use a large scale video-grounded scene&topic AwaRe dialogue dataset to study video-based dialogue understanding.
Outcome: The proposed dataset shows that multimodal information and segments are important in video-grounded dialogue understanding and generation.
Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verification (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in Deep Research Agents (DRAs) are transforming automated knowledge discovery and problem-solving.
Approach: They propose an inference-time scaling of verification wherein an agent self-improves at test time by evaluating its generated answers.
Outcome: The proposed model outperforms vanilla agent-as-judge and LLM judge baselines by 12%–48% in meta-evaluation F1 score.
Instantly Learning Preference Alignment via In-context DPO (2025.naacl-long)

Copied to clipboard

Challenge: Presently, mainstream approaches to HPA heavily depend on fine-tuning . however, the huge computational and annotation costs of fine-timing are hard to ignore .
Approach: They propose a tuning-free approach to HPA using LLMs' decoding . they first rethink the derivation procedures of DPO and build an instant scorer .
Outcome: The proposed approach outperforms existing methods even with tuning-free baselines and an upgraded scorer.
Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsing (D19-1)

Copied to clipboard

Challenge: Existing approaches to learn cross-lingual word embeddings in a contextual space are lacking.
Approach: They propose a method to generate cross-lingual contextualized word embeddings using pre-trained BERT models by learning a linear transformation from contextual word alignments.
Outcome: The proposed approach outperforms state-of-the-art models on zero-shot cross-lingual transfer parsing and is highly competitive with existing models.
Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Existing "LLM-as-a-judge" evaluation frameworks are limited by persona descriptions and are not generalizable to other tasks.
Approach: They propose a framework that can automatically construct multiple evaluator personas with distinct dimensions from relevant text documents and instantiate LLM agents with the persona.
Outcome: The proposed framework can believably simulate human evaluators . it extracts stakeholders' diverse perspectives from the provided research papers and constructs personas for the agents .
A Multistage Extraction Pipeline for Long Scanned Financial Documents: An Empirical Study in Industrial KYC Workflows (2026.acl-industry)

Copied to clipboard

Challenge: Structured information extraction from long, multilingual scanned financial documents is a core requirement in industrial KYC and compliance workflows.
Approach: They propose a framework for structured information extraction from long, multilingual scanned financial documents . they combine image preprocessing, multilinguistic OCR, hybrid page-level retrieval and VLMs .
Outcome: The proposed pipeline outperforms direct PDF-to-VLM baselines on 120 production KYC documents.
LLaMA-Rider: Spurring Large Language Models to Explore the Open World (2024.findings-naacl)

Copied to clipboard

Challenge: Recent studies have used Large Language Models to help decision-making and planning in environments, but their capacity to acquire environmental knowledge and adapt in an open world remains uncertain.
Approach: They propose an approach to spur LLMs to explore the open world, gather experiences, and learn to improve their task-solving capabilities by using a feedback-revision mechanism.
Outcome: The proposed model enhances the efficiency of the LLM in exploring the open world and improves its ability to accomplish more tasks through fine-tuning with merely 1.3k instances of collected data, showing minimal training costs compared to baseline using reinforcement learning.
Event Detection from Social Media for Epidemic Prediction (2024.naacl-long)

Copied to clipboard

Challenge: Social media is an easy-to-access platform providing timely updates about societal trends and events.
Approach: They propose a framework to extract epidemic-related events from social media posts to provide early warnings.
Outcome: The proposed framework can detect epidemic events for three unseen epidemics of Monkeypox, Zika, and Dengue while existing models fail miserably.
Crisp: Cognitive Restructuring of Negative Thoughts through Multi-turn Supportive Dialogues (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to cognitive restructuring (CR) are limited by entrenched cognitive distortions, emotional resistance, and individual differences.
Approach: They propose a framework that structures CR as theory-grounded multi-stage multi-turn dialogue and a multi-channel loop mechanism to account for diverse individual distortions.
Outcome: The proposed framework integrates supportive strategies for emotional management and a multi-channel loop mechanism to account for diverse individual distortions.
SAM Decoding: Speculative Decoding via Suffix Automaton (2025.acl-long)

Copied to clipboard

Challenge: Speculative decoding (SD) methods are inefficient and rely on single retrieval resources.
Approach: They propose a retrieval-based speculative decoding method that adapts the suffix automaton for efficient draft generation by utilizing the generating text sequence and static text corpus.
Outcome: The proposed method can find the longest suffix match and can be integrated with existing methods to generalize to broader domains.
QualiSpeech: A Speech Quality Assessment Dataset with Natural Language Reasoning and Descriptions (2025.acl-long)

Copied to clipboard

Challenge: Existing datasets lack comprehensive annotations for speech quality assessment . existing methods lack detailed annotations, resulting in inaccurate evaluations.
Approach: They propose a low-level speech quality assessment dataset incorporating natural language descriptions and a Benchmark to evaluate low- level speech understanding capabilities of auditory large language models.
Outcome: The proposed model can be used to evaluate the low-level speech understanding capabilities of auditory large language models.
From Recognition to Reasoning: Benchmarking and Enhancing MLLMs on Real-World Receipt Document Understanding (2026.acl-long)

Copied to clipboard

Challenge: Existing models for visual information extraction suffer from limitations in scale and realism . ReceiptBench is a large-scale, human-annotated benchmark for receipts .
Approach: They propose a large-scale, human-annotated benchmark for visual information extraction . the method organizes information extraction into four hierarchical sub-tasks .
Outcome: The proposed method surpasses proprietary models on complex reasoning tasks.
P2 Law: Scaling Law for Post-Training After Model Pruning (2025.acl-long)

Copied to clipboard

Challenge: Pruning has become a widely adopted technique for reducing the hardware requirements of large language models (LLMs).
Approach: They propose to use model pruning techniques to maintain high performance while reducing hardware requirements for large language models (LLMs).
Outcome: The proposed model pruning law can be generalized to larger dataset sizes, larger model sizes, and higher pruning rates, offering valuable insights for resource allocation in pruned LLMs.
Improving Contextual Faithfulness of Large Language Models via Retrieval Heads-Induced Optimization (2025.acl-long)

Copied to clipboard

Challenge: Existing frameworks for retrieval-augmented large language models (LLMs) are lacking in LFQA faithfulness testing.
Approach: They propose a framework to teach retrieval-augmented large language models to explicitly discriminate between faithful and unfaithful generations.
Outcome: The proposed framework outperforms GPT-4o in LFQA scenarios and outperformed existing benchmarks.
Neural Topic Modeling with Bidirectional Adversarial Training (2020.acl-main)

Copied to clipboard

Challenge: Recent studies have shown that neural topic models for automatic topic extraction avoid complicated mathematical derivations for model inference.
Approach: They propose a bidirectional adversarial topic model which uses a generator and an encoder to infer topic distribution.
Outcome: The proposed model outperforms baselines and competitive models in three benchmark corpora.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations