Papers by Qian Yang

81 papers
Product Question Answering in E-Commerce: A Survey (2023.acl-long)

Copied to clipboard

Challenge: Product question answering (PQA) aims to automatically provide instant responses to customer’s questions in E-commerce platforms.
Approach: They categorize PQA studies into four problem settings in terms of the form of provided answers.
Outcome: The proposed methods capture the unique challenges of product question answering (PQA) .
HateModerate: Testing Hate Speech Detectors against Content Moderation Policies (2024.findings-naacl)

Copied to clipboard

Challenge: Existing studies on hate speech detection have failed to answer this question.
Approach: They propose a dataset for testing the behaviors of automated content moderators against content policies.
Outcome: The proposed dataset includes hateful and non-hateful examples matching the 41 community standards guideline policies of Facebook.
ReCode: Robustness Evaluation of Code Generation Models (2023.acl-long)

Copied to clipboard

Challenge: Existing work on robustness in text or code tasks has focused on classification, while robustness for code generation tasks is an uncharted area.
Approach: They propose a robustness evaluation benchmark for code generation models that customizes over 30 transformations specifically for code on docstrings, function and variable names, code syntax, and code format.
Outcome: The proposed model performs better on human annotators and on SOTA models with human annnotators.
Fast and Effective On-Policy Distillation from Reasoning Prefixes (2026.findings-acl)

Copied to clipboard

Challenge: On-policy distillation (OPD) requires expensive on-the-fly sampling of the student policy during training, which substantially increases training cost.
Approach: They propose to use on-policy distillation to sample trajectories from student model . they propose to terminate the sampling early during distillation .
Outcome: The proposed method matches the performance of full OPD in long reasoning outputs while reducing training FLOP by 2x–40x.
UniVocal: Unified Speech-Singing Code-Switching Synthesis (2026.acl-long)

Copied to clipboard

Challenge: Existing systems cannot automatically determine when to switch between modes based on text content.
Approach: They propose a unified framework that implicitly infers vocal modes from text context to pioneer SCS Synthesis.
Outcome: The proposed framework infers vocal modes solely from text context to pioneer SCS Synthesis.
VoxpopuliTTS: a large-scale multilingual TTS corpus for zero-shot speech generation (2025.coling-main)

Copied to clipboard

Challenge: Existing multilingual TTS datasets are limited in speech generation fields due to lack of quality data.
Approach: They propose to use 30,000 hours of high-quality speech data across 3 languages . they filter out low-quality text-text pairs and concatenate short transcripts .
Outcome: The proposed dataset comprises 30,000 hours of high-quality speech data, across 3 languages with multiple speakers and styles, suitable for various speech tasks such as TTS and ASR.
AT²PO: Agentic Turn-based Policy Optimization via Tree Search (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have catalyzed the development of autonomous agents capable of executing complex, multi-turn tasks.
Approach: They propose a framework for agentic reinforcement learning that integrates turn-level tree search with tree search to address key challenges.
Outcome: The proposed framework addresses key challenges: limited exploration diversity, sparse credit assignment, and misaligned policy optimization.
PUNR: Pre-training with User Behavior Modeling for News Recommendation (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing news recommendation methods use pre-trained language models to produce news vectors and user vectors.
Approach: They propose an unsupervised pre-training paradigm with two tasks for user behavior modeling.
Outcome: The proposed model improves on the real-world news benchmark.
Few-Shot Multimodal Named Entity Recognition Based on Mutlimodal Causal Intervention Graph (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for multimodal named entity recognition are limited due to limited resources.
Approach: They propose a Few-shot Multimodal Named Entity Recognition task to address these relation types by constructing a multimodal graph and a new multimodal causal intervention strategy.
Outcome: The proposed model improves on two multimodal named entity recognition datasets.
ReasonAny: Incorporating Reasoning Capability to Any Model via Simple and Effective Model Merging (2026.acl-long)

Copied to clipboard

Challenge: Existing models with long chain-of-thought reasoning lack reasoning depth and domain-specific utility.
Approach: They propose a model merging framework that integrates reasoning with domain-specific task models.
Outcome: The proposed model merging framework outperforms state-of-the-art models while maintaining robust reasoning performance.
GLM: General Language Model Pretraining with Autoregressive Blank Infilling (2022.acl-long)

Copied to clipboard

Challenge: Existing pretraining frameworks do not perform well for all tasks of three main categories, such as natural language understanding (NLU), unconditional generation, and conditional generation.
Approach: They propose a general language model based on autoregressive blank infilling to address this challenge.
Outcome: The proposed model outperforms BERT, T5, and GPT on a wide range of tasks across NLU, conditional and unconditional generation tasks.
Decompose and Compare Consistency: Measuring VLMs’ Answer Reliability via Task-Decomposition Consistency Comparison (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for estimating uncertainty using answer likelihoods or prompt-based confidence generation often suffer from overconfidence and confirmation biases.
Approach: They propose to use Decompose and Compare Consistency (DeCC) to measure the reliability of a VLM's direct answer and indirect answers by decomposing the question into sub-questions and reasoning over the sub-answers.
Outcome: Experiments on six vision-language tasks with three VLMs show that DeCC achieves better correlation with task accuracy compared to existing methods.
CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents (2025.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for MLM agents in interactive environments are limited by their focus on a single environment, lack of detailed and generalized evaluation methods, and the complexity of constructing tasks and evaluators.
Approach: They propose a cross-environment agent benchmark framework that integrates graph-based evaluation and task generation methods.
Outcome: The proposed framework supports multiple devices and can be easily extended to any environment with a Python interface.
A Framework for Exploring Player Perceptions of LLM-Generated Dialogue in Commercial Video Games (2023.findings-emnlp)

Copied to clipboard

Challenge: evaluating the player experience in a roleplaying game augmented with LLM-generated dialogue remains a major challenge.
Approach: They propose a dynamic evaluation framework for the dialogue management systems that govern the task-oriented dialogue often found in roleplaying video games.
Outcome: The proposed framework directly evaluates the performance of LLM-generated dialogue in a role-playing game with 28 players.
Exploring the Best Practices of Query Expansion with Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) are foundational in language technologies, particularly in information retrieval (IR).
Approach: They propose a framework that leverages large language models for query expansion . they use LLMs to generate multiple pseudo-references and integrate them with original queries .
Outcome: The proposed framework enhances sparse and dense retrieval methods without pre-indexing.
Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning (2024.acl-long)

Copied to clipboard

Challenge: Experimental results show that fine-tuning of large language models for specific tasks can be challenging . distribution shift during fine-timing can lead to performance degradation in general task capabilities .
Approach: They propose a new approach that bridges the distribution gap between task datasets and LLMs by guiding fine-tuning with a distilled dataset generated by the model itself.
Outcome: The proposed approach achieves comparable or superior performance on downstream tasks compared to the vanilla approach.
i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data (2024.findings-naacl)

Copied to clipboard

Challenge: i-Code V2 is one of the first models capable of generating natural language from any combination of Vision, Language, and Speech data.
Approach: They propose to create a model that can generate natural language from any combination of Vision, Language, and Speech data.
Outcome: i-Code V2 matches or outperforms state-of-the-art single- and dual-modality baselines on 7 multimodal tasks.
Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have emerged as powerful tools for a wide range of tasks, from * Equal Contribution.
Approach: They propose a framework that enhances communication efficiency and task effectiveness in LLM-based multi-agent systems through training.
Outcome: The proposed framework improves communication efficiency and task effectiveness on multi-agent tasks with 2.8x performance gain with less than 10% tokens on tasks requiring heavy information exchange.
Forget the Unneeded: Backdooring Large Language Models via Contrastive-enhanced Machine Unlearning (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for prompt tuning for Large Language Models find backdoor attacks to be significant in data-rich scenarios.
Approach: They propose a backdoor attacks through contrastive-enhanced machine unlearning in data-limited scenarios . they use a machine un learning method to capture precise backdoor patterns .
Outcome: The proposed method captures precise backdoor patterns without association between triggers and backdoors, reducing side effects.
WESR: A Benchmark and Strong Baseline for Word-level Event-Speech Recognition (2026.findings-acl)

Copied to clipboard

Challenge: aaron carroll: the precise localization of non-verbal vocal events remains a critical yet under-explored challenge. carroll says current methods suffer from insufficient task definitions with limited category coverage. carrol: knowing exactly where an event occurred is not enough; knowing exactly what it happened is.
Approach: They propose a taxonomy of 21 vocal events with a new categorization into discrete versus continuous types.
Outcome: The proposed model disentangles ASR errors from event detection while maintaining ASR quality.
DataTales: A Benchmark for Real-World Intelligent Data Narration (2024.emnlp-main)

Copied to clipboard

Challenge: Existing benchmarks fail to capture the requisite analytical complexity for practical applications.
Approach: They propose a benchmark to assess the proficiency of language models in data narration.
Outcome: The proposed model combines financial reports with market data to demonstrate proficiency in data narration.
Incremental Transformer with Deliberation Decoder for Document Grounded Conversations (P19-1)

Copied to clipboard

Challenge: Existing dialogue systems do not exploit document knowledge effectively enough.
Approach: They propose a Transformer-based architecture for document grounded conversations that incorporates document knowledge into a two-pass decoder to improve context coherence and knowledge correctness.
Outcome: The proposed model outperforms baselines on context coherence and knowledge relevance on a real-world document grounded dataset.
Revisiting Interpolation Augmentation for Speech-to-Text Generation (2024.findings-acl)

Copied to clipboard

Challenge: Existing approaches to speech-to-text generation tasks are limited by the lack of extensive labeled datasets.
Approach: They propose to use interpolation augmentation to construct virtual training samples by transforming inputs and labels to enhance generalization in other domains.
Outcome: The proposed approach significantly improves performance across diverse tasks, architectures, and data scales, offering a promising avenue for more robust S2T systems in resource-constrained settings.
Multi-Agent Collaboration via Cross-Team Orchestration (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have significantly impacted various domains, especially through organized LLM-driven autonomous agents.
Approach: They propose a framework that enables orchestrated teams to jointly propose various task-oriented solutions and interact with their insights in a self-independence while cross-team collaboration environment for superior solutions generation.
Outcome: Experiments show that the framework can generate better software quality compared to state-of-the-art frameworks.
DocAgent: A Multi-Agent System for Automated Code Documentation Generation (2025.acl-demo)

Copied to clipboard

Challenge: Existing methods for generating documentation using Large Language Models (LLMs) produce incomplete, unhelpful, or factually incorrect outputs.
Approach: They propose a novel collaborative system that uses topological code processing for incremental context building to generate documentation by agents.
Outcome: The proposed system outperforms baselines in completeness, helpfulness, and truthfulness evaluations.
Duplicate-Aware Controlled Code Generation: Enhancing Copyright Protection with Targeted Reordering Beam Search in LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Experimental results demonstrate that TRBS effectively reduces verbatim repetition while maintaining functional adequacy.
Approach: They propose a plug-and-play decoding method that dynamically reorders beam candidates to reduce direct copying.
Outcome: The proposed method reduces verbatim repetition while maintaining functional adequacy on a multi-language code generation benchmark.
Beyond Natural Language: LLMs Leveraging Alternative Formats for Enhanced Reasoning and Communication (2024.findings-emnlp)

Copied to clipboard

Challenge: Natural language (NL) has long been the predominant format for human cognition and communication, but its utility in LLMs has not been thoroughly examined.
Approach: They propose to allow LLMs to choose the most suitable format before reasoning or communicating, and to automate the selection process.
Outcome: The proposed format improves reasoning efficiency and reduces token usage while maintaining communicative effectiveness.
AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)

Copied to clipboard

Challenge: Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning.
Approach: AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks.
Outcome: Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% .
Multi-Hop Knowledge Editing via Critic-Guided Multi-Agent Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing knowledge editing methods rely on unidirectional, feed-forward pipelines . a minor retrieval error or logical mismatch at an early hop can become a silent failure .
Approach: They propose a framework for closed-loop post-edit reasoning that uses a Critic agent to verify coherence and step-wise correctness.
Outcome: Experiments on MQuAKE-2002 and MQuADE-hard show that CARE effectively mitigates error propagation . a minor retrieval error or logical mismatch at an early hop can become a silent failure .
AnyTrans: Translate AnyText in the Image with Large Scale Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in natural language processing and computer vision have made it possible to translate images with text in one language into equivalent images displaying that text translated into another language.
Approach: They propose an all-encompassing framework for the task–In-Image Machine Translation (IIMT) that incorporates contextual cues from both textual and visual elements during translation.
Outcome: The proposed framework can be constructed using open-source models and requires no training, making it highly accessible and expandable.
EscapeBench: Towards Advancing Creative Intelligence of Language Model Agents (2025.acl-long)

Copied to clipboard

Challenge: Existing language model agents excel in planning and reasoning, but lack creativity in unfamiliar environments.
Approach: They propose a benchmark suite of room escape game environments to challenge agents with creative reasoning, unconventional tool use and iterative problem-solving to uncover implicit goals.
Outcome: The proposed framework can perform with 40% fewer steps and hints and performs robustly across difficulty levels.
A Systematic Assessment of Language Models with Linguistic Minimal Pairs in Chinese (2026.tacl-1)

Copied to clipboard

Challenge: Using sub-linear length normalized log-probabilities (SLLN-LP), we find unequal lengths of sentences in minimal pairs difficult for LMs even up to 32B parameters.
Approach: They propose to use ZhoBLiMP as a linguistic minimal pair benchmark for Chinese language models to mitigate biases.
Outcome: The proposed metric mitigates biases in Chinese language models with over 100 paradigms . Anaphor, Quantifiers, and Ellipsis are difficult for LMs even up to 32B parameters .
Internalizing Multi-Agent Reasoning for Accurate and Efficient LLM-based Recommendation (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are reshaping recommender systems by leveraging extensive world knowledge and semantic reasoning to interpret user intent.
Approach: They propose a single-agent Trajectory-Aligned Recommender to integrate reasoning capabilities into a model by a multi-agend teacher system.
Outcome: The proposed model surpasses its teacher by 8.7% to 39.5% while eliminating iterative latency.
AMA: Adaptive Memory via Multi-Agent Collaboration (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to longterm memory rely on rigid retrieval granularity, accumulation-heavy maintenance strategies, and coarse-grained update mechanisms.
Approach: They propose a framework that leverages coordinated agents to manage memory across multiple granularities.
Outcome: The proposed framework outperforms state-of-the-art benchmarks while reducing token consumption by approximately 80%.
MuG: A Multimodal Classification Benchmark on Game Data with Tabular, Textual, and Visual Fields (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing multimodal classification systems use tabular, textual, and visual data to provide efficient and scalable services.
Approach: They propose a multimodal classification benchmark MuG with eight datasets . they analyze label balance ratios, percentages of missing features, distributions of data within each modality .
Outcome: The proposed benchmark is available on https://github.com/lujiaying/MUG-Bench . it includes eight datasets that allow researchers to evaluate and improve their models .
Can Small Language Models Help Large Language Models Reason Better?: LM-Guided Chain-of-Thought (2024.lrec-main)

Copied to clipboard

Challenge: Existing frameworks for guiding a language model in reasoning tasks are limited by their tendency to generate low-quality rationales that are repetitive and vacuous.
Approach: They propose a framework that leverages a lightweight language model for guiding a black-box large LM in reasoning tasks.
Outcome: The proposed framework outperforms baselines in answer prediction accuracy.
EoT: Evolution of Thoughts for Complex Reasoning Tasks (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing studies focus on ensuring behavior fidelity, factuality or reliability in generated reasoning processes, but they neglect the simultaneous optimization of all three aspects for each thought.
Approach: They propose a thought assessment method that is sensitive to knowledge and LLM behaviors . they use three scorers to evaluate each thought by considering domain context, semantic alignment, and behavior impact.
Outcome: The proposed framework outperforms advanced approaches in knowledge-based complex tasks.
Diffusion Glancing Transformer for Parallel Sequence-to-Sequence Learning (2024.naacl-long)

Copied to clipboard

Challenge: Experimental results show that non-autoregressive generation models are superior in generation efficiency but inferior in generation quality.
Approach: They propose a diffusion glancing transformer which employs a modality diffusion process and residual glancy sampling to improve multi-modality modeling.
Outcome: The proposed model outperforms autoregressive and non-autoregressive models on machine translation and text generation benchmarks.
PLAY2PROMPT: Zero-shot Tool Instruction Optimization for LLM Agents via Tool Play (2025.findings-acl)

Copied to clipboard

Challenge: Existing solutions for large language models rely on manual rewriting or labeled data for validation . Existing approaches rely only on comprehensive tool documentation and in-context demonstrations .
Approach: They propose a framework that "plays" with each tool to explore its input-output behaviors.
Outcome: Experiments show that PLAY2PROMPT improves zero-shot tool performance across open and closed models.
SparkRA: A Retrieval-Augmented Knowledge Service System Based on Spark Large Language Model (2024.emnlp-demo)

Copied to clipboard

Challenge: Large language models (LLMs) have shown remarkable achievements across various language tasks.
Approach: They propose a scientific literature LLM and a knowledge service system based on it . they collect scientific literature and then pre-train it using autoregressive training .
Outcome: The proposed system provides literature investigation, paper reading, and academic writing functions.
FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding (2022.acl-long)

Copied to clipboard

Challenge: Existing evaluation protocols for few-shot natural language understanding (NLU) tasks are inconsistent and hinder fair comparison and measuring progress.
Approach: They propose an evaluation framework that improves previous evaluation procedures in three key aspects, i.e., test performance, dev-test correlation, and stability.
Outcome: The proposed framework improves evaluation procedures in three key aspects, i.e., performance, dev-test correlation, and stability.
Task-oriented Word Embedding for Text Classification (C18-1)

Copied to clipboard

Challenge: Existing word embeddings only consider contextual information, which is suboptimal when used in various tasks due to a lack of task-specific features.
Approach: They propose a task-oriented word embedding method that regularizes the distribution of words to enable a clear classification boundary.
Outcome: The proposed method outperforms the state-of-the-art methods on a text classification task.
Web Sitemap Knowledge Can Enhance Autonomous Browsing (2026.findings-acl)

Copied to clipboard

Challenge: Existing web agents suffer from limited robustness, efficiency and task success due to lack of structural understanding of websites and lack of browsing priors in pre-trained models.
Approach: They propose an agent-oriented sitemap protocol that integrates structured website knowledge into web agents.
Outcome: The proposed agent-oriented sitemap improves robustness, efficiency and effectiveness without extra training.
Audio-Aware Large Language Models as Judges for Speaking Styles (2025.findings-emnlp)

Copied to clipboard

Challenge: Audio-aware large language models (ALLMs) can understand textual and non-textual information in the audio input.
Approach: They use audio-aware large language models (ALLMs) to evaluate the speaking styles of SLMs on two tasks: voice style instruction following and role-playing.
Outcome: The proposed models can understand the textual and non-textual information in the audio input and can be used as a judge to assess the speaking styles of SLMs.
MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown remarkable capabilities as autonomous agents, yet existing benchmarks focus on single-agent tasks or are confined to narrow domains, failing to capture the dynamics of multi-agent coordination and competition.
Approach: They propose a benchmark to evaluate LLM-based multi-agent systems across diverse, interactive scenarios.
Outcome: The proposed framework measures task completion and quality of collaboration and competition using novel, milestone-based key performance indicators.
MASFactory: A Graph-centric Framework for Orchestrating LLM-Based Multi-Agent Systems with Vibe Graphing (2026.acl-demo)

Copied to clipboard

Challenge: Large language model-based multi-agent systems (MAS) are increasingly used to extend agentic problem solving via role specialization and collaboration.
Approach: They propose a graph-centric framework for orchestrating large language model-based multi-agent systems . they compile a user's natural-language intent into an editable workflow specification and then into an executable graph .
Outcome: The proposed framework compiles natural-language intent into an executable graph and then compile and executes it at runtime.
HyperCRS: Hypergraph-Aware Multi-Grained Preference Learning to Burst Filter Bubbles in Conversational Recommendation System (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to analyze filter bubbles in the static recommendation environment are unable to burst them during user interactions.
Approach: They propose a paradigm to learn multi-grained user preferences during dynamic user-system interactions via natural language conversations to burst filter bubbles.
Outcome: The proposed paradigm achieves state-of-the-art performance and the superior of bursting filter bubbles in the conversational recommendation system.
UNIKIE-BENCH: Benchmarking Large Multimodal Models for Key Information Extraction in Visual Documents (2026.acl-long)

Copied to clipboard

Challenge: Recent Large Multimodal Models (LMMs) have shown promising potential for performing end-to-end KIE directly from document images.
Approach: They propose a benchmark to evaluate the performance of Large Multimodal Models (LMMs) using a constrained-category KIE track and an open-categorical KIE Track.
Outcome: Experiments on 15 state-of-the-art LMMs show performance degradation under diverse schema definitions, long-tail key fields, and complex layouts, along with pronounced performance disparities across different document types and scenarios.
AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension (2024.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for audio-centric interaction have impeded advancements in this field . AIR-Bench evaluates LALMs' ability to understand audio signals and interact with humans .
Approach: They propose a benchmark to evaluate the ability of large audio-language models to understand audio signals . they use 19 tasks with approximately 19k single-choice questions to examine single-task ability .
Outcome: The proposed framework evaluates the ability of large audio-language models to understand audio signals and interact with humans in the textual format.
EmoRes: Toward Adaptive Psychological Support via User-Agnostic Benchmark and Topic-Mining Agent (2026.findings-acl)

Copied to clipboard

Challenge: Large language models generate fragmented and emotionally inconsistent dialogues lacking the therapeutic structure necessary for reliable assessment.
Approach: They propose a framework that boosts psychological reasoning via a Topic-Mining Emotional Agent and a multi-perspective Self-Reflection Agent.
Outcome: The proposed framework improves topic continuity, emotional coherence, and clinical interpretability over baselines and validated by ablation studies and human evaluations.
Chase: A Large-Scale and Pragmatic Chinese Dataset for Cross-Database Context-Dependent Text-to-SQL (2021.acl-long)

Copied to clipboard

Challenge: XDTS is a cross-database context-dependent text-to-sql problem with wide range of applications.
Approach: They present a large-scale Chinese dataset for cross-database context-dependent Text-to-SQL . they find that only 35% of questions are context-independent and 28% of SQL queries are easy .
Outcome: The proposed approach achieves an exact match accuracy of 40% over all questions and 16% over all question sequences.
FineState-Bench: Benchmarking State-Conditioned Grounding for Fine-grained GUI State Setting (2026.findings-acl)

Copied to clipboard

Challenge: FineState-Bench evaluates whether an agent can correctly ground an instruction to the intended UI control and reach the exact target state.
Approach: They propose a benchmark that evaluates whether an agent can correctly ground an instruction to the intended UI control and reach the exact target state.
Outcome: The proposed benchmark evaluates whether an agent can ground an instruction to the intended UI control and reach the exact target state.
Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study (2025.coling-main)

Copied to clipboard

Challenge: Existing benchmarks focused on simplified or isolated aspects of coding, ignoring the full spectrum of programming challenges.
Approach: They propose a case study that examines the performance of large language models across the entire software development lifecycle with four programming languages, multiple domains, and carefully designed and verified metrics for each task.
Outcome: The proposed model performs across the entire software development lifecycle, including design, environment setup, implementation, acceptance testing, and unit testing.
Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generation (2026.findings-acl)

Copied to clipboard

Challenge: Multi-agent systems (MAS) are increasingly used for open-ended idea generation . when and why collective interaction expands the solution space remains unclear .
Approach: They propose to study diversity in multi-agent systems across three bottom-up levels: model intelligence, agent cognition, and system dynamics.
Outcome: The proposed model yields diminishing diversity despite higher quality . the proposed model fails to expand diversity and causes it to collapse .
FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models (2023.findings-acl)

Copied to clipboard

Challenge: Existing methods for speech editing still suffer from over-smoothing problem and lack of robustness due to stutter.
Approach: They propose a stutter-oriented automatic speech editing model that incorporates sutter information into the hidden sequence.
Outcome: The proposed model achieves state-of-the-art performance on a speech recording dataset . it can improve fluency of stuttering speech in terms of objective and subjective metrics.
Toward Informal Language Processing: Knowledge of Slang in Large Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have offered a strong potential for natural language systems to process informal language.
Approach: They propose to use movie subtitles to evaluate slang in large language models . they find that smaller LLMs finetuned on the dataset achieve comparable performance .
Outcome: The proposed dataset can be used to evaluate LLMs on slang detection and identification of regional and historical sources for interpretive insights.
Experiential Co-Learning of Software-Developing Agents (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have brought significant changes to various domains, especially through autonomous agents.
Approach: They propose a framework that lets agents learn shortcuts from their past tasks and use them for future task execution.
Outcome: The proposed framework enables agents to tackle unseen software-developing tasks more effectively.
Rejection-to-Acceptance Transition: Model Editing-Based Jailbreak Backdoor Injection Not Limited to Few Output Tokens (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for jailbreaking LLMs are implemented by binding backdoors to predefined phrases as first few output tokens, inducing the LLM’s next-token prediction to produce continuous responses.
Approach: They propose a model editing-based jailbreak backdoor attack that hijacks LLM representations into a acceptance domain rather than binding to a few output tokens.
Outcome: The proposed model editing method outperforms existing methods, showing stronger jailbreak capabilities across LLMs and datasets.
SEER: Facilitating Structured Reasoning and Explanation via Reinforcement Learning (2024.acl-long)

Copied to clipboard

Challenge: Existing methods focus on single-step reasoning, ignoring logical dependencies between steps.
Approach: They propose a method that maximizes a structure-based return to facilitate structured reasoning and explanation.
Outcome: The proposed method outperforms state-of-the-art methods on EntailmentBank and STREET benchmarks.
Detecting AI-Generated Content on Social Media with Multi-modal Language Models (2026.acl-industry)

Copied to clipboard

Challenge: Existing methods for AI-generated content detection face poor generalization to newer models, reliance on single modalities, and lack of interpretable explanations.
Approach: They propose a model that curates diverse social media data and trains a vision-language model for detection and explanation.
Outcome: The proposed model achieves state-of-the-art detection performance on public benchmarks and observes positive downstream impacts on user engagement.
Chameleon: A Language Model Adaptation Toolkit for Automatic Speech Recognition of Conversational Speech (D19-3)

Copied to clipboard

Challenge: Language model adaptation (LMA) is a promising solution for conversational speech recognition systems.
Approach: They propose to use language model adaptation techniques to adapt language models to conversational speech recognition.
Outcome: The proposed toolkit compares state-of-the-art language model adaptation techniques in conversational speech recognition tasks.
Deputy: Accelerating Large Language Model Inference with Dynamic Low-Rank Substitution (2026.findings-acl)

Copied to clipboard

Challenge: Existing dynamic schemes such as early-exit and layer-drop reduce FLOPs but break batch processing or introduce KV-cache inconsistency.
Approach: They propose a dynamic low-rank substitution framework that employs a lightweight decision module at each layer to dynamically determine the execution branch for different tokens.
Outcome: The proposed model reduces computation by approximately 40% compared to the original dense model while outperforming existing baseline methods.
Code to Think, Think to Code: A Survey on Code-Enhanced Reasoning and Reasoning-Driven Code Intelligence in LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Recent breakthrough models like OpenAI-o1 and DeepSeek-R1 show powerful task-solving capabilities, particularly advances in reasoning.
Approach: They propose future research directions that may deepen the synergy, ultimately advancing LLM performance in both complex reasoning and code intelligence.
Outcome: The proposed research may deepen the synergy, ultimately advancing LLM performance in both complex reasoning and code intelligence.
Improved Word Sense Disambiguation with Enhanced Sense Representations (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing supervised word sense disambiguation systems do not provide enough information about word senses.
Approach: They propose to incorporate synonyms, example phrases or sentences showing usage of word senses and sense gloss of hypernyms into the sense representations.
Outcome: The proposed system achieves an F1 score of 82.0% on the standard benchmark test dataset of the English all-words WSD task.
OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Code LLMs lack reproducible data pipelines and training protocols for reproducible advancements in code intelligence.
Approach: They propose a top-tier code LLM that releases model weights and inference code . reproducible data pipelines, rigorous experimental ablation results and training protocols are included .
Outcome: The proposed model achieves comparable performance to leading models and serves as an "open cookbook" reproducible training data, rigorous experimental ablation results, and detailed training protocols are also included in the model.
Measuring Human Contribution in AI-Assisted Content Generation (2026.acl-long)

Copied to clipboard

Challenge: generative AI has created a new way to generate content with humans . varying degrees of human contribution in content generation poses significant challenges for the delineation of originality .
Approach: They propose a framework to measure human contribution in AI-assisted content generation by calculating mutual information between human input and AI-aided output relative to self-information of AI-assist output.
Outcome: The proposed measure discriminates between varying degrees of human contribution across multiple creative domains and is validated in real-world applications.
Can Large Language Models Tackle Graph Partitioning? (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have remarkable capabilities in understanding complex tasks, but they can only handle graph partitioning tasks that require global perception abilities.
Approach: They propose a pipeline for coarsening, reasoning, and refining to enable LLMs to perform graph partitioning on small-scale graphs.
Outcome: The proposed pipeline can handle graph partitioning tasks on small graphs with coarsening, reasoning, and refining.
MADAWSD: Multi-Agent Debate Framework for Adversarial Word Sense Disambiguation (2025.emnlp-main)

Copied to clipboard

Challenge: Word sense disambiguation (WSD) is a fundamental yet challenging task in natural language processing.
Approach: a novel multi-agent Debate framework for adversarial word Sense disambiguation is proposed . the framework simulates a real-world debate environment where multiple agents engage in discussions about ambiguous words in the context of adversarials.
Outcome: The proposed framework integrates with existing LLMs and improves models in Chinese language . it shows that it can be used to improve models in the Chinese language and improve performance .
APEX: Learning Adaptive Priorities for Multi-Objective Alignment in Vision-Language Generation (2026.findings-acl)

Copied to clipboard

Challenge: APEX optimizes for text-to-image generation by combining learning potential, conflict penalty, and progress need.
Approach: They propose an algorithm that stabilizes heterogeneous rewards and dynamically schedules objectives . they propose a method that achieves better Pareto trade-offs across four heterogenous objectives based on P3 Adaptive Priorities .
Outcome: The proposed algorithm achieves better pareto trade-offs across four heterogeneous objectives while maintaining competitive OCR accuracy.
Learning Compressed Sentence Representations for On-Device Text Processing (P19-1)

Copied to clipboard

Challenge: Existing methods for learning sentence embeddings assume they are continuous and real-valued.
Approach: They propose four different strategies to transform continuous and generic sentence embeddings into a binarized form while preserving their rich semantic information.
Outcome: The proposed methods reduce storage requirements by over 98% and improve performance on downstream tasks.
Improving Text Generation with Student-Forcing Optimal Transport (2020.emnlp-main)

Copied to clipboard

Challenge: Maximum likelihood estimation (MLE) is used to train models, but during testing, the model is conditioned on previously generated tokens, resulting in exposure bias.
Approach: They propose to use optimal transport to match the sequences generated in MLE and test modes to reduce exposure bias.
Outcome: The proposed method is validated on machine translation, text summarization, and text generation tasks.
TeachMaster: Generative Teaching via Code (2026.acl-industry)

Copied to clipboard

Challenge: Existing methods for creating video content are limited by high costs and slow update cycles.
Approach: They propose a paradigm shifting educators from manual creators to high-level directors who focus on pedagogical intents while agents handle execution.
Outcome: The proposed framework reduces production costs to 0.3% of traditional course videos and provides a robust solution for scalable education.
i-Code Studio: A Configurable and Composable Framework for Integrative AI (2024.emnlp-demo)

Copied to clipboard

Challenge: Existing frameworks for Integrative AI lack flexibility and composability to handle multimodal tasks.
Approach: They propose a configurable framework for Integrative AI that orchestrates multiple pre-trained models to conduct complex multimodal tasks.
Outcome: The proposed framework achieves impressive results on zero-shot multimodal tasks . it can communicate and personalize for users, and it can be used in a multimodal agent .
Awakening Latent Grounding from Pretrained Language Models for Semantic Parsing (2021.findings-acl)

Copied to clipboard

Challenge: Recent years pretrained language models (PLMs) have shown their power on modeling language . however, few efforts have been made to explore grounding capabilities of PLMs .
Approach: They propose to use pretrained language models to explore syntactic structures . they propose to combine their approach with an erasingthen-awakening approach . their results show that the approach can awaken latent grounding, which is understandable to humans .
Outcome: Empirical studies show that the proposed approach can awaken latent grounding . it shows great potential to benefit downstream semantic parsing models, it says .
The Invisible Hand: Unveiling Provider Bias in Large Language Models for Code Generation (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have emerged as the new recommendation engines, surpassing traditional methods in both capability and scope, particularly in code generation.
Approach: They propose to use a dataset to investigate a new type of bias in Large Language Models for code generation, provider bias, to determine whether the model favors specific providers.
Outcome: The proposed model favors services from Google and Amazon, but without explicit directives, and can modify input code to incorporate their preferred providers without user requests.
A Multi-Attention based Neural Network with External Knowledge for Story Ending Predicting Task (C18-1)

Copied to clipboard

Challenge: Existing studies on the topic of common sense story understanding focus on generating guesses for a missing event or concentrating on unsupervised learning.
Approach: They propose to extend attention-based neural network with external knowledge resources to understand temporal stories and predict their endings.
Outcome: The proposed model outperforms state-of-the-art models and external knowledge resources.
Enhancing Open-Domain Task-Solving Capability of LLMs via Autonomous Tool Integration from GitHub (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches lack flexibility to address diverse and ever-evolving user queries in open domains.
Approach: They propose to evaluate LLMs on open-domain knowledge that requires tools to solve diverse and ever-evolving user queries.
Outcome: The proposed system outperforms baselines in the open domain task-solving benchmark.
Active Retrieval Augmented Generation (2023.emnlp-main)

Copied to clipboard

Challenge: Generative language models (LMs) have a tendency to hallucinate and create inaccurate output.
Approach: They propose a method which iteratively uses a prediction of the upcoming sentence to anticipate future content.
Outcome: The proposed method achieves superior or competitive performance on all tasks . iteratively uses a prediction of the upcoming sentence to anticipate future content .
An End-to-End Generative Architecture for Paraphrase Generation (D19-1)

Copied to clipboard

Challenge: Existing methods for generating paraphrases with linguistic knowledge are often domain specific and hard to scale, or yield inferior results.
Approach: They propose an end-to-end conditional generative architecture for generating paraphrases via adversarial training which does not depend on extra linguistic information.
Outcome: The proposed method outperforms existing models on automatic metrics and human evaluations on four public datasets.
Specializing Large Models for Oracle Bone Script Interpretation via Component-Grounded Multimodal Knowledge Augmentation (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for deciphering ancient Chinese Oracle Bone Script (OBS) treat deciphering as a closed-set image recognition problem, which fails to bridge the "interpretation gap" .
Approach: They propose a vision-language model framework that integrates a VLM and an LLM to automate a reasoning chain of component identification and knowledge retrieval.
Outcome: The proposed framework yields more detailed and precise decipherments compared to baseline methods.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations