Papers by Qian Yu

75 papers
Product Question Answering in E-Commerce: A Survey (2023.acl-long)

Copied to clipboard

Challenge: Product question answering (PQA) aims to automatically provide instant responses to customer’s questions in E-commerce platforms.
Approach: They categorize PQA studies into four problem settings in terms of the form of provided answers.
Outcome: The proposed methods capture the unique challenges of product question answering (PQA) .
UniCodec: Unified Audio Codec with Single Domain-Adaptive Codebook (2025.acl-long)

Copied to clipboard

Challenge: Existing neural audio codecs are not capable of handling multi-domain audio data . et al., 2023) integrate speech modality with text-based large language models .
Approach: They propose a unified audio codec with a single codebook to support multi-domain audio data . they propose combining a mix-of-experts strategy and a partitioned domain-adaptive codebook method .
Outcome: The proposed codec outperforms existing codecs on acoustic and semantic representation capabilities.
Multimodal Fusion and Coherence Modeling for Video Topic Segmentation (2025.findings-acl)

Copied to clipboard

Challenge: Traditional video topic segmentation methods struggle to discern topical transitions . supervised approaches have improved performance on video action or scene segmentation .
Approach: They propose a new task for video topic segmentation that enhances multimodality alignment and fusion by exploring different architectures using Cross-Attention and Mixture of Experts.
Outcome: The proposed model improves on educational videos, in the form of lectures . it combines cross-attention and mixture of experts to strengthen multimodality alignment and fusion .
Domain Adaptive Dialog Generation via Meta Learning (P19-1)

Copied to clipboard

Challenge: Existing methods to adapt dialog data to new domains with limited resources are expensive . a domain adaptive dialog system model learns from multiple rich-resource tasks and adapts to new tasks with minimal training samples.
Approach: They propose a domain adaptive dialog generation method based on meta-learning . they train a dialog system model using multiple rich-resource single-domain dialog data .
Outcome: The proposed method can learn a competitive dialog system on a new domain with minimal training examples.
Through the MUD: A Multi-Defendant Charge Prediction Benchmark with Linked Crime Elements (2024.acl-long)

Copied to clipboard

Challenge: Existing charge prediction datasets focus on single-defendant cases, but real-world cases involve multiple defendants.
Approach: They propose a benchmark that encompasses legal cases involving multiple defendants . they develop an interpretable model called EJudge that incorporates crime elements and legal rules to infer charges.
Outcome: The proposed model outperforms state-of-the-art models in predicting crime charges while providing corresponding rationales.
CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Tools (2023.emnlp-demo)

Copied to clipboard

Challenge: a lack of transparency in sustainability reporting is a key challenge due to the sheer volume and complexity of sustainability reports . only a few entities worldwide have the resources to analyze these reports at scale . a novel LLM-based system to automate the analysis of corporate sustainability reports is needed .
Approach: They propose a novel LLM-based system to automate the analysis of corporate sustainability reports.
Outcome: The proposed system automates the analysis of corporate sustainability reports.
Improving Long Document Topic Segmentation Models With Enhanced Coherence Modeling (2023.emnlp-main)

Copied to clipboard

Challenge: Recent supervised neural models have greatly promoted the development of topic segmentation, but the deeper relationship between coherence and topic segmenting is underexplored.
Approach: They propose to use topic-aware Sentence Structure Prediction and Contrastive Semantic Similarity Learning to capture coherence from logical structure and semantic similarity perspectives to further improve topic segmentation performance.
Outcome: The proposed approach outperforms state-of-the-art methods on WIKI-727K and achieves an average relative reduction of 4.3% on Pk on WikiSection.
PTCSpell: Pre-trained Corrector Based on Character Shape and Pinyin for Chinese Spelling Correction (2023.findings-acl)

Copied to clipboard

Challenge: Chinese spelling correction (CSC) is a task which detects incorrect characters in Chinese text and corrects them.
Approach: They propose to pre-train a Chinese spelling correction corrector under the detector-corrector architecture and propose to capture pronunciation and shape information in Chinese characters.
Outcome: The proposed corrector achieves an average of 5.8% F1 improvements over state-of-the-art methods, verifying its effectiveness.
RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Existing RS agents built on general-purpose LLMs are domain-agnostic, resulting in brittle and error-prone workflows.
Approach: They propose a knowledge-enhanced memory evolution mechanism that bootstraps RS agents with pre-distilled domain knowledge and iteratively integrates online experience for robust multi-step tool execution.
Outcome: Experiments show that the new model improves tool-use performance and accuracy . iteratively, iteration of the model integrates online experience for robust multi-step tool execution .
Exploring Diverse Expressions for Paraphrase Generation (D19-1)

Copied to clipboard

Challenge: Existing neural paraphrase generation methods focus on single paraphrases while ignoring the fact that diversity is essential for enhancing generalization capability and robustness of downstream applications.
Approach: They propose a novel approach with two discriminators and multiple generators to generate a variety of different paraphrases.
Outcome: The proposed model gains significant diversity and improves quality over state-of-the-art datasets.
SEGMENT+: Long Text Processing with Short-Context Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing frameworks that increase context window do not guarantee robust performance across long input tasks.
Approach: They propose a framework that enables language models to handle extended inputs within limited context windows efficiently.
Outcome: The framework improves performance on long-document question-answering and Needle-in-a-Haystack tasks.
Guided Knowledge Generation with Language Models for Commonsense Reasoning (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have achieved notable success in commonsense reasoning tasks, benefiting from extensive world knowledge acquired through extensive pretraining.
Approach: They propose a method to generate knowledge explanations and to automatically assign labels based on the probability of correct answers.
Outcome: The proposed method outperforms baselines on four widely-used commonsense reasoning benchmarks and shows that it can generate high quality knowledge leading to correct answers.
WIKIGENBENCH:Exploring Full-length Wikipedia Generation under Real-World Scenario (2025.coling-main)

Copied to clipboard

Challenge: Existing efforts to generate Wikipedia articles for new events fall short of real-world application.
Approach: They propose a benchmark to generate Wikipedia articles for new events under real-world scenarios . they use systematic metrics and LLM-based metrics to assess verifiability, organization, and other aspects aligned with real-life scenarios.
Outcome: The proposed benchmarks show that hierarchical-based methods generate more comprehensive content while fine-tuned methods achieve better verifiability.
CLEAR: A Framework Enabling Large Language Models to Discern Confusing Legal Paragraphs (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing work focuses on enabling LLMs to leverage legal rules to tackle complex legal reasoning tasks, but ignores their ability to understand legal rules.
Approach: They propose a legal paragraph prediction task that aims to predict the legal paragraph given criminal facts and a framework CLEAR to enhance their legal reasoning ability.
Outcome: The proposed model improves the ability of LLMs to analyze legal cases with the guidance of legal rule insights.
TransBench: Breaking Barriers for Transferable Graphical User Interface Agents in Dynamic Digital Environments (2025.findings-acl)

Copied to clipboard

Challenge: Existing GUI agents struggle to adapt to dynamic and interconnected nature of real-world digital environments, authors show .
Approach: They propose a benchmark to evaluate the transferability of GUI agents across three key dimensions . transBench includes 15 app categories with diverse functionalities .
Outcome: The proposed benchmark shows that existing GUI agents struggle to adapt to dynamic, interconnected environments.
i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data (2024.findings-naacl)

Copied to clipboard

Challenge: i-Code V2 is one of the first models capable of generating natural language from any combination of Vision, Language, and Speech data.
Approach: They propose to create a model that can generate natural language from any combination of Vision, Language, and Speech data.
Outcome: i-Code V2 matches or outperforms state-of-the-art single- and dual-modality baselines on 7 multimodal tasks.
ReasonMed: A 370K Multi-Agent Generated Dataset for Advancing Medical Reasoning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing medical reasoning datasets are limited in scale and typically rely on incomplete data.
Approach: They propose to use ReasonMed to train medical reasoning models using a multi-agent generation, verification, and refinement pipeline.
Outcome: The largest medical reasoning dataset to date surpasses the prior best sub-10B models by 4.17% and even exceeds LLaMA3.1-70B on PubMedQA by 4.60%.
KRLS: Improving End-to-End Response Generation in Task Oriented Dialog with Reinforced Keywords Learning (2023.emnlp-main)

Copied to clipboard

Challenge: Task-oriented dialogs (TOD) require a model to generate a response that optimizes for task-related metrics.
Approach: They propose a faster generation procedure that samples from independent next-word distributions and introduce a fine-grained reward function to help the model focus on learning key information in a dialog.
Outcome: The proposed algorithm achieves state-of-the-art performance on an offline task with 15% training time reduction compared to a standard RL algorithm using auto-regressive generation.
Retaining Key Information under High Compression Ratios: Query-Guided Compressor for LLMs (2024.acl-long)

Copied to clipboard

Challenge: Existing methods to compress long contexts have degraded dramatically as compression ratios increase, sometimes even falling to the closed-book level.
Approach: They propose a query-guided compression method that preserves key information within the compressed context.
Outcome: The proposed method can consistently perform well even at high compression ratios, and offers significant benefits in terms of inference cost and throughput.
AsymKV: Enabling 1-Bit Quantization of KV Cache with Layer-Wise Asymmetric Quantization Configurations (2025.coling-main)

Copied to clipboard

Challenge: Large language models require substantial storage space to perform tasks such as text generation and video generation.
Approach: They propose to compress large language models using integer replacements for floating-point numbers, in a process known as Quantization.
Outcome: The proposed model allows for quantization of up to 75% decoder layers with 1 bit while maintaining performance levels comparable to those of the models with floating parameters.
AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)

Copied to clipboard

Challenge: Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning.
Approach: AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks.
Outcome: Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% .
Editing the Moving World: Model Editing for Video LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing models for knowledge editing focus on knowledge-level or static visual domains, overlooking dynamic semantics.
Approach: They propose a benchmark for modeling large language models using six representative models . they analyze the strengths and limitations of existing models and identify new directions .
Outcome: The proposed benchmark extends existing models from static modalities to dynamic video scenarios.
LEMON: Language-Based Environment Manipulation via Execution-Guided Pre-training (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to language-based environment manipulation are difficult to generalize across environments.
Approach: They propose a general framework for language-based environment manipulation tasks that can deal with various environments using the same generative language model.
Outcome: The proposed framework achieves new state-of-the-art results on four of the tasks and the execution-guided pre-training strategy brings remarkable improvements on all experimental tasks.
Database Search Results Disambiguation for Task-Oriented Dialog Systems (2022.naacl-main)

Copied to clipboard

Challenge: Task-oriented dialog systems can't handle multiplesearch results when querying a database due to the lack of such scenarios in existing datasets.
Approach: They propose a task that focuses on disambiguating database search results by synthetically generating turns through a pre-defined grammar and collecting human paraphrases for a subset.
Outcome: The proposed task improves performance on DSR-disambiguation even in the absence of in-domain data, suggesting it can be learned as a universal dialog skill.
INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agent (2025.acl-long)

Copied to clipboard

Challenge: Recent advances have underscored the potential of large language model (LLM)-based agents in financial decision-making.
Approach: They propose to evaluate LLM agents using 13 different LLMs as backbone models across various market environments and tasks.
Outcome: The proposed framework assesses the reasoning and decision-making capabilities of 13 different LLMs across various market environments and tasks.
Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies focus on pre-trained LLMs to better understand and improve their trustworthiness.
Approach: They apply linear probing to LLMs to explore five key dimensions of trustworthiness: reliability, privacy, toxicity, fairness, and robustness.
Outcome: The proposed model can distinguish concepts in each trustworthiness dimension, suggesting that it can be trained in early pre-training.
DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AI (2024.findings-eacl)

Copied to clipboard

Challenge: DialogStudio is the largest and most diverse collection of dialogue datasets . existing datasets lack diversity and comprehensiveness, authors say .
Approach: They introduce DialogStudio: the largest and most diverse collection of dialogue datasets . DialogStuio aggregates more than 80 diverse dialogue dataset .
Outcome: a new dataset is created to improve the quality and diversity of dialogue datasets . DialogStudio is the largest and most diverse collection of dialogue data .
DECOR: Improving Coherence in L2 English Writing with a Novel Benchmark for Incoherence Detection, Reasoning, and Rewriting (2024.emnlp-main)

Copied to clipboard

Challenge: Existing automated writing evaluation systems only detect incoherence in writing . a recent study has found that incorporating specific reasons for incohence improves the quality of rewrites .
Approach: They propose a benchmark that includes expert annotations for detecting incoherence in L2 English writing, identifying the underlying reasons, and rewriting the incoerent sentences.
Outcome: The proposed benchmark improves coherence in L2 English writing by fine-tuning models . the authors find that incorporating specific reasons improves quality of rewrites .
Internalizing Multi-Agent Reasoning for Accurate and Efficient LLM-based Recommendation (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are reshaping recommender systems by leveraging extensive world knowledge and semantic reasoning to interpret user intent.
Approach: They propose a single-agent Trajectory-Aligned Recommender to integrate reasoning capabilities into a model by a multi-agend teacher system.
Outcome: The proposed model surpasses its teacher by 8.7% to 39.5% while eliminating iterative latency.
Bring Invariant to Variant: A Contrastive Prompt-based Framework for Temporal Knowledge Graph Forecasting (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for temporal knowledge graph forecasting are insufficient structural contexts to learn effective representations.
Approach: They propose a Contrastive Prompt-based framework with Entity background information for TKG forecasting that brings time-invariant entity background information to time-variant structural information.
Outcome: The proposed framework is effective and stays competitive in inference with limited structural information.
Review-based Question Generation with Adaptive Instance Transfer and Augmentation (2020.acl-main)

Copied to clipboard

Challenge: Existing methods to generate questions for verbose reviews are inefficient for potential consumers . lack of training data hinders efficient review digestion, authors say .
Approach: They propose to generate questions that can be answered by corresponding review sentences . they propose an iterative learning framework with adaptive instance transfer and augmentation .
Outcome: The proposed model can generate questions that can be answered by review sentences . it is easier to find critical review parts that are important for potential consumers .
ReTraCk: A Flexible and Efficient Framework for Knowledge Base Question Answering (2021.acl-demo)

Copied to clipboard

Challenge: Existing neural semantic parsing methods for knowledge base question answering are lacking . a generic and extensible framework is lacking for KBQA.
Approach: They propose a neural semantic parsing framework for large scale knowledge base question answering . they propose 'retriever-transducer-checker' framework that provides a retriever and a transducer .
Outcome: The proposed framework is ranked at top1 overall performance on the GrailQA leaderboard and achieves competitive performance on typical WebQuestionsSP benchmark.
EvoR: Evolving Retrieval for Code Generation (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing pipelines for retrieval-augmented code generation (RACG) use static knowledge bases with a single source, limiting adaptation capabilities of Large Language Models (LLMs) Extensive experiments demonstrate that EVOR achieves two to four times of execution accuracy compared to other methods such as Reflexion.
Approach: They propose a retrieval-augmented code generation pipeline that employs the synchronous evolution of queries and diverse knowledge bases.
Outcome: The proposed pipeline achieves two to four times of execution accuracy compared to other methods.
How to Build User Simulators to Train RL-based Dialog Systems (D19-1)

Copied to clipboard

Challenge: RL-based dialog systems require interaction with the environment and obtaining real human users to interact with the system is time-consuming and labor-intensive.
Approach: They propose a method to standardize user simulator building to compare dialog system quality using the same set of user simulators.
Outcome: The proposed method can be used by the community to compare dialog system quality using the same set of user simulators fairly.
CGIM: A Cycle Guided Interactive Learning Model for Consistency Identification in Task-oriented Dialogue (2022.coling-1)

Copied to clipboard

Challenge: Consistency identification in task-oriented dialog usually consists of three subtasks . a proposed model for consistency identification in dialog is based on an explicit interaction paradigm .
Approach: They propose a cycle guided interactive learning model that makes information exchange explicit from all the three tasks.
Outcome: The proposed model achieves state-of-the-art performance pushing the overall score to 56.3% (5.0% point absolute improvement)
OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversation (2025.acl-long)

Copied to clipboard

Challenge: Full-duplex spoken dialogue systems allow simultaneous bidirectional communication . low latency and natural interactions in full-duplice systems remains a challenge .
Approach: They propose a multi-stage post-training scheme that adapts a text large language model into a speech-text dialogue LLM.
Outcome: The proposed model can model human conversation behaviors with low latency and natural interactions with low delay.
MAViS: A Multi-Agent Framework for Long-Sequence Video Storytelling (2026.eacl-long)

Copied to clipboard

Challenge: Experimental results show that MAViS achieves state-of-the-art performance in assistive capability, visual quality, and video expressiveness.
Approach: They propose an end-to-end multi-agent collaborative framework for long-sequence video storytelling that orchestrates specialized agents across multiple stages.
Outcome: The proposed framework achieves state-of-the-art performance in assistive capability, visual quality, and video expressiveness.
IAM: A Comprehensive and Large-Scale Dataset for Integrated Argument Mining Tasks (2022.acl-long)

Copied to clipboard

Challenge: Argument mining (AM) is a computational process that is used to analyze information in a debating system.
Approach: They propose to use a large dataset to automate the manual process of debating . they propose to integrate claim extraction, stance classification and evidence extraction tasks .
Outcome: The proposed tasks can extract claims, stances, evidence and more from a large dataset . the proposed tasks are highly efficient and can be applied to argument mining tasks .
Answering Product-related Questions with Heterogeneous Information (2020.aacl-main)

Copied to clipboard

Challenge: Existing product question answering methods only consider a single information source such as user reviews and/or require large amounts of labeled data.
Approach: They propose a framework to exploit heterogeneous information including natural language text and attribute-value pairs from two information sources of the concerned product, namely product details and user reviews.
Outcome: The proposed framework achieves superior performance over state-of-the-art models on a real-world dataset.
Memformer: A Memory-Augmented Transformer for Sequence Modeling (2022.findings-aacl)

Copied to clipboard

Challenge: Experimental results show that Memformer uses 8.1x less memory space and 3.2x faster on inference.
Approach: They propose an efficient neural network that utilizes an external dynamic memory to encode and retrieve past information.
Outcome: The proposed model achieves comparable performance against baselines with 8.1x less memory space and 3.2x faster on inference.
Bottom-Up Synthesis of Knowledge-Grounded Task-Oriented Dialogues with Iteratively Self-Refined Prompts (2025.naacl-short)

Copied to clipboard

Challenge: Training conversational question-answering systems requires in-domain data, which is often scarce in practice.
Approach: They propose a bottom-up approach where QA pairs are generated first and combined into a coherent dialogue.
Outcome: The proposed approach produces more realistic and higher-quality dialogues compared to top-down methods.
UNIKIE-BENCH: Benchmarking Large Multimodal Models for Key Information Extraction in Visual Documents (2026.acl-long)

Copied to clipboard

Challenge: Recent Large Multimodal Models (LMMs) have shown promising potential for performing end-to-end KIE directly from document images.
Approach: They propose a benchmark to evaluate the performance of Large Multimodal Models (LMMs) using a constrained-category KIE track and an open-categorical KIE Track.
Outcome: Experiments on 15 state-of-the-art LMMs show performance degradation under diverse schema definitions, long-tail key fields, and complex layouts, along with pronounced performance disparities across different document types and scenarios.
TimeR4 : Time-aware Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering (2024.emnlp-main)

Copied to clipboard

Challenge: Temporal Knowledge Graph Question Answering (TKGQA) aims to answer temporal questions using knowledge in Temporal knowledge graphs (TKTs).
Approach: They propose a Time-aware retrieve-rewrite-retrieve-rerank framework to integrate temporal knowledge from TKGs into Large Language Models (LLMs) to reduce temporal hallucination, they propose rewrite module to rew questions using background knowledge stored in TKG's, then implement a retrieve-rank module to retrieve semantically and temporally relevant facts from Tkgs and rerank them according to temporal constraints.
Outcome: The proposed approach achieves relative gains of 47.8% and 22.5% on two datasets, underscoring its effectiveness in boosting the temporal reasoning abilities of LLMs.
Self-Generated Critiques Boost Reward Modeling for Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Existing reward models produce scalar scores and struggle to incorporate critiques in a natural language format.
Approach: They propose a framework that predicts critiques and rewards using self-generated critiques without extra supervision.
Outcome: The proposed framework improves reward modeling accuracy by 3.7%-7.3% compared to standard reward models and LLM judges.
CasEE: A Joint Learning Framework with Cascade Decoding for Overlapping Event Extraction (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods assume that events appear in sentences without overlaps . overlapping event extraction is a challenging task in natural language understanding .
Approach: They propose a joint learning framework with cascade decoding for overlapping event extraction . they sequentially perform type detection, trigger extraction and argument extraction based on the specific former prediction .
Outcome: The proposed framework improves on a public event extraction benchmark . it sequentially performs type detection, trigger extraction and argument extraction .
Rethinking Cross-Subject Data Splitting for Brain-to-Text Decoding (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies have successfully decoded natural language from non-invasive brain signals . current dataset splitting methods suffer from data leakage problem .
Approach: They propose a right cross-subject data splitting criterion without data leakage for decoding fMRI and EEG signal to text.
Outcome: The proposed method overfits and overestimates brain-to-text decoding models.
Beyond Timestamps: Bridging Forward and Backward Reasoning in Temporal Numerical and Relational Understanding (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for Temporal Numerical and Relational reasoning rely on single-task evaluation paradigms.
Approach: They propose a benchmark to evaluate Temporal Numerical and Relational reasoning . they propose QA and verification, and a Consistency Rate to quantify robustness .
Outcome: The proposed framework evaluates both Temporal Numerical and Relational reasoning . it measures the alignment between QA and FV and the Consistency Rate measures robustness across these directions.
Chase: A Large-Scale and Pragmatic Chinese Dataset for Cross-Database Context-Dependent Text-to-SQL (2021.acl-long)

Copied to clipboard

Challenge: XDTS is a cross-database context-dependent text-to-sql problem with wide range of applications.
Approach: They present a large-scale Chinese dataset for cross-database context-dependent Text-to-SQL . they find that only 35% of questions are context-independent and 28% of SQL queries are easy .
Outcome: The proposed approach achieves an exact match accuracy of 40% over all questions and 16% over all question sequences.
Divide and Conquer: Legal Concept-guided Criminal Court View Generation (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for creating rationales for criminal cases do not pay enough attention to the important legal concepts.
Approach: They propose a legal concept-guided court view generation framework that generates rationales based on predicted legal concepts . they first divide the court view into sub-views, then employ a solver and verifier to generate and select rationale.
Outcome: The proposed model generates coherent and coherent court views on a real-world criminal case dataset.
Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study (2025.coling-main)

Copied to clipboard

Challenge: Existing benchmarks focused on simplified or isolated aspects of coding, ignoring the full spectrum of programming challenges.
Approach: They propose a case study that examines the performance of large language models across the entire software development lifecycle with four programming languages, multiple domains, and carefully designed and verified metrics for each task.
Outcome: The proposed model performs across the entire software development lifecycle, including design, environment setup, implementation, acceptance testing, and unit testing.
Ditto: A Simple and Efficient Approach to Improve Sentence Embeddings (2023.emnlp-main)

Copied to clipboard

Challenge: Prior studies diagnose the anisotropy problem in sentence embeddings from pre-trained language models without fine-tuning.
Approach: They propose an unsupervised method that weights words with model-based importance estimations and computes the weighted average of word representations from pre-trained models as sentence embeddings.
Outcome: Empirical evaluations show that the proposed method can alleviate the anisotropy problem and improve various pre-trained models on the STS benchmarks.
Stabilized In-Context Learning with Pre-trained Language Models for Few Shot Dialogue State Tracking (2023.findings-eacl)

Copied to clipboard

Challenge: Prompt-based methods with large pre-trained language models have shown impressive unaided performance across many NLP tasks.
Approach: They propose a meta-learning scheme to stabilize the ability of the model to perform well under various prompts and introduce a saliency model to limit dialogue text length.
Outcome: The proposed model improves on large pre-trained language models with labeled in-context exemplars and can be used to generate more exemplar queries.
Beyond Dialogue: A Profile-Dialogue Alignment Framework Towards General Role-Playing Language Model (2025.acl-long)

Copied to clipboard

Challenge: Existing role-playing training methods often lack profile-dialogue alignment at the sentence level.
Approach: They propose a framework that aligns dialogue with profile traits for each scenario, eliminating biases during training.
Outcome: The proposed model outperforms most proprietary role-playing models and is fully automated and low-cost.
SEER: Facilitating Structured Reasoning and Explanation via Reinforcement Learning (2024.acl-long)

Copied to clipboard

Challenge: Existing methods focus on single-step reasoning, ignoring logical dependencies between steps.
Approach: They propose a method that maximizes a structure-based return to facilitate structured reasoning and explanation.
Outcome: The proposed method outperforms state-of-the-art methods on EntailmentBank and STREET benchmarks.
COSIGN: Contextual Facts Guided Generation for Knowledge Graph Completion (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods for knowledge graph completion (KGC) are limited in generality and scalability due to poor contextual facts.
Approach: They propose a contextual facts collector and contextual facts organizer to enhance the inference ability of GM-based methods for various KGC tasks.
Outcome: The proposed model outperforms state-of-the-art methods in terms of performance.
Detecting AI-Generated Content on Social Media with Multi-modal Language Models (2026.acl-industry)

Copied to clipboard

Challenge: Existing methods for AI-generated content detection face poor generalization to newer models, reliance on single modalities, and lack of interpretable explanations.
Approach: They propose a model that curates diverse social media data and trains a vision-language model for detection and explanation.
Outcome: The proposed model achieves state-of-the-art detection performance on public benchmarks and observes positive downstream impacts on user engagement.
NCLS: Neural Cross-Lingual Summarization (D19-1)

Copied to clipboard

Challenge: Existing approaches to cross-lingual summarization divide the task into two steps: summarizing and translation.
Approach: They propose to integrate two related tasks into the training process of CLS under multi-task learning to improve cross-lingual summarization.
Outcome: The proposed framework improves on English-to-Chinese and Chinese-to English CLS human-corrected test sets.
SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches fail to fully capture all risks in tool utilization, resulting in financial loss or privacy leaking.
Approach: They propose a framework to assess the safety of LLM tool utilization in a prospective manner, covering malicious user instructions and diverse practical toolsets.
Outcome: The proposed framework significantly enhances LLMs’ self-awareness, enabling a more safer and trustworthy tool utilization.
Glancing Transformer for Non-Autoregressive Neural Machine Translation (2021.acl-long)

Copied to clipboard

Challenge: Existing non-autoregressive neural machine translation methods are either inferior to Transformer or require multiple decoding passes, leading to reduced speedup.
Approach: They propose a Glancing Language Model (GLM) for single-pass parallel generation models and Glancing Transformer (GLAT) with only single- pass decoding, GLAT is able to generate high-quality translation with 8-15 speedup.
Outcome: The proposed model outperforms all previous non-autoregressive methods on multiple language directions and is nearly comparable to Transformer.
CityNavAgent: Aerial Vision-and-Language Navigation with Hierarchical Semantic Planning and Global Memory (2025.acl-long)

Copied to clipboard

Challenge: Existing ground VLN agents struggle in aerial VLLN due to the lack of predefined navigation graphs and the exponentially expanding action space in long-horizon exploration.
Approach: They propose a large language model-empowered aerial VLN agent that decomposes the long-horizon task into sub-goals with different semantic levels.
Outcome: The proposed method achieves state-of-the-art performance with significant improvement in continuous city environments.
latent-GLAT: Glancing at Latent Variables for Parallel Text Generation (2022.acl-long)

Copied to clipboard

Challenge: Recent advances in text generation have limited applications due to multimodality problem.
Approach: They propose a method which uses latent variables to capture word categorical information and invoke an advanced curriculum learning technique to overcome multi-modality problem.
Outcome: The proposed method outperforms strong baselines without an autoregressive model, which further broadens the application scenarios of the parallel decoding paradigm.
Sparse-to-Dense: A Free Lunch for Lossless Acceleration of Video Understanding in LLMs (2025.acl-short)

Copied to clipboard

Challenge: Recent advances in Video Large Language Models (Video-LLMs) have achieved exceptional performance on tasks like video question answering and captioning.
Approach: They propose a decoding strategy that leverages sparse top-K attention and dense full attention to accelerate Video-LLMs without loss.
Outcome: The proposed approach achieves a 1.94 walltime speedup in video processing.
Measuring Human Contribution in AI-Assisted Content Generation (2026.acl-long)

Copied to clipboard

Challenge: generative AI has created a new way to generate content with humans . varying degrees of human contribution in content generation poses significant challenges for the delineation of originality .
Approach: They propose a framework to measure human contribution in AI-assisted content generation by calculating mutual information between human input and AI-aided output relative to self-information of AI-assist output.
Outcome: The proposed measure discriminates between varying degrees of human contribution across multiple creative domains and is validated in real-world applications.
Capturing Conversational Interaction for Question Answering via Global History Reasoning (2022.findings-naacl)

Copied to clipboard

Challenge: Existing studies have studied history-dependent reasoning for question answering . utilizing global conversation history for enhancement is gaining interest .
Approach: They propose to establish long-distance dependency among global utterances in multi-turn conversation.
Outcome: The proposed method improves on QuAC by 1%, yielding the F1 score of 73.7%.
SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing (2022.acl-long)

Copied to clipboard

Challenge: Existing work shows that pre-trained models can improve in various natural language processing tasks.
Approach: They propose a unified-modal encoder-decoder framework that pre-trains speech-text representations using large-scale unlabeled speech and text data.
Outcome: The proposed framework is superior to existing models on speech-to-text processing tasks.
Responding E-commerce Product Questions via Exploiting QA Collections and Reviews (C18-1)

Copied to clipboard

Challenge: Existing QA and review collections can be used to provide instant responses to product questions . a proposed framework can be applied to a real-world commercial E-commerce site .
Approach: They propose a framework for automatically responding product questions in E-commerce sites . existing QA pairs are exploited as distant supervision for learning to rank responses .
Outcome: The proposed framework can return a ranked list of snippets serving as the automated response for a given question.
The Law of Knowledge Overshadowing: Towards Understanding, Predicting and Preventing LLM Hallucination (2025.findings-acl)

Copied to clipboard

Challenge: Hallucination is a persistent challenge in large language models where even with rigorous quality control, models often generate distorted facts.
Approach: They propose a new framework to quantify factual hallucinations by modeling knowledge overshadowing.
Outcome: The proposed framework improves model factuality on Overshadow (27.9%), MemoTrap (13.1%) and NQ-Swap (18.3%).
From “Thinking” to “Justifying”: Aligning High-Stakes Explainability with Professional Communication Standards (2026.findings-acl)

Copied to clipboard

Challenge: Existing explanations for large language models (LLMs) need to be able to verify outputs.
Approach: They propose a method that constrains output communication to present a conclusion before its structured justification.
Outcome: The proposed approach achieves 83.9% accuracy and correctness over CoT.
Harnessing the Power of Large Language Model for Uncertainty Aware Graph Processing (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for graph processing rely on assumptions about data relations that are inadequate when handling large and complex graph data.
Approach: They propose a large language model enhanced by an uncertainty-aware module to provide a confidence score on the generated graph data.
Outcome: The proposed approach surpasses state-of-the-art algorithms by a substantial margin on ten datasets.
AdvancedIF: Rubric-Based Benchmarking and Reinforcement Learning for Advancing LLM Instruction Following (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have shown impressive performance on a range of tasks, yet advanced instruction following (IF) remains a significant challenge.
Approach: They propose a benchmark that features over 1,600 prompts and expert-curated rubrics that assess LLMs’ ability to follow complex, multi-turn, and system-level instructions.
Outcome: The proposed framework improves instruction-following abilities of large language models, achieving a 6.7% gain on AdvancedIF and strong results on public benchmarks.
Type-Aware Decomposed Framework for Few-Shot Named Entity Recognition (2023.findings-emnlp)

Copied to clipboard

Challenge: Named entity recognition (NER) methods can detect entity spans and classify them into pre-defined categories.
Approach: They propose a type-aware decomposed framework to filter out false spans . they propose 'type-against-type' learning strategy to construct more accurate prototypes based on type names as references.
Outcome: The proposed framework yields state-of-the-art on several benchmarks.
APE: Argument Pair Extraction from Peer Review and Rebuttal via Multi-task Learning (2020.emnlp-main)

Copied to clipboard

Challenge: Argument mining is an important research field that attracts growing attention in recent years.
Approach: They propose a new task to extract argument pairs from peer review and rebuttal . they use an open review platform to analyze the contents, structure and connections .
Outcome: The proposed task is based on a dataset of 4,764 fully annotated review-rebuttal passage pairs . it is able to detect argumentative propositions and extract argument pairs from the corpus .
Enhancing Open-Domain Task-Solving Capability of LLMs via Autonomous Tool Integration from GitHub (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches lack flexibility to address diverse and ever-evolving user queries in open domains.
Approach: They propose to evaluate LLMs on open-domain knowledge that requires tools to solve diverse and ever-evolving user queries.
Outcome: The proposed system outperforms baselines in the open domain task-solving benchmark.
VarBench: Robust Language Model Benchmarking Through Dynamic Variable Perturbation (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent benchmarks release only training and validation sets, keeping the test set labels closed-source.
Approach: They propose to extract variables from each test case and define a value range for each variable.
Outcome: The proposed method improves the accuracy of the evaluations on four datasets covering mathematical generation and multiple-choice tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations