Papers by Zhen Chen

81 papers
Towards Multi-label Unknown Intent Detection (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for multi-class unknown intent detection assume that each utterance has only one intent, which is not true because utterrances often contain multiple intents.
Approach: They propose a task to detect whether an utterance contains the unknown intent by recognizing whether all intents contained in the utterant are known.
Outcome: The proposed method significantly reduces the FPR95 on the MultiWOZ 2.3 dataset by 12.25% compared to the best baseline.
Unsupervised Neural Machine Translation with Weight Sharing (P18-1)

Copied to clipboard

Challenge: Unsupervised neural machine translation (NMT) is a new approach for machine translation . the model uses only one shared encoder to map pairs of sentences from different languages to a shared-latent space .
Approach: They propose an unsupervised approach which trains the model without labeling data . they propose two independent encoders but share some partial weights to extract high-level representations of input sentences.
Outcome: The proposed approach achieves significant improvements on English-German, English-French and Chinese-to-English translation tasks.
OceanGPT: A Large Language Model for Ocean Science Tasks (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have transformed the paradigm in ocean science.
Approach: They propose a framework to automatically obtain large volume of ocean domain instruction data, which generates instructions based on multi-agent collaboration.
Outcome: The proposed framework shows a higher level of knowledge expertise for ocean science tasks and gains preliminary embodied intelligence capabilities in ocean technology.
CRITICTOOL: Evaluating Self-Critique Capabilities of Large Language Models in Tool-Calling Error Scenarios (2025.emnlp-main)

Copied to clipboard

Challenge: a number of tools are used to perform complex tasks, but the tool utilization process can cause errors.
Approach: They propose a critique evaluation benchmark for tool learning that analyzes function-calling errors on tool evaluation benchmarks.
Outcome: The proposed critique evaluation benchmark holds diverse tool-use errors with varying complexities, which better reflects real-world scenarios.
CroAno : A Crowd Annotation Platform for Improving Label Consistency of Chinese NER Dataset (2021.emnlp-demo)

Copied to clipboard

Challenge: Existing crowd annotation tools for named entity recognition (NER) focus on efficiency and don't consider consistency of datasets.
Approach: They propose a crowd annotation platform for Chinese named entity recognition (NER) CroAno provides a systematic solution for improving label consistency of Chinese NER datasets.
Outcome: The proposed platform improves label consistency of Chinese NER datasets.
Graph Enhanced Contrastive Learning for Radiology Findings Summarization (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for automating impression generation have limited the relationship between extra knowledge and the original findings.
Approach: They propose a framework for automating impression generation that exploits extra knowledge and original findings . they propose combining key words and their relations to extract critical information .
Outcome: The proposed framework exploits extra knowledge and the original findings in an integrated way . the state-of-the-art results on two datasets confirm the effectiveness of the proposed method .
Bit-Flip Error Resilience in LLMs: A Comprehensive Analysis and Defense Framework (2025.emnlp-main)

Copied to clipboard

Challenge: Bit-flip errors (BFEs) are hardware faults where individual bits in memory or processing units are unintentionally flipped.
Approach: They propose a novel defense strategy to mitigate bit-flip errors (BFEs) they propose bfe protection and a self-correction mechanism to minimize performance degradation .
Outcome: The proposed defense strategy minimizes performance degradation while significantly improving robustness against BFEs.
Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language Translation (2024.lrec-main)

Copied to clipboard

Challenge: Previous Sign Language Translation methods have relied on gloss annotations to improve performance, but labeling high-quality glosses is labor-intensive and inefficient.
Approach: They propose to integrate Large Language Model (LLM) into SLT by factorizing learning into two stages to improve the learning curve.
Outcome: The proposed approach improves on three SLT datasets conducted under the gloss-free setting.
SCALE: Towards Collaborative Content Analysis in Social Science with Large Language Model Agents and Human Intervention (2025.acl-long)

Copied to clipboard

Challenge: Content analysis is labor-intensive and time-consuming process that requires multiple rounds of manual annotation, domain expert discussion, and rule-based refinement.
Approach: They propose a multi-agent framework that effectively Simulates Content Analysis via Large language model (LLM) ag Ents.
Outcome: The proposed framework achieves human-approximated performance across various content analysis tasks.
IntrAgent: An LLM Agent for Content-Grounded Information Retrieval through Literature Review (2026.acl-long)

Copied to clipboard

Challenge: Scientific research relies on accurate information retrieval from literature to support analytical decisions.
Approach: They propose a task that automates fine-grained information retrieval *faithfully* grounded in the provided content in response to research-driven queries.
Outcome: The proposed agent achieves 13.2% higher cross-domain accuracy than state-of-the-art RAG and research-agent baselines across seven backbone LLMs.
DALK: Dynamic Co-Augmentation of LLMs and KG to answer Alzheimer’s Disease Questions with Scientific Literature (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in large language models have achieved promising performances across various applications, but the challenge of integrating long-tail knowledge continues to impede the seamless adoption of LLMs in specialized domains.
Approach: They propose a dynamic co-augmentation framework for the refinement of large language models and knowledge graphs in the context of Alzheimer's Disease.
Outcome: The proposed framework can be used to study Alzheimer's Disease (AD) using LLMs and KGs.
ExploraCoder: Advancing Code Generation for Multiple Unseen APIs via Planning and Chained Exploration (2025.acl-long)

Copied to clipboard

Challenge: Large language models face intrinsic limitations in coding with unseen APIs in training corpora.
Approach: They propose a training-free framework that empowers LLMs to invoke multiple unseen APIs in code solution by planning a complex problem into several API invocation subtasks and experimenting with correct API usage at intermediate steps.
Outcome: The proposed framework significantly improves performance for models lacking prior API knowledge, achieving 11.99% over retrieval-based approaches and 17.28% over pretraining-based methods in pass@10.
PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown remarkable progress in dialogue and reasoning, but they struggle to solve strictly constrained dialogue tasks.
Approach: They construct a dataset that contains 12,705 high-quality Chinese dialogue instructions from 440 flowcharts containing 5,055 process nodes.
Outcome: The proposed model outperforms GPT-4o models on backward transitions and outperformed GPT-42 models on the same dataset.
RoBSA: RoPE-based Blockwise Sparse Multi-head Latent Attention (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have advanced in recent years, scaling up in both parameter count and context length.
Approach: They propose a method to compute attention over a subset of context tokens and to implement token selection in a blockwise manner.
Outcome: The proposed method reduces end-to-end inference latency by up to 2.55x with minimal accuracy loss compared to full attention in long-context scenarios for very large models.
Forget the Unneeded: Backdooring Large Language Models via Contrastive-enhanced Machine Unlearning (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for prompt tuning for Large Language Models find backdoor attacks to be significant in data-rich scenarios.
Approach: They propose a backdoor attacks through contrastive-enhanced machine unlearning in data-limited scenarios . they use a machine un learning method to capture precise backdoor patterns .
Outcome: The proposed method captures precise backdoor patterns without association between triggers and backdoors, reducing side effects.
Learning from Adjective-Noun Pairs: A Knowledge-enhanced Framework for Target-Oriented Multimodal Sentiment Classification (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to determine sentiment polarity of opinion target are inconsistent and lack visual attention.
Approach: They propose a framework which can exploit adjective-noun pairs extracted from images to improve visual attention and sentiment prediction capability of the TMSC task.
Outcome: The proposed framework outperforms state-of-the-art on two public datasets.
Sparse Black-Box Multimodal Attack for Vision-Language Adversary Generation (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing adversarial attacks using imperceptible perturbations are challenging to simulate . e-commerce product restrictions and hate speech monitoring are examples of such attacks .
Approach: They propose a black-box adversarial attack that leverages sparse perturbations to simulate adversarials exhibited by illegal merchants in the black- box scenario.
Outcome: The proposed method outperforms existing attacks and unimodal attacks by treating images and text in discrete space and outperforming existing models.
Metacognitive Self-Correction for Multi-Agent System via Prototype-Guided Next-Execution Reconstruction (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Model based multi-agent systems (MAS) excel at collaborative problem solving but remain brittle to cascading errors.
Approach: They propose a metacognitive framework that enables step-level error detection and self-correction in Large Language Model based multi-agent systems (MAS) .
Outcome: The proposed framework outperforms baselines on the Who When benchmark and delivers consistent gains on AgentErrorBench.
Beyond Logits: Aligning Feature Dynamics for Effective Knowledge Distillation (2025.acl-long)

Copied to clipboard

Challenge: Knowledge distillation (KD) compresses large language models into lightweight versions called student models.
Approach: They propose to align the entire feature dynamics between teacher and student models by using two additional loss terms to achieve this.
Outcome: The proposed method matches the entire feature dynamics between teacher and student models rather than just the final states.
AdamMeme: Adaptively Probe the Reasoning Capacity of Multimodal Large Language Models on Harmfulness (2025.acl-long)

Copied to clipboard

Challenge: Existing models that assess mLLMs on harmful meme understanding are inaccurate and lack accuracy.
Approach: They propose a framework that adaptively probes the reasoning capabilities of mLLMs . their framework systematically reveals the varying performance of different target mllms a .
Outcome: The proposed framework systematically reveals the performance of different target mLLMs.
IF-GEO: Conflict-Aware Instruction Fusion for Multi-Query Generative Engine Optimization (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods to improve content visibility are static heuristic rules or optimize for heterogeneous queries.
Approach: They propose a "diverge-then-converge" framework that extracts optimization preferences from latent queries and synthesizes a global revision blueprint for guided editing.
Outcome: The proposed framework achieves substantial performance gains while maintaining robustness across diverse retrieval scenarios.
In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to long-term dialogue memory management fail to capture the natural semantic structure of conversations, leading to fragmented and incomplete representations.
Approach: They propose a mechanism that integrates forward- and backward-looking reflections into a personalized memory bank for effective future retrieval.
Outcome: The proposed mechanism outperforms state-of-the-art benchmarks on a long-term dialogue memory model.
Improving Continual Relation Extraction through Prototypical Contrastive Learning (2022.coling-1)

Copied to clipboard

Challenge: Continual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks.
Approach: They propose a Continual Relation Extraction framework with Contrastive Learning which is built with a classification network and a prototypical contrastive network to achieve incremental-class learning of CRE.
Outcome: The proposed framework outperforms the state-of-the-art methods on two public datasets and proves its effectiveness on improving performance.
EFUF: Efficient Fine-Grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to eliminate hallucinations require expensive human annotation . hallucination in multimodal large language models poses unique challenges for current research .
Approach: They propose a fine-grained unlearning framework that performs gradient ascent to eliminate hallucinations without paired data.
Outcome: The proposed method reduces hallucinations while preserving quality with modest computational overhead.
Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Chain-of-Thought (CoT) reasoning has improved the performance of large language models (LLMs) however, the detailed reasoning process in CoT often incurs long generation times and high computational costs due to the inclusion of unnecessary steps.
Approach: They propose a method to identify critical reasoning steps using perplexity as a measure of their importance.
Outcome: The proposed method achieves a better balance between reasoning accuracy and efficiency of CoT.
Less is More: Improving LLM Reasoning with Minimal Test-Time Intervention (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have focused on test-time scaling to improve reasoning quality but at the cost of efficiency.
Approach: They propose a training-free framework that enhances reasoning accuracy and stability with minimal overhead.
Outcome: The proposed framework yields consistent gains across general, coding, and STEM tasks while remaining highly efficient.
KBM: Delineating Knowledge Boundary for Adaptive Retrieval in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) is employed to tackle these challenges . a Knowledge Boundary Model (KBM) is used to express the known/unknown of a given question .
Approach: They propose a Knowledge Boundary Model to express the known/unknown of a given question . they find that not all questions need to trigger RAG to improve performance .
Outcome: The proposed model reduces time and computational costs by retrieving parts of unknown knowledge . the proposed model can express the known/unknown of a given question and determine whether a RAG needs to be triggered .
LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning (2024.findings-acl)

Copied to clipboard

Challenge: Low-rank adaption (LoRA) is a low-level pruning method that can be expensive and slow to deploy.
Approach: They propose a low-rank adaption pruning framework that provides an accurate structured pruned model in a memory-efficient manner.
Outcome: The proposed pruning framework reduces perplexity and memory usage by 52.6% on LLaMA and T5 models while reducing memory usage.
ProLongVid: A Simple but Strong Baseline for Long-context Video Instruction Tuning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to adapt image-focused models for video understanding have not been successful in analyzing long video sequences.
Approach: They propose a video instruction dataset that outperforms existing video instruction data for fine-tuning MLLMs by incrementally increasing input context length.
Outcome: The proposed model outperforms existing models on video benchmarks and outperformed proprietary models on VideoMME even with a compact 7B model.
EQA-RM: A Generative Embodied Reward Model with Test-time Scaling (2025.emnlp-main)

Copied to clipboard

Challenge: Existing generic Reward Models are ill-equipped for dynamic and interactive domains.
Approach: They propose a novel generative multimodal reward model specifically architected for EQA that provides interpretable, structured reward feedback.
Outcome: The proposed model outperforms proprietary benchmarks, including Gemini-2.5-Flash, GPT-4o, Claude-3.5-Haiku, and open-sourced state-of-the-art models such as RoVRM and VisualPRM.
Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment (2022.emnlp-main)

Copied to clipboard

Challenge: Existing word alignment models capture few interactions between input sentence pairs, which severely degrades the word alignment quality.
Approach: They propose to model deep interactions between input and target sentences using a two-stage training framework to train the model.
Outcome: The proposed model achieves the state-of-the-art (SOTA) performance on four out of five language pairs.
A New Pipeline for Knowledge Graph Reasoning Enhanced by Large Language Models Without Fine-Tuning (2024.emnlp-main)

Copied to clipboard

Challenge: Conventional knowledge Graph Reasoning models learn the embeddings of KG components over the structure of a KG.
Approach: They propose a pipeline to integrate knowledge from LLMs into KGs without fine-tuning . they propose knowledge alignment, KG reasoning and entity reranking to enhance conventional models .
Outcome: The proposed pipeline can enhance the performance of conventional KGR models in incomplete and general situations.
From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan (2026.acl-long)

Copied to clipboard

Challenge: Large language models have achieved remarkable success across a wide range of tasks, yet their performance remains heavily biased toward high-resource languages.
Approach: They propose a pipeline for advancing Tibetan language modeling through multilingual continual pre-training with Tibetan, Chinese, and English.
Outcome: The proposed model outperforms open-source and Tibetan-focused models on diverse tasks.
Beyond Accuracy: Unveiling Inefficiency Patterns in Tool-Integrated Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Tool-Integrated Reasoning (TIR) is a tool that can be used to solve complex tasks.
Approach: They propose a hardware-aware TIR-efficiency metric that unifies internal reasoning and external tool-use costs while explicitly accounting for non-reusable KV-Cache and long-tool-response scenarios.
Outcome: The proposed metric explains wall-clock latency significantly better than token-count metric in a simulated high-concurrency industrial setting.
Task-Aware Resolution Optimization for Visual Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing visual large language models pre-assume a fixed resolution for downstream tasks, leading to sub-optimal performance.
Approach: They propose a formula to determine the optimal resolution for a given vision-language task . they then propose 'parameter-efficient' fine-tuning technique to extend the visual input resolution .
Outcome: The proposed method is based on rigorous experiments on vision-language tasks.
Contextualization Distillation from Large Language Model for Knowledge Graph Completion (2024.findings-eacl)

Copied to clipboard

Challenge: Existing knowledge graph completion models lack textual information, which limits their performance . a plug-in-and-play approach is needed to train small models in descriptive context .
Approach: They propose a plug-in-and-play approach to knowledge graph completion that prompts LLMs to generate descriptive context.
Outcome: The proposed method improves performance on Wikipedia articles and synset definitions.
Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perception (2026.acl-long)

Copied to clipboard

Challenge: naively fine-tuning an omni-model on speech recognition and external sound understanding tasks often degrades performance . Xie and Wu's framework, Speech-Hands, recasts the problem as an explicit self-reflection decision.
Approach: They propose a voice-agentic framework that learns one critical omni-understanding skill: trusting itself versus external audio perception.
Outcome: The proposed framework outperforms baseline models on the OpenASR leaderboard by 12.1% WER and high F1 on audio QA decisions.
SpeechIQ: Speech-Agentic Intelligence Quotient Across Cognitive Levels in Voice Understanding by Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: SIQ quantifies voice understanding abilities and provides unified comparisons between cascaded methods and end-to-end models.
Approach: They propose a human cognition-inspired evaluation pipeline for voice understanding large language models (LLM_Voice) that quantifies voice understanding abilities and provides unified comparisons between cascaded methods and end-to-end models.
Outcome: The proposed framework quantifies voice understanding abilities and provides unified comparisons between cascaded methods and end-to-end models, identifies annotation errors in existing benchmarks, and detects hallucinations in LLM_Voice.
Generating Authentic Adversarial Examples beyond Meaning-preserving with Doubly Round-trip Translation (2022.naacl-main)

Copied to clipboard

Challenge: Existing approaches to generate adversarial examples for NMT use the meaning-preserving restriction.
Approach: They propose a new definition for adversarial examples based on the Doubly Round-Trip Translation (DRTT) they introduce masked language models to construct bilingual adversarials based upon DRTT .
Outcome: The proposed approach significantly improves the robustness of the NMT model on clean and noisy test sets.
Learning from Diverse Reasoning Paths with Routing and Collaboration (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies suggest that the reasoning abilities of large language models (LLMs) grows with model size and pre-training data.
Approach: They propose to combine quality filtering, conditional routing, and cooperative peer teaching to transfer knowledge from powerful teacher models to compact and transparent students.
Outcome: Experiments show that QR-Distill is superior to traditional methods.
DyERNIE: Dynamic Evolution of Riemannian Manifold Embeddings for Temporal Knowledge Graph Completion (2020.emnlp-main)

Copied to clipboard

Challenge: Existing embedding approaches for temporal knowledge graphs typically learn entity representations and their dynamic evolution in the Euclidean space.
Approach: They propose a non-Euclidean embedding approach that learns evolving entity representations in a product of Riemannian manifolds.
Outcome: The proposed model improves on three real-world datasets showing that the embeddings on Riemannian manifolds can capture the evolution of temporal KGs.
From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) inspire the "LLM-as-a-judge" paradigm . traditional methods of assessment and evaluation fail in dynamic and open-ended scenarios .
Approach: They propose a paradigm where LLMs are leveraged to perform scoring, ranking, or selection for machine learning evaluation scenarios.
Outcome: The proposed model-based judgment and evaluation paradigms are based on large language models and are compared to the current model-driven evaluation paradigm.
LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing (2026.findings-acl)

Copied to clipboard

Challenge: Large language model (LLM) routing assigns each query to the best suitable model from an ensemble.
Approach: They introduce a large-scale benchmark and unified framework for LLM routing . they find that many routing methods exhibit similar performance under unified evaluation .
Outcome: The proposed benchmark provides comprehensive metrics for both performance-oriented and performance-cost trade-off routing.
Jointly Identifying Rhetoric and Implicit Emotions via Multi-Task Learning (2021.findings-acl)

Copied to clipboard

Challenge: Experimental results validate the benefit of the proposed model over the state-of-the-art baselines for rhetoric and emotion identification tasks.
Approach: They propose a multi-task learning framework that can encode categorical correlation between tasks to improve rhetoric and emotion identification problem.
Outcome: The proposed model can encode the categorical correlation between tasks to improve rhetoric and emotion identification problem.
Query-Efficient Textual Adversarial Example Generation for Black-Box Attacks (2024.naacl-long)

Copied to clipboard

Challenge: Existing black-box attacks require thousands of queries on the target model, making them expensive in real-world applications.
Approach: They propose a new approach that guides word substitutions using prior knowledge from the training set to improve the attack efficiency.
Outcome: The proposed approach reduces query-free attack and guided search attacks by a factor of 10 500 . it improves transferability and generalization by the ensemble of the ABPens in NLP .
Measuring Your ASTE Models in The Wild: A Diversified Multi-domain Dataset For Aspect Sentiment Triplet Extraction (2023.findings-acl)

Copied to clipboard

Challenge: Existing ASTE datasets are limited in their ability to represent real-world scenarios, hindering progress in this area.
Approach: They propose a new ASTE dataset that is manually annotated to better fit real-world scenarios by providing more diverse and realistic reviews.
Outcome: The proposed dataset is manually annotated to better fit real-world scenarios.
RECAL: Sample-Relation Guided Confidence Calibration over Tabular Data (2023.findings-emnlp)

Copied to clipboard

Challenge: Various machine learning methods for tabular data lack accurate confidence estimation, which is needed for high-risk sensitive applications such as credit modeling and financial fraud detection.
Approach: They propose a general post-training confidence calibration framework to calibrate the confidence of current machine learning models by employing graph neural networks to model the relationships between different samples.
Outcome: The proposed framework improves the confidence estimation on tabular datasets by using graph neural networks to model the relationships between different samples.
Visual Question Decomposition on Multimodal Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for question decomposition focus on unimodal language models, but question decomposing capability of Multimodal Large Language Models (MLLMs) has yet to be explored.
Approach: They propose a finetuning dataset and a training objective for selective decomposition to enhance the model's question decomposing capability.
Outcome: The proposed dataset shows that existing models struggle to produce high-quality sub-questions.
Glue pizza and eat rocks - Exploiting Vulnerabilities in Retrieval-Augmented Generative Models (2024.emnlp-main)

Copied to clipboard

Challenge: Retrieval-Augmented Generative (RAG) models enhance Large Language Models (LLMs) by integrating external knowledge bases.
Approach: They propose to exploit openness of RAG models by injecting deceptive content into the retrieval database, intentionally changing the model’s behavior.
Outcome: The proposed model can be exploited through crafted content uploads with access to the retriever.
Detecting Knowledge Boundary of Vision Large Language Models by Sampling-Based Inference (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods to detect the knowledge boundary of Vision Large Language Models (VLLMs) are expensive and require indiscriminate retrieval to address questions that require real-time information or are knowledge-intensive.
Approach: They propose a method that fine-tunes a VLLM on an automatically constructed dataset for boundary identification.
Outcome: The proposed method reduces indiscriminate retrieval while maintaining or improving the performance of a VLLM on an automatically constructed dataset.
Temporal Extrapolation and Knowledge Transfer for Lifelong Temporal Knowledge Graph Reasoning (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for lifelong TKG reasoning only address part of the challenges.
Approach: They propose a temporal-path-based reinforcement learning framework for lifelong TKG reasoning . they add temporal displacement into the action space of RL to extrapolate for the future .
Outcome: The proposed model outperforms existing models against well-adapted baselines on three lifelong TKG reasoning benchmarks.
SANCL: Multimodal Review Helpfulness Prediction with Selective Attention and Natural Contrastive Learning (2022.coling-1)

Copied to clipboard

Challenge: e-commerce has become a research hotspot for review helpfulness prediction . a new approach to help predict helpfulness of multimodal product reviews is proposed .
Approach: They propose a machine learning task to identify helpfulness of multimodal product reviews . they use a probe-based strategy to enforce high attention weights on regions of greater significance .
Outcome: The proposed model achieves state-of-the-art performance with lower memory consumption on two benchmark datasets with three categories.
Agents Under Siege: Breaking Pragmatic Multi-Agent LLM Systems with Optimized Prompt Attacks (2025.acl-long)

Copied to clipboard

Challenge: Multi-agent LLMs are prone to adversarial attacks because of constraints such as limited token bandwidth and latency between message delivery.
Approach: They propose a permutation-invariant adversarial attack that optimizes prompt distribution across latency and bandwidth constraints to bypass distributed safety mechanisms within the system.
Outcome: The proposed method outperforms conventional attacks by up to 7 on multiple models.
Improving Neural Machine Translation with Conditional Sequence Generative Adversarial Nets (N18-1)

Copied to clipboard

Challenge: Experimental results show that the proposed model consistently outperforms the traditional RNNSearch and the newly emerged state-of-the-art Transformer on English-German and Chinese-English translation tasks.
Approach: They propose an approach for applying GANs to NMT by building a conditional sequence generative adversarial net with two adversarials.
Outcome: The proposed model outperforms the existing RNNSearch and Transformer on English-German and Chinese-English translation tasks.
FCGCL: Fine- and Coarse-Granularity Contrastive Learning for Speech Translation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to perform implicit knowledge transfer from machine translation to ST model are difficult because of the task complexity and data scarcity.
Approach: They recommend a method which conducts explicit knowledge transfer from MT to ST model by fine and coarse granularity contrastive learning.
Outcome: The proposed method improves the performance of the end-to-end speech translation model on all 8 languages.
UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervision (2026.acl-long)

Copied to clipboard

Challenge: Unified Multimodal Models have achieved remarkable success in cross-modal comprehension, but a gap persists in their ability to translate internal knowledge into faithful and controllable synthesis.
Approach: They propose a self-improvement framework that partitions a single UMM into three collaborative roles: Proposer, Solver, and Judge.
Outcome: The proposed framework improves on TIIF, DPG, CompBench and UniCycle benchmarks.
Domain-Specific Data Generation Framework for RAG Adaptation (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-Augmented Generation (RAG) combines the language understanding and reasoning capabilities of large language models (LLMs) with external retrieval to produce domain-grounded responses.
Approach: They propose a scalable and modular data-centric framework for generating domain-grounded question–answer–context triples tailored to diverse RAG adaptation strategies.
Outcome: The proposed framework generates domain-grounded question–answer–context triples for multiple RAG adaptation strategies.
PyramidCodec: Hierarchical Codec for Long-form Music Generation in Audio Domain (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to generate long music are inefficient and lack of structured representation.
Approach: They propose a hierarchical discrete representation of audio for long audio-domain music generation using residual vector quantization on different levels of features.
Outcome: The proposed method achieves competitive performance in terms of reconstruction quality and token per second (TPS) the proposed method facilitates training a language model that can generate well-structured long-form music for up to 3 minutes.
LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in language models have demonstrated strong capabilities in semantic understanding and contextual modeling.
Approach: They propose a LLaMA-based language model that incentivizes generalization capabilities for speech enhancement.
Outcome: The proposed language model outperforms prior task-specific discriminative and generative models in acoustic enhancement tasks.
EasyInstruct: An Easy-to-use Instruction Processing Framework for Large Language Models (2024.acl-demos)

Copied to clipboard

Challenge: Large Language Models (LLMs) have improved performance across tasks and domains . instruction tuning is a crucial technique to enhance the capabilities of LLMs - but there is no standard open-source instruction processing framework available for the community .
Approach: They propose an open-source instruction tuning framework for Large Language Models that modularizes instruction generation, selection, prompting and their combination and interaction.
Outcome: The proposed framework is open-source and available on Github.
SQL-Trail: Multi-Turn Reinforcement Learning with Interleaved Feedback for Text-to-SQL (2026.acl-long)

Copied to clipboard

Challenge: Recent large language models (LLMs) have significantly improved Text-to-SQL generation, but a gap remains between AI systems and human experts on challenging benchmarks such as BIRD-Sql.
Approach: They propose a multi-turn reinforcement learning agentic framework for Text-to-SQL that uses execution feedback to iteratively refine its predictions.
Outcome: The proposed framework outperforms proprietary systems on 7B and 14B models by **5% on average, underscoring the effectiveness of interactive, agentic workflows for robust Text-to-SQL generation.
CoPA: Benchmarking Personalized Question Answering with Data-Informed Cognitive Factors (2026.findings-acl)

Copied to clipboard

Challenge: Existing LLMs rely on surface-level similarity or manual heuristics to evaluate personalization . Existing evaluation protocols for personalization are lacking sufficient data-driven validation.
Approach: They propose a benchmark to assess personalization by mining CIPDs to quantify individual preferences.
Outcome: The proposed benchmark provides a more comprehensive and discriminative standard than generic metrics.
Semi-Supervised Disfluency Detection (C18-1)

Copied to clipboard

Challenge: Detecting disfluency can be difficult because of the flexible nature of reparandum structure and the lack of a nested structure.
Approach: They propose a semi-supervised approach which extracts hidden features from self-attention without any Recurrent Neural Network (RNN) or Convolutional Neural Net (CNN).
Outcome: The proposed approach improves over baselines by using unlabelled data . identifying and removing non-fluent factors would help to improve spontaneous speech quality .
AnyMAC: Cascading Flexible Multi-Agent Collaboration via Next-Agent Prediction (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for multi-agent collaboration rely on static or graph-based topologies lacking flexibility and adaptability.
Approach: They propose a new framework that rethinks multi-agent coordination through a sequential structure rather than a graph structure.
Outcome: The proposed method achieves superior performance while significantly reducing communication overhead.
D4: a Chinese Dialogue Dataset for Depression-Diagnosis-Oriented Chat (2022.emnlp-main)

Copied to clipboard

Challenge: Existing human-machine dialogue systems are not able to provide diagnostic information for depression diagnosis due to stigma associated with mental illness.
Approach: They propose to construct a Chinese Dialogue Dataset for depression-diagnosis-oriented chat based on clinical depression diagnostic criteria.
Outcome: The proposed system can be used to diagnose depression using a Chinese Dialogue Dataset.
Execution as Verification: Fine-Grained Self-Correcting Reasoning for Complex KBQA (2026.acl-long)

Copied to clipboard

Challenge: Existing knowledge base question answering methods are limited by syntactic constraints and are prone to structural deviations that render queries unexecutable.
Approach: They propose a framework that reframes semantic parsing as an iterative reasoning process driven by execution feedback.
Outcome: The proposed method achieves significant improvements in query executability and answer accuracy on the WebQSP and CWQ datasets.
Target-oriented Opinion Words Extraction with Target-fused Neural Sequence Labeling (N19-1)

Copied to clipboard

Challenge: Opinion target extraction and opinion words extraction are two fundamental subtasks in Aspect Based Sentiment Analysis (ABSA).
Approach: They propose a new subtask for Aspect Based Sentiment Analysis to extract opinion words as pairs from a given opinion target.
Outcome: The proposed model outperforms existing methods significantly on several popular ABSA benchmarks.
Towards a Unified Framework for Reference Retrieval and Related Work Generation (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for related work generation use human-annotated references as information sources.
Approach: They propose a model which combines reference retrieval and related work generation processes in a unified framework based on the large language model.
Outcome: The proposed model outperforms the state-of-the-art models on two wide-applied datasets.
OpenUE: An Open Toolkit of Universal Extraction from Text (2020.emnlp-demos)

Copied to clipboard

Challenge: a large number of natural language processing tasks focus on token-level or sentence-level understandings.
Approach: They propose an open-source and extensible toolkit for various extraction tasks . they deploy an online demo with restful APIs to support real-time extraction .
Outcome: The proposed model can be used to extract information from text without training and deployment.
CompTab: A Comprehensive Benchmark for Real-World TableQA with Complex Reasoning and Irregular Tables (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on well-structured tables and fail to reflect irregular structures and complex reasoning commonly encountered in real-world scenarios.
Approach: They propose a benchmark to evaluate TableQA under complex reasoning and irregular table conditions.
Outcome: The proposed framework improves generalization and realism of large language models under complex and irregular table conditions.
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark (2022.acl-long)

Copied to clipboard

Challenge: a new benchmark for biomedical language understanding is being developed in Chinese . most benchmarks are limited to English, which makes it difficult to replicate success in other languages.
Approach: They propose to use Chinese biomedical language understanding evaluation benchmarks to evaluate Chinese models.
Outcome: The proposed benchmarks show that the current models perform worse than the human ceiling.
Dr3: Ask Large Language Models Not to Give Off-Topic Answers in Open Domain Multi-Hop Question Answering (2024.lrec-main)

Copied to clipboard

Challenge: Open Domain Multi-Hop Question Answering (ODMHQA) is one of the most challenging tasks in Natural Language Processing (NLP)
Approach: They propose a mechanism that leverages the intrinsic capabilities of Large Language Models to judge whether the generated answers are off-topic.
Outcome: The proposed method reduces the occurrence of off-topic answers by nearly 13%, improving the performance in Exact Match (EM) by nearly 3% compared to the baseline method without the Dr3 mechanism.
Thinking Beyond the Local: Multi-View Instructed Adaptive Reasoning in KG-Enhanced LLMs (2026.findings-eacl)

Copied to clipboard

Challenge: Existing methods for large language models adopt query-driven iterative reasoning from a local perspective, limiting efficiency and accuracy for complex multi-hop tasks.
Approach: They propose a multi-view instructed adaptive reasoning of LLM on Knowledge Graphs that allows LLMs to plan, evaluate, and adapt reasoning paths from a global perspective.
Outcome: The proposed model overcomes the limitations of local exploration by enabling LLMs to plan, evaluate, and adapt reasoning paths from a global perspective.
Continual Named Entity Recognition without Catastrophic Forgetting (2023.emnlp-main)

Copied to clipboard

Challenge: Named Entity Recognition (CNER) is a burgeoning area of research . a new paradigm has ushered NER into a non-entity type at the current step t .
Approach: They propose a pooled feature distillation loss that skillfully navigates the trade-off between retaining knowledge of old entity types and acquiring new ones.
Outcome: The proposed method outperforms state-of-the-art approaches on ten CNER settings using three datasets.
Logical Structure as Knowledge: Enhancing LLM Reasoning via Structured Logical Knowledge Density Estimation (2026.findings-acl)

Copied to clipboard

Challenge: Existing data-centric paradigms equate quality with factuality or diversity and ignore the internal logical complexity of training samples.
Approach: They propose a density-aware re-cognizing optimization strategy that prioritizes high-density logical samples to align training with the model's reasoning boundary.
Outcome: The proposed metric outperforms existing methods and improves reasoning performance without increasing total data volume.
Separate the Wheat from the Chaff: Winnowing Down Divergent Views in Retrieval Augmented Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) lack robustness in knowledge-intensive tasks due to noisy or irrelevant retrieved data.
Approach: They propose a multi-agent debate-based RAG framework that integrates external knowledge sources into large language models to improve their accuracy.
Outcome: The proposed framework is unsupervised and leverages pretrained LLMs without fine-tuning, making it easily adaptable to various tasks.
Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advances, Resources, and Future Directions (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) are used to assist with driving decisions, but they face limitations in perception and computational demands.
Approach: They propose a survey of LLM-based multi-agent ADSs and their applications . they analyze agent-human interactions in scenarios where LLM agents engage with humans .
Outcome: The proposed approach reduces human intervention and improves safety and efficiency.
ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference (2022.findings-acl)

Copied to clipboard

Challenge: State-of-the-art neural models typically encode document-query pairs using cross-attention for re-ranking.
Approach: They propose to fine tune a pretrained encoder-decoder model using document to query generation.
Outcome: The proposed model achieves comparable results to more expensive approaches while being 6.8X faster.
TSAM: A Two-Stream Attention Model for Causal Emotion Entailment (2022.coling-1)

Copied to clipboard

Challenge: Existing studies on EAC focus on Emotion Recognition in Conversations (ERC), i.e., recognizing emotion labels of utterances.
Approach: They propose a two-stream attention model to capture correlations between utterances in a global view and classify multiple utterrances synchronously to capture emotion and speaker information in parallel.
Outcome: The proposed model outperforms baselines and achieves new State-Of-The-Art (SOTA) performance.
The Adaptive Interrogator: Detecting Trojan LLMs in Multi-Agent Systems via Evolved Conversational Strategies (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have been focused on single-agent, white-box environments, but multi-agend systems (MAS) have a critical blind spot: supply chain vulnerabilities.
Approach: They propose a black-box auditing framework that leverages an Evolutionary Algorithm to autonomously expose hidden threats.
Outcome: The proposed framework achieves superior detection rates (up to 100% in specific configurations) and robustness across diverse architectures.
NeKo: Cross-Modality Post-Recognition Error Correction with Tasks-Guided Mixture-of-Experts Language Model (2025.acl-industry)

Copied to clipboard

Challenge: Existing methods to train a model on a mixture of domain datasets require separate correction language models.
Approach: They propose a multi-task correction MoE that trains experts to become an "expert" of speech-to-text, language-totext and vision-to text datasets by learning to route each dataset’s tokens to its mapped expert.
Outcome: The proposed model outperforms GPT-3.5 and Claude-3.5-Sonnet on the Open ASR Leaderboard and reaches an average relative 5.0% WER reduction and substantial improvements in BLEU scores.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations