Papers by Kang Zhang

100 papers
Simple Role Assignment is Extraordinarily Effective for Safety Alignment (2026.findings-acl)

Copied to clipboard

Challenge: a new study proposes a role-conditioned pipeline for value alignment . principles alone are incomplete, and they provide little guidance on when and how a value applies in context.
Approach: They propose a role-conditioned pipeline with role-based critics and a model-free approach that is based on role conditioning.
Outcome: The proposed approach outperforms principle-based, Chain-of-Thought and other benchmarks.
Continual Few-shot Event Detection via Hierarchical Augmentation Networks (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for continual few-shot event detection use labeled data, but in real-world applications, new event types emerge continually.
Approach: They propose a memory-based framework for continual few-shot event detection . they incorporate prototypical augmentation into the memory set to memorize previous event types .
Outcome: The proposed method outperforms existing methods in multiple continual few-shot event detection tasks.
CroAno : A Crowd Annotation Platform for Improving Label Consistency of Chinese NER Dataset (2021.emnlp-demo)

Copied to clipboard

Challenge: Existing crowd annotation tools for named entity recognition (NER) focus on efficiency and don't consider consistency of datasets.
Approach: They propose a crowd annotation platform for Chinese named entity recognition (NER) CroAno provides a systematic solution for improving label consistency of Chinese NER datasets.
Outcome: The proposed platform improves label consistency of Chinese NER datasets.
FinLLM-B: When Large Language Models Meet Financial Breakout Trading (2025.naacl-industry)

Copied to clipboard

Challenge: Existing methods for financial breakout detection are subpar, despite large data and knowledge required.
Approach: They propose a financial breakout dataset and introduce FinLLM-B, a large language model for financial breakout detection.
Outcome: The proposed model outperforms GPT-3.5 in the field of financial breakout detection.
MenatQA: A New Dataset for Testing the Temporal Comprehension and Reasoning Abilities of Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have shown nearly saturated performance on many NLP tasks.
Approach: They construct multiple sensitive factors time QA which encompasses three temporal factors . they test current mainstream LLMs with different parameter sizes .
Outcome: The proposed model incorporates three temporal factors with 2,853 samples . the results show that LLMs fall behind smaller models on these factors .
BANER: Boundary-Aware LLMs for Few-Shot Named Entity Recognition (2025.coling-main)

Copied to clipboard

Challenge: Named Entity Recognition (NER) is a fundamental task in Natural Language Processing (NLP) that aims to detect the entity spans of text and classify them into pre-defined set of entity types.
Approach: They propose a boundary-aware contrastive learning strategy to enhance the LLM’s ability to perceive entity boundaries for generalized entity spans.
Outcome: The proposed framework outperforms prior methods and validates its effectiveness across a range of LLM architectures.
ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matching (2026.findings-acl)

Copied to clipboard

Challenge: Existing autoregressive models for dialogue generation suffer from high latency and stability issues.
Approach: They propose a non-autoregressive (NAR) zero-shot spoken dialogue generation model based on flow-matching.
Outcome: The proposed model outperforms existing models in speech generation due to poor speech intelligibility and turn-taking precision.
REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? (2025.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for reproducing social science papers focus on reproducing results using provided code and data without assessing their consistency with the paper.
Approach: They propose a benchmark to evaluate agentic AI systems' ability to automate reproducibility assessment.
Outcome: The proposed benchmark oversimplifies real-world scenarios and lacks diversity in data formats and programming languages.
RubricBench: Aligning Model-Generated Rubrics with Human Standards (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks lack discriminative complexity and ground-truth rubric annotations required for rigorous evaluation.
Approach: They propose a curated benchmark with 1,147 pairwise comparisons to assess the reliability of rubric-based evaluation.
Outcome: The proposed benchmarks show that they support diverse domains, exhibit discriminative ability, provide high-quality annotations, and include human-authored rubrics.
Towards Robust Neural Machine Translation with Iterative Scheduled Data-Switch Training (2022.coling-1)

Copied to clipboard

Challenge: Existing methods on robust neural machine translation (NMT) construct adversarial examples by injecting noise into authentic examples and indiscriminately exploit two types of examples.
Approach: They propose an iterative scheduled data-switch training framework to mitigate this problem by injecting noise into authentic examples and indiscriminately exploiting two types of examples.
Outcome: The proposed model outperforms several competitive benchmarks on four translation benchmarks.
TexSmart: A System for Enhanced Natural Language Understanding (2021.acl-demo)

Copied to clipboard

Challenge: TexSmart supports fine-grained named entity recognition (NER) Large-scale fine-granular entity types are expected to provide richer semantic information for downstream NLP applications.
Approach: They introduce TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities.
Outcome: The proposed system supports fine-grained named entity recognition (NER) and enhanced semantic analysis functions.
Skeleton-Guided-Translation: A Benchmarking Framework for Code Repository Translation with Fine-Grained Quality Evaluation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing code translation benchmarks focus on individual functions, overlooking repository-level challenges like intermodule coherence and dependency management.
Approach: They propose a framework for benchmarking Java-to-C# translation at the repository level . it uses a translation framework guided by skeletons and fine-grained quality evaluation .
Outcome: The proposed framework improves Java-to-C# translation quality at the repository level.
CMQA: A Dataset of Conditional Question Answering with Multiple-Span Answers (2022.coling-1)

Copied to clipboard

Challenge: Existing QA datasets only contain unconditional and parallel answers . conditional question answering with hierarchical multi-span answers is challenging for the community to solve .
Approach: They propose a conditional question answering task with hierarchical multi-span answers . they propose CMQA, which contains conditional and hierarchic samples .
Outcome: The proposed task can be used to build more reliable and sophisticated QA systems.
SafeSteer: A Decoding-level Defense Mechanism for Multimodal Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing defense methods rely on fine-tuning or inefficient post-hoc interventions, limiting their ability to address novel attacks.
Approach: They propose a decoding-level defense mechanism that employs a lightweight discriminator to iteratively steer the decoding process toward safety.
Outcome: The proposed method improves safety performance by up to 33.40% without fine-tuning on multiple MLLMs.
UFO: A UI-Focused Agent for Windows OS Interaction (2025.naacl-long)

Copied to clipboard

Challenge: UFO is a UI-Fcused agent designed to fulfill user requests tailored to Windows OS applications . it decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications.
Approach: They propose a UI-Fcused Windows OS agent that decomposes user requests using a divide-and-conquer approach and incorporates a control interaction module tailored for Windows OS.
Outcome: The proposed agent decomposes user requests using divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications.
DI-BENCH: Benchmarking Large Language Models on Dependency Inference with Testable Repositories at Scale (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies highlight that dependency-related issues cause over 40% of observed runtime errors on the generated repository.
Approach: They propose a large-scale benchmark and evaluation framework specifically designed to assess LLMs’ capability on dependency inference.
Outcome: The proposed model achieves only a 48% execution pass rate on Python, indicating room for improvement.
An Evaluation Resource for Grounding Translation Errors (2025.findings-emnlp)

Copied to clipboard

Challenge: Current fine-grained error analyses do not ground the errors to the reasons why the annotated text spans are erroneous.
Approach: They use a bi-directional grounding scheme to ground erroneous text in two directions . if the error spans of both directions are consistent, the explanation is valid .
Outcome: The proposed grounding process improves translation error detection significantly.
R³A: Reinforced Reasoning for Relevance Assessment for RAG in User-Generated Content Platforms (2026.acl-industry)

Copied to clipboard

Challenge: Existing approaches to query–document relevance assessment are limited . ambiguous user intent and asymmetric relevance are challenges for RAG platforms .
Approach: They propose a decomposed reasoning model for relevance assessment that decomposes query intent into intent inference and evidence grounding.
Outcome: The proposed model outperforms strong baselines on offline benchmarks and achieves significant gains in large-scale online A/B testing.
UniSonate: A Unified Model for Speech, Music, and Sound Effect Generation with Text Instructions (2026.acl-long)

Copied to clipboard

Challenge: Generative audio modeling has been fragmented into specialized tasks such as text-to-speech (TTS), text- to-music (TTM), and text-ta (TTA) specialized models require reference audio for timbre cloning and strict phoneme alignment, whereas TTA models generate unstructured textures from open-ended captions.
Approach: They propose a unified flow-matching framework capable of synthesizing speech, music, sound effects . they propose 'token injection mechanism' that projects unstructured environmental sounds into structured temporal latent space .
Outcome: The proposed framework achieves state-of-the-art performance in instruction-based TTS and TTM while maintaining competitive fidelity in TTA.
Detect Camouflaged Spam Content via StoneSkipping: Graph and Text Joint Embedding for Chinese Character Variation Representation (D19-1)

Copied to clipboard

Challenge: Currently, Chinese characters share glyph and phonetic variations to escape detection algorithms due to their complexity and complexity.
Approach: They propose a Chinese variation-enhanced Graph Embedding algorithm that can learn Chinese character embeddings and latent variation families.
Outcome: The proposed model outperforms state-of-the-art models on Chinese spam detection datasets and review datasets.
iMOVE : Instance-Motion-Aware Video Understanding (2025.findings-acl)

Copied to clipboard

Challenge: Recent advances in Video Large Language Models have led to rapid development, significantly enhancing the capture of overall video semantics and achieving remarkable performance in general video understanding tasks.
Approach: They propose a large-scale instance-motion-aware video instruction-tuning dataset iMOVE that utilizes Event-awful Spatiotemporal Efficient Modeling to retain informative instance spatiotemporal motion details while maintaining computational efficiency.
Outcome: The proposed model excels in video temporal understanding and general video understanding.
PQR: Improving Dense Retrieval via Potential Query Modeling (2025.acl-long)

Copied to clipboard

Challenge: Existing training data is sparse, with each document associated with one or a few labeled queries.
Approach: They propose a training-free potential query retrieval framework to address this problem . they use a Gaussian mixture distribution to model all potential queries for a document .
Outcome: The proposed method is able to capture comprehensive semantic information from a document with multiple queries.
From Model-centered to Human-Centered: Revision Distance as a Metric for Text Evaluation in LLMs-based Applications (2024.findings-acl)

Copied to clipboard

Challenge: Existing evaluation metrics for large language models yield numerical scores that ignore user experience.
Approach: They propose a metric that suggests revision edits that mimic the human writing process . their results show that the metric offers more insightful feedback and distinguishes between texts .
Outcome: The proposed metric can provide a self-explained text evaluation result in a human-understandable manner beyond the context-independent score.
Interpreting Sentiment Composition with Latent Semantic Tree (2023.findings-acl)

Copied to clipboard

Challenge: Current researches on sentiment classification are shifting from improving model performance to interpretability.
Approach: They propose a new tree form capable of interpreting sentiment composition in a principled way.
Outcome: The proposed tree can explain sentiment composition in a principled way.
Scene Restoring for Narrative Machine Reading Comprehension (2020.emnlp-main)

Copied to clipboard

Challenge: Narrative passages describe a chain of events, which helps the machine understand the passage comprehensively.
Approach: They propose a method to let machine read narrative passages with their prior knowledge . they build a scene graph using Atomic as external knowledge and encode it with GDIN .
Outcome: The proposed method achieves state-of-the-art on a Story Cloze Test and CosmosQA datasets.
Hetero-Designer: Automated Design of Multi-Agent Systems with Heterogeneous LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches to design LLM-based Multi-agent systems are constrained by homogeneous LLMs.
Approach: They propose an automated design of heterogeneous-LLMs-based MAS with a binary-star transformer and an autoregressive graph generation pipeline.
Outcome: The proposed pipeline is high-performing on various benchmarks and extensible to unseen LLMs and roles.
LongCLI-Bench: A Preliminary Benchmark and Study for Long-horizon Agentic Programming in Command-Line Interfaces (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for agentic programming in long-horizon command-line interface tasks are limited by short task horizons, data contamination from GitHub scraping, and a lack of fine-grained evaluation metrics.
Approach: They propose a benchmark to evaluate agentic capabilities across long-horizon command-line interface tasks.
Outcome: The proposed benchmarks cover four engineering categories: from scratch, feature addition, bug fixing, and refactoring.
IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offs (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing systems require users to manually select models or employ rigid routing rules that fail to capture the continuous spectrum of query complexity.
Approach: They propose a quality-constrained intelligent prompt routing framework that automatically selects optimal models based on predicted response quality and user-specified tolerance levels.
Outcome: The proposed framework achieves 43.9% cost reduction while maintaining quality parity with strongest model in the Claude family and processes requests with sub-150ms latency.
I²B-LPO: Latent Policy Optimization via Iterative Information Bottleneck (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for large language model reasoning suffer from exploration collapse due to the semantic homogeneity of random rollouts.
Approach: They propose to use latent policy optimization via iterative information bottleneck to optimize reasoning trajectories by diversifying reasoning .
Outcome: Empirical results show that the proposed method achieves state-of-the-art performance with margins of up to 5.3% in accuracy and 7.4% in diversity metrics.
QueueEDIT: Structural Self-Correction for Sequential Model Editing in LLMs (2026.findings-acl)

Copied to clipboard

Challenge: Recent studies have shown that large language models (LLMs) can be effective for correcting factual inaccuracies but can still suffer from hallucinations.
Approach: They propose a queue-based self-correction framework that addresses parameter bias during sequential model editing.
Outcome: The proposed framework outperforms baseline models while maintaining competitive performance in single-turn editing.
ZhuJiu: A Multi-dimensional, Multi-faceted Chinese Benchmark for Large Language Models (2023.emnlp-demo)

Copied to clipboard

Challenge: Various types of LLMs have recently been rapidly developing, such as Llama2 and ChatGLM2 .
Approach: They propose a benchmark that comprehensively evaluates LLMs across 7 ability dimensions covering 51 tasks.
Outcome: The proposed benchmarks are comprehensive and systematic, with a high level of accuracy and authority.
APIRecX: Cross-Library API Recommendation via Pre-Trained Language Model (2021.emnlp-main)

Copied to clipboard

Challenge: API recommendation tools can help programmers use APIs by recommending which APIs to be used next given the APIs that have been written.
Approach: They propose a cross-library API recommendation approach that uses BPE to split API calls in each sequence and pre-train a GPT based language model.
Outcome: The proposed APIRecX can recommend APIs that are previously regarded as OOV . it can migrate knowledge of existing libraries to a new library and recommend API that is previously viewed as OVO .
Awakening Augmented Generation: Learning to Awaken Internal Knowledge of Large Language Models for Question Answering (2025.coling-main)

Copied to clipboard

Challenge: Recent studies indicate that Large Language Models model rich knowledge, but it is often not activated and awakened.
Approach: They propose a framework that leverages richer context to enhance question answering . Explicit awakening fine-tunes a context generator to create a synthetic, compressed document that functions as symbolic context.
Outcome: The proposed framework mimics the human ability to answer questions using only thinking and recalling to compensate for knowledge gaps.
RexUIE: A Recursive Method with Explicit Schema Instructor for Universal Information Extraction (2023.findings-emnlp)

Copied to clipboard

Challenge: Named Entity Recognition (NER) and Relation Extraction (RE) models have limited success when extracting general schemas such as quadruples and quintuples.
Approach: They propose a formal formulation that covers almost all extraction schemas and a Recursive Method with Explicit Schema Instructor for UIE.
Outcome: The proposed method shows strong performance under full-shot and few-shot settings and achieves state-of-the-art results on the tasks of extracting complex schemas.
Guiding Medical Vision-Language Models with Diverse Visual Prompts: Framework Design and Comprehensive Exploration of Prompt Variations (2025.naacl-long)

Copied to clipboard

Challenge: Current vision-language models lack the ability to focus on specific areas designated by humans . a new framework that integrates medical entity extraction, visual prompt generation, and dataset adaptation is proposed to improve visual prompt-guided fine-tuning.
Approach: They propose to use visual prompts to guide and enhance formation of region-specific attention.
Outcome: The proposed framework outperforms state-of-the-art large vision-language models on medical datasets.
Camouflaged Chinese Spam Content Detection with Semi-supervised Generative Active Learning (2020.acl-main)

Copied to clipboard

Challenge: Existing active learning models for text spam detection tasks are based on pool-based active learning, but the annotating process is laborious and time consuming for humans.
Approach: They propose a semi-supervised active learning model to address spam imbalances . they propose masked attention learning approach and character variation graph-enhanced augmentation procedure .
Outcome: The proposed model can improve the performance of existing models for Chinese spam detection task.
P²Net: Parallel Pointer-based Network for Key Information Extraction with Complex Layouts (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for key information extraction are based on a limited set of entity categories and fixed layouts.
Approach: They propose a large-scale, human-annotated dataset for key information extraction . it is based on a human-annotated layout and 1,162 entity categories . they propose 'parallel pointer-based network' that leverages implicit relationships .
Outcome: Experiments on widely-used datasets show that the proposed model outperforms state-of-the-art methods while maintaining fast inference speeds.
Connecting Embeddings for Knowledge Graph Entity Typing (2020.acl-main)

Copied to clipboard

Challenge: Existing knowledge graphs suffer from incompleteness and miss important facts, jeopardizing their usefulness in downstream tasks such as question answering.
Approach: They propose a method which is trained by utilizing local typing knowledge from existing entity type assertions and global triple knowledge in KGs.
Outcome: The proposed model favors inferences that agree with both entity type instances and triple knowledge in KGs.
LLM-based Medical Assistant Personalization with Short- and Long-Term Memory Coordination (2024.naacl-long)

Copied to clipboard

Challenge: Existing studies have focused on learning and enhancing large language models to understand and generate natural language.
Approach: They propose a computational bionic memory mechanism equipped with a parameter-efficient fine-tuning schema to personalize medical assistants.
Outcome: The proposed method can enhance the response with aware of previous mistakes for new queries during a dialogue session, but the training costs are prohibitive.
Attend What You Need: Motion-Appearance Synergistic Networks for Video Question Answering (2021.acl-long)

Copied to clipboard

Challenge: Recent advances in natural language processing and computer vision have made significant progress in artificial intelligence (AI).
Approach: They propose Motion-Appearance Synergistic Networks which embed cross-modal features grounded on motion and appearance information and selectively utilize them depending on the question’s intentions.
Outcome: The proposed network achieves state-of-the-art on the TGIF-QA and MSVD-QA datasets and qualitatively analyzes the results.
NeuSym-RAG: Hybrid Neural Symbolic Retrieval with Multiview Structuring for PDF Question Answering (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to retrieval augmented generation neglect PDF structure and layout . individual PDFs often exceed prompt limits and user queries may span multiple documents.
Approach: They propose a hybrid neural symbolic retrieval framework which combines both paradigms in an interactive process.
Outcome: The proposed framework organizes semi-structured PDF content into relational database and vectorstore . it defeats both RAG and structured baselines on three PDF-based QA datasets .
Taxonomy-guided Semantic Indexing for Academic Paper Search (2024.emnlp-main)

Copied to clipboard

Challenge: Academic paper search often struggles to match underlying academic concepts between queries and documents.
Approach: They propose a framework that extracts key concepts from papers and organizes them as a semantic index guided by an academic taxonomy.
Outcome: The proposed framework can be flexibly employed to enhance existing retrieval frameworks.
Scientific Paper Retrieval with LLM-Guided Semantic-Based Ranking (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent studies also use large language models (LLMs) for query understanding, but these methods lack grounding in corpus-specific knowledge and may generate unreliable or unfaithful content.
Approach: They propose a paper retrieval framework that combines large language models (LLMs) with a concept-based semantic index to capture scientific concepts.
Outcome: The proposed framework improves the performance of various base retrievers, surpasses strong existing LLM-based baselines, and remains highly efficient.
ZhuJiu-Knowledge: A Fairer Platform for Evaluating Multiple Knowledge Types in Large Language Models (2024.naacl-demo)

Copied to clipboard

Challenge: evaluating the knowledge of large language models (LLMs) is crucial, and rapid advancement in large language modeling has heightened the importance of model evaluations.
Approach: They propose a fairer benchmark for evaluating multiple knowledge types of LLMs by focusing on commonsense knowledge, world knowledge, and language knowledge.
Outcome: The proposed framework evaluates 14 current mainstream LLMs and provides a detailed discussion and analysis of their results.
Efficient and Accurate Prompt Optimization: the Benefit of Memory in Exemplar-Guided Reflection (2025.acl-long)

Copied to clipboard

Challenge: Recent work utilizes feedbacks generated from erroneous cases to guide prompt optimization . previous methods rely on computational resources and powerful GPUs .
Approach: They propose an automatic prompt engineering method that leverages feedbacks from erroneous cases to guide prompt optimization.
Outcome: The proposed method surpasses state-of-the-art methods with less steps and lower computational resources.
Learning to Ideate for Machine Learning Engineering Agents (2026.eacl-short)

Copied to clipboard

Challenge: Existing machine learning engineering (MLE) agents struggle to iteratively optimize their implemented algorithms for effectiveness.
Approach: They propose a framework that separates ideation from implementation that allows an implementation agent to request strategic help from a dedicated Ideator.
Outcome: The proposed framework outperforms implementation-only agent baselines on MLE-Bench and can be trained with reinforcement learning to generate more effective ideas.
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)

Copied to clipboard

Challenge: Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task.
Approach: They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5.
Outcome: The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers.
BBScoreV2: Learning Time-Evolution and Latent Alignment from Stochastic Representation (2025.emnlp-main)

Copied to clipboard

Challenge: Autoregressive generative models are gaining traction in language tasks such as text generation and machine translation.
Approach: They propose a likelihood-based evaluation metric that fits transformer-based model embeddings into a stochastic process and propose it as a probability-based metric.
Outcome: The proposed model embeddings induce a "clustered-to-temporal ordered" mapping of language model representations in high-dimensional space, and this structure enhances performance on tasks such as temporal consistency evaluation and AI-generated content detection.
ScEdit: Script-based Assessment of Knowledge Editing (2025.findings-acl)

Copied to clipboard

Challenge: Knowledge Editing (KE) has gained increasing attention, yet current evaluation frameworks do not integrate KE into real-world application scenarios.
Approach: They propose a script-based benchmark which encompasses both counterfactual and temporal edits and integrates token-level and text-level evaluation methods.
Outcome: The proposed method combines token-level and text-level evaluation methods with a new fact-based evaluation framework.
Incorporating Causal Analysis into Diversified and Logical Response Generation (2022.coling-1)

Copied to clipboard

Challenge: Existing generation-based models generate generic and safe responses such as "So am I" or "I don't know"
Approach: They propose to predict the mediators to preserve relevant information and auto-regressively incorporate the mediator into generating process.
Outcome: The proposed model generates relevant and informative responses and outperforms the state-of-the-art in terms of automatic metrics and human evaluations.
Class Lifelong Learning for Intent Detection via Structure Consolidation Networks (2023.findings-acl)

Copied to clipboard

Challenge: Existing intent detection models can only handle predefined intent classes in the offline environment.
Approach: They propose a method that continually learns new intent classes from new data . structure-based retrospection and contrastive knowledge distillation are used to solve these problems .
Outcome: The proposed method outperforms existing models on three benchmarks.
Reconsidering LLM Uncertainty Estimation Methods in the Wild (2025.acl-long)

Copied to clipboard

Challenge: Existing studies evaluate UE methods in short-form QA settings, but real-world deployment presents several challenges.
Approach: They examine UE methods' sensitivity to decision threshold selection and their robustness to query transformations such as typos and adversarial prompts.
Outcome: The proposed methods exhibit robustness against typos, adversarial prompts, and prior chat history, and are highly susceptible to adversarials.
Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering (2024.findings-emnlp)

Copied to clipboard

Challenge: Knowledge graph question answering (KGQA) aims to provide factual answers to natural language questions by leveraging structured information stored in a knowledge graph.
Approach: They propose a Question-guided Knowledge Graph Re-scoring method to eliminate noisy pathways for the input question, thereby focusing specifically on pertinent factual knowledge.
Outcome: The proposed method eliminates noisy pathways for the input question, thereby focusing specifically on pertinent factual knowledge.
ExeCoder: Empowering Large Language Models with Executability Representation for Code Translation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing code translation models only learn the contextual semantics of code during pre-training, neglecting executability information closely related to the execution state of the code.
Approach: They propose an LLM specifically designed for code translation called ExeCoder . it uses executability representations such as functional semantics and syntax structures to enhance LLMs' capabilities.
Outcome: The proposed model outperforms existing open-source code translation models on two metrics.
MAS-Bench: A Unified Benchmark for Shortcut-Augmented Hybrid Mobile GUI Agents (2026.acl-long)

Copied to clipboard

Challenge: Shortcuts such as APIs and deep-links have emerged as efficient complements to flexible GUI operations, but systematic evaluation of GUI–shortcut hybrid agents remains underexplored.
Approach: They propose a benchmark that evaluates GUI-shortcut hybrid agents with a specific focus on the mobile domain.
Outcome: MAS-Bench evaluates agent's ability to generate shortcuts by discovering and creating reusable, low-cost workflows.
Multi-Turn Dialogue Generation in E-Commerce Platform with the Context of Historical Dialogue (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing research on customer service dialogue generation generates generic responses from sellers . however, such cost prohibits small businesses, and multiturn dialogue generation is becoming more popular.
Approach: They propose a novel and extensible dialogue generation method by leveraging sellers’ historical dialogue information to generate generic seller responses.
Outcome: The proposed model can generate high-quality responses that cater to specific sellers’ characteristics and exhibit consistent superiority over baselines on a real-world multi-turn customer service dialogue dataset.
Dual Attention Networks for Visual Reference Resolution in Visual Dialog (D19-1)

Copied to clipboard

Challenge: Visual dialog (VisDial) requires a dialog agent to answer a series of questions grounded in an image.
Approach: They propose dual attention networks (DAN) for visual reference resolution in VisDial.
Outcome: The proposed model outperforms the previous state-of-the-art model on VisDial datasets.
KMatrix: A Flexible Heterogeneous Knowledge Enhancement Toolkit for Large Language Model (2024.emnlp-demo)

Copied to clipboard

Challenge: Existing Knowledge-Enhanced Large Language Models (K-LLMs) toolkits focus on free-textual knowledge and lack robust datasets, models, and user-friendly experience.
Approach: They propose a flexible heterogeneous knowledge enhancement toolkit to enhance Large Language Models (LLMs) using external knowledge.
Outcome: KMatrix: a flexible heterogeneous knowledge enhancement toolkit for LLMs includes verbalizing-retrieval and parsing-query methods.
KMatrix-2: A Comprehensive Heterogeneous Knowledge Collaborative Enhancement Toolkit for Large Language Model (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing studies on K-LLMs systems focus on declarative knowledge and procedural knowledge (rules) .
Approach: They propose to build a toolkit that supports comprehensive heterogeneous knowledge collaborative enhancement for Large Language Models (LLMs).
Outcome: The proposed toolkit provides unified knowledge integration and joint knowledge retrieval methods to achieve more comprehensive heterogeneous knowledge collaborative enhancement.
The Security Threat of Compressed Projectors in Large Vision-Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Mainstream VLPs have significant security implications, but their security implications have not been thoroughly examined.
Approach: a study evaluates the security of visual language projectors by comparing them to uncompressed projector.
Outcome: The evaluation reveals significant differences in security profiles between compressed and uncompressed projectors.
On the In-context Generation of Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have the ability of in-context generation (ICG) when given an in-text prompt, they can implicitly recognize the pattern of the examples and complete the prompt in the desired way.
Approach: They propose a plausible latent variable model to model the distribution of pretrained corpora and formalize ICG as a problem of next topic prediction.
Outcome: The proposed model can model the distribution of pretrained corpora and then formalize ICG as a problem of next topic prediction.
JurisBench: A Deep Benchmark for Assessing Large Language Models in Professional Legal Practice (2026.acl-long)

Copied to clipboard

Challenge: Existing legal benchmarks evaluate isolated tasks or exam-style questions, failing to capture the procedural interdependencies and adjudicative rigor inherent in professional practice.
Approach: They propose a vertical, depth-oriented, domain-specific benchmark to evaluate Large Language Models (LLMs) in Chinese civil litigation.
Outcome: The proposed benchmarks show that large language models exhibit an "illusion of competence" the results highlight a critical gap between fluent linguistic output and judicial reliability .
When Phrases Meet Probabilities: Enabling Open Relation Extraction with Cooperating Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Existing clustering-based open relation extraction methods use pre-trained language models . embeddings from language models are high-dimensional and anisotropic, so there is a gap .
Approach: They propose a framework that makes two LLMs work collaboratively to achieve clustering.
Outcome: The proposed framework outperforms existing methods by 1.4%3.13% on different datasets.
Alignment Rationale for Natural Language Inference (2021.acl-long)

Copied to clipboard

Challenge: Existing explanation methods pick prominent features, but alignments between words or phrases are more enlightening clues to explain the model.
Approach: They propose a method to generate alignment rationale explanations for co-attention based models in NLI by feature selection.
Outcome: The proposed method is more faithful and human-readable compared with existing methods.
Dynamic Context Selection for Document-level Neural Machine Translation via Reinforcement Learning (2020.emnlp-main)

Copied to clipboard

Challenge: Existing document-level neural machine translation methods use all context sentences in a fixed scope.
Approach: They propose an approach to select dynamic context so that document-level neural machine translation models can utilize more useful selected context sentences.
Outcome: The proposed approach can select adaptive context sentences for different source sentences and significantly improves translation quality over sentences in a document.
Exploring the Vulnerability of the Content Moderation Guardrail in Large Language Models via Intent Manipulation (2025.findings-emnlp)

Copied to clipboard

Challenge: Prior work has shown that intent detection enhances LLMs’ moderation guardrails, but the robustness of these guardrail mechanisms under malicious manipulations remains under-explored.
Approach: They propose a two-stage intent-based prompt-refinement framework that first transforms harmful inquiries into structured outlines and further reframes them into declarative-style narratives.
Outcome: The proposed framework outperforms several cutting-edge jailbreak methods and evades even advanced Intent Analysis (IA) and Chain-of-Thought (CoT)-based defenses.
Zero-Shot Cross-Lingual Document-Level Event Causality Identification with Heterogeneous Graph Contrastive Transfer Learning (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies focus on sentence-level ECI with high-resource languages, leaving document-level DECI with low-resourced languages under-explored.
Approach: They propose a Heterogeneous Graph Interaction Model with Multi-granularity Contrastive Transfer Learning for zero-shot cross-lingual ECI.
Outcome: The proposed model outperforms the state-of-the-art model on monolingual and multilingual scenarios by 9.4% and 8.2% of average F1 score.
FocalOrder: Focal Preference Optimization for Reading Order Detection (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for document comprehension rely on uniform supervision, resulting in a performance degradation in the intermediate sections.
Approach: They propose a framework driven by Focal Preference Optimization to detect reading order in document layouts.
Outcome: The proposed framework outperforms competing baselines and surpasses large-scale general VLMs.
LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in language models have demonstrated strong capabilities in semantic understanding and contextual modeling.
Approach: They propose a LLaMA-based language model that incentivizes generalization capabilities for speech enhancement.
Outcome: The proposed language model outperforms prior task-specific discriminative and generative models in acoustic enhancement tasks.
Biomedical Concept Normalization by Leveraging Hypernyms (2021.emnlp-main)

Copied to clipboard

Challenge: Biomedical Concept Normalization (BCN) is widely used in biomedical text processing . despite numerous surface variants of biomedically-defined concepts, it remains challenging and unsolved.
Approach: They propose a framework that uses hypernyms and synonyms to facilitate BCN . they use list-wise training to make use of both hypernies and synonym entities .
Outcome: The proposed framework outperforms the state-of-the-art model on the NCBI dataset.
Uncertainty-Calibrated Elastic Alignment for Multimodal Sentiment Analysis with Missing Modalities (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for multimodal sentiment analysis are often dynamically incomplete.
Approach: They propose a new uncertainty-calibrated elastic alignment framework to address these issues by employing probabilistic imputation to capture cross-modal ambiguity and leverage the estimated uncertainty to drive elastic alignment.
Outcome: The proposed framework outperforms state-of-the-art models in multiple benchmarks and consistently outperformed existing models.
SciMMIR: Benchmarking Scientific Multi-modal Information Retrieval (2024.findings-acl)

Copied to clipboard

Challenge: Multi-modal information retrieval (MMIR) is a rapidly evolving field . current benchmarks for image-text pairings overlook the scientific domain .
Approach: They develop a scientific domain-specific MMIR benchmark to evaluate image-text pairings using open-access research paper corpora.
Outcome: The proposed benchmarks are based on 530K image-text pairs extracted from scientific documents with detailed captions.
MIE: A Medical Information Extractor towards Medical Dialogues (2020.acl-main)

Copied to clipboard

Challenge: EMRs are important but many doctors suffer from writing them, which is time-consuming and tedious.
Approach: They propose an automatic conversion of medical dialogues to EMRs using a window-sliding style . they propose a medical information extractor (MIE) that extracts medical information from medical dialogue .
Outcome: The proposed model extracts medical information from doctor-patient dialogues.
From Past To Path: Masked History Learning for Next-Item Prediction in Generative Recommendation (2026.acl-long)

Copied to clipboard

Challenge: Generative recommendation models inherently bias towards local contexts, failing to capture deeper historical dependencies necessary for understanding complex user intents.
Approach: They propose a training framework that shifts the objective from simple next-step prediction to deep comprehension of history by entropy-guided masking policy and a curriculum learning scheduler to enhance the framework.
Outcome: The proposed framework outperforms state-of-the-art generative models on three public datasets and shows that it is more accurate than current models.
Sentiment Classification towards Question-Answering with Hierarchical Matching Network (D18-1)

Copied to clipboard

Challenge: Existing methods to classify QA text contain rich sentiment information.
Approach: They propose a task/method to address QA sentiment analysis by annotating QA text pair with annotation guidelines.
Outcome: The proposed method can learn the matching vectors of each Q-sentence, A-sentent unit.
IPL: Leveraging Multimodal Large Language Models for Intelligent Product Listing (2024.emnlp-industry)

Copied to clipboard

Challenge: Unlike professional Business-to-Consumer (B2C) e-commerce platforms, consumer-to consumer (C2C), is mainly targeting individual sellers.
Approach: They develop an intelligent product listing tool that generates product descriptions using various product attributes such as category, brand, color, condition, etc.
Outcome: The proposed tool outperforms the base model in domain-specific tasks while producing less hallucination.
Machine Reading Comprehension Using Structural Knowledge Graph-aware Network (D19-1)

Copied to clipboard

Challenge: Recent large-scale datasets specify that external knowledge is required to answer questions.
Approach: They propose a model that leverages external knowledge to construct sub-graphs for entities in machine comprehension context.
Outcome: The proposed model achieves state-of-the-art performance on the ReCoRD dataset.
A Hierarchical Explanation Generation Method Based on Feature Interaction Detection (2023.findings-acl)

Copied to clipboard

Challenge: Existing work on hierarchical attributions tends to limit text groups to a continuous text span, which is difficult for humans to read.
Approach: They propose a method which captures feature interactions and converts non-hierarchical explanations into hierarchical versions.
Outcome: The proposed method can convert ubiquitous non-hierarchical explanations into their corresponding hierarchical versions.
WSDPO: A Generative Word Sense Disambiguation Framework with Chain-of-Thought and Preference Optimization (2026.acl-long)

Copied to clipboard

Challenge: Word sense disambiguation (WSD) is a fundamental task in natural language processing.
Approach: They propose a training framework for generative WSD with chain-of-thought (CoT) and preference optimization.
Outcome: The proposed framework achieves significant performance gains on rare and unseen settings and exhibits strong generalization in standard evaluation settings.
A Framework for Effective Invocation Methods of Various LLM Services (2025.coling-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are becoming a fundamental tool for various natural language processing tasks due to commercial reasons, the potential risk of misuse and expensive tuning cost.
Approach: They propose a framework for constructing an effective LLM services invocation strategy that best meets task demands.
Outcome: The proposed framework classifies existing methods into four categories: input abstraction, semantic cache, solution design, and output enhancement, which can be used separately or jointly during the invocation life cycle.
SKIntern: Internalizing Symbolic Knowledge for Distilling Better CoT Capabilities into Small Language Models (2025.coling-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have high computational costs and privacy concerns due to their high computational expenses and data privacy.
Approach: They propose a method that empowers SLMs to internalize symbolic knowledge and few-shot examples gradually through a progressive fine-tuning process.
Outcome: The proposed approach outperforms state-of-the-art baselines by over 5% while reducing inference costs by up to 4 across a wide range of SLMs in both in-domain (ID) and out-of domain (OOD) tasks.
DTELS: Towards Dynamic Granularity of Timeline Summarization (2025.naacl-long)

Copied to clipboard

Challenge: Existing timeline summarizations lack flexibility to meet diverse granularity needs . a fine-grained timeline showing the technical details is preferred for news topics .
Approach: They propose a new paradigm to construct adaptive timelines based on user instructions or requirements.
Outcome: The proposed timelines are informative and granularly consistent, but they struggle to generate consistent timelines.
Enhancing Multiple-choice Machine Reading Comprehension by Punishing Illogical Interpretations (2021.emnlp-main)

Copied to clipboard

Challenge: Multiple-choice MRC is one of the most studied tasks in MRC due to the convenience of evaluation and the flexibility of answer format.
Approach: They propose to use multiple-choice MRC to explain a trained model and reveal how it arrives at the prediction by punishing illogical attributions.
Outcome: The proposed method improves model performance without external information and model structure change without any external information.
NEAT: Neuron-Based Early Exit for Large Reasoning Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to reduce overthinking require additional rollout computation or externally labeled datasets.
Approach: They propose a Neuron-based Early reAsoning exiT framework that monitors neuron-level activation dynamics to enable training-free early exits.
Outcome: The proposed framework reduces the amount of reasoning steps generated by LRMs while maintaining accuracy.
Reasoning Visual Dialog with Sparse Graph Learning and Knowledge Transfer (2021.findings-emnlp)

Copied to clipboard

Challenge: Visual dialog is a task of answering questions grounded in an image using dialog history as context.
Approach: They propose a Sparse Graph Learning method to formulate visual dialog as a graph structure learning task.
Outcome: The proposed model outperforms the state-of-the-art models on the VisDial v1.0 dataset.
QAVA: Query-Agnostic Visual Attack to Large Vision-Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Currently, large vision-language models are limited in their ability to provide correct answers for multimodal tasks . however, they can still provide correct responses for multiple images associated with a single image . a query-agnostic visual attack (QAVA) provides robust adversarial examples that generate incorrect responses to unspecified and unknown questions.
Approach: They propose a query-agnostic visual attack to create adversarial examples that generate incorrect answers to unspecified and unknown questions.
Outcome: The proposed model improves performance on images when the question is unknown compared to known target questions .
DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: DA-Code is a code generation benchmark designed to assess LLMs on agent-based data science tasks.
Approach: They propose a code generation benchmark specifically designed for LLMs on agent-based data science tasks.
Outcome: The benchmark performs better than existing frameworks, but lacks accuracy . it is based on real-world data, and includes examples that cover a wide range of tasks .
Preference Heads in Large Language Models: A Mechanistic Framework for Interpretable Personalization (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models exhibit strong implicit personalization ability, but most approaches treat this behavior as a black box.
Approach: They propose a mechanistic interpretation perspective and propose 'sparse' set of Preference Heads . they compute a Preference Contribution Score for each attention head and compare their predictions .
Outcome: The proposed framework computes a Preference Contribution Score (PCS) for each attention head and measures its causal impact on user aligned outputs.
AdaNSP: Uncertainty-driven Adaptive Decoding in Neural Semantic Parsing (P19-1)

Copied to clipboard

Challenge: Semantic parsing (SP) maps a natural language utterance into a formal language . standard Seq2Seq models ignore underlying grammars and may give ill-formed results.
Approach: They propose an end-to-end model for semantic parsing that transduces a natural language sentence to the formal semantic representation.
Outcome: The proposed model outperforms the state-of-the-art models and does not need expertise like predefined grammar or sketches in the meantime.
ABSEval: An Agent-based Framework for Script Evaluation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies on script evaluation of large language models (LLMs) have not evaluated scripts generated by LLMs due to their logical structure, sequential organization, and open-ended nature.
Approach: They propose to use a script evaluation dataset to evaluate LLM scripts . they propose to develop an agent-based script evaluation framework ABSEval to evaluate scripts.
Outcome: The proposed framework provides superior accuracy and relevance, aligning closely with human evaluation.
TEXTOIR: An Integrated and Visualized Platform for Text Open Intent Recognition (2021.acl-demo)

Copied to clipboard

Challenge: TEXTOIR is the first integrated platform for text open intent recognition . currently, many dialogue systems are limited to handle the uncertain open intents .
Approach: TEXTOIR is the first integrated platform for text open intent recognition . it is composed of two main modules: open intent detection and open intent discovery . authors propose a framework to implement a complete process to identify known intents and discover open intents .
Outcome: TEXTOIR is the first integrated and visualized platform for text open intent recognition . it integrates state-of-the-art algorithms and benchmark intent datasets . however, there are still some issues, which bring difficulties for future research .
DocFusion: A Unified Framework for Document Parsing Tasks (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for document parsing often employ multiple models, limiting performance . Existing models often employ discrete tokens, whereas recognition relies on continuous coordinates .
Approach: They propose a Gaussian-Kernel Cross-Entropy Loss (GK-CEL) that unifies detection and recognition by enabling generative frameworks to handle both tasks simultaneously.
Outcome: The proposed model performs competitively across four core document parsing tasks.
Content- and Topology-Aware Representation Learning for Scientific Multi-Literature (2023.emnlp-main)

Copied to clipboard

Challenge: Existing approaches focus on learning textual information at sentence- or document-level, but ignore inter-document connections.
Approach: They propose a model that extends representation learning to the multi-document level . it integrates latent semantic and rich relatedness information from topological networks .
Outcome: The proposed model learns latent semantic information from content and rich relatedness information from topological networks.
RoDEval: A Robust Word Sense Disambiguation Evaluation Framework for Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies rely on single-task evaluations and classification-based metrics that overlook the fundamental differences between generative LLMs and traditional classification models.
Approach: They propose to use four new metrics to evaluate LLM-based word sense disambiguation (WSD) . experimental results reveal significant limitations in LLMs' WSD performance .
Outcome: The proposed evaluation framework is open-source at https://github.com/DayDream405/RoDEval.
Generative Calibration for In-context Learning (2023.findings-emnlp)

Copied to clipboard

Challenge: In-context learning is one of the most exciting features of large language models . performance is sensitive to various configurations of the prompt, such as the choice or order of the training examples.
Approach: They propose to calibrate the in-context predictive distribution by adjusting the label marginal . they find that the proposed method outperforms the ICL and state-of-the-art calibration methods .
Outcome: The proposed method outperforms state-of-the-art methods by 27% absolute in macro-F1.
LMDX: Language Model-based Document Information Extraction and Localization (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models have revolutionized Natural Language Processing but their application in extracting information from visually rich documents has not been successful.
Approach: They propose a language model-based document information extraction and localization methodology to reframe the document information extract task for a LLM.
Outcome: The proposed method enables extraction of singular, repeated, and hierarchical entities with and without training data.
Logic Traps in Evaluating Attribution Scores (2022.acl-long)

Copied to clipboard

Challenge: Modern deep learning models are notoriously opaque, which has motivated the development of methods for interpreting how deep models predict.
Approach: They propose to review existing methods for evaluating attribution scores and summarize the logic traps in these methods.
Outcome: The proposed methods show that they do not contain logic traps and that they are not reliable.
Data Collection for Dialogue System: A Startup Perspective (N18-3)

Copied to clipboard

Challenge: Developing dialogue systems such as Apple Siri and Google Now requires high quality training data but data collection with crowdsourcing is largely an open question.
Approach: They propose to use crowdsourcing to collect data for a user intent classification task in a dialogue system.
Outcome: The proposed method improves the quality of the collected data and the model performance on real user queries.
Representative Demonstration Selection for In-Context Learning with Two-Stage Determinantal Point Process (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods tend to select different demonstrations for each test instance, which is time-consuming and poses limitations in practical scenarios.
Approach: They propose to select a representative subset of in-context demonstrations that can prompt different test instances in a specific task.
Outcome: The proposed method can be used to generate representative in-context demonstrations.
Knowledge Triplets Derivation from Scientific Publications via Dual-Graph Resonance (2024.lrec-main)

Copied to clipboard

Challenge: Existing relation extraction methods aim to extract explicit triplet knowledge from documents, but they can hardly perceive unobserved factual relations.
Approach: They propose a novel Extraction-Contextualization-Derivation strategy to generate a document-specific dynamic graph from a shared static knowledge graph.
Outcome: The proposed method can generate richer explicit and implicit relations under the guidance of static and dynamic knowledge topologies.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations