Papers by Kun Huang

39 papers
Pierce the Mists, Greet the Sky: Decipher Knowledge Overshadowing via Knowledge Circuit Analysis (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are hampered by hallucinations, a particularly challenging variant, knowledge overshadowing, which can lead to erroneous outputs even with high-quality training data.
Approach: They propose a framework to analyze and detect knowledge overshadowing by using knowledge circuit analysis to dissect the function of key components in the circuit and how attention pattern dynamics contribute to the phenomenon.
Outcome: Extensive experiments show that the framework can detect and analyze knowledge overshadowing and improves on existing models.
MAKAR: a Multi-Agent framework based Knowledge-Augmented Reasoning for Grounded Multimodal Named Entity Recognition (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for GMNER fail to address semantic ambiguity caused by polysemy and long-tail distribution of datasets.
Approach: They propose a framework for Grounded Multimodal Named Entity Recognition that leverages a Multimodal Large Language Model to address semantic ambiguity.
Outcome: Extensive experiments show that the proposed framework outperforms existing methods on two benchmark datasets.
Uncertainty Guided Label Denoising for Document-level Distant Relation Extraction (2023.acl-long)

Copied to clipboard

Challenge: Document-level relation extraction (DocRE) aims to extract semantic relations between entities in a document.
Approach: They propose a Document-level distant relation extraction framework with unreliable pseudo labels to denoise DS data.
Outcome: The proposed framework outperforms strong baselines on two public datasets.
Probing Multimodal Large Language Models for Global and Local Semantic Representations (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies have focused on the ability of MLLMs to generate single tokens one by one, while lacking studies about how their representation vectors can encode global multimodal information.
Approach: They propose to use image-caption corpus to train Multimodal Large Language Models (MLLMs) . they find that the topmost layers encode more global semantic information .
Outcome: The proposed models can encode more global semantic information, rather than the topmost layers, and perform better on visual-language entailment tasks.
C-World: A Computer Use Agent Environment Creator (2026.acl-long)

Copied to clipboard

Challenge: C-World enables users to build agent environments on demand.
Approach: They propose a system that enables users to build agent environments on demand.
Outcome: The proposed system outperforms baselines on 119k samples and achieves Spearman = 0.883 ranking correlation with real execution.
Correctable-DST: Mitigating Historical Context Mismatch between Training and Inference for Improved Dialogue State Tracking (2022.emnlp-main)

Copied to clipboard

Challenge: Existing dialogue state tracking approaches predict the dialogue state of a target turn sequentially based on the ground-truth previous dialogue state.
Approach: They propose a method that predicts dialogue state sequentially based on previous dialogue state . they propose generating a previously “predicted” dialogue state using ground-truth previous dialogue states .
Outcome: The proposed method achieves 67.51%, 68.24%, 70.30%, 71.38%, and 81.27% joint goal accuracy on MultiWOZ 2.0-2.4 datasets.
Rewrite to Jailbreak: Discover Learnable and Transferable Implicit Harmfulness Instruction (2025.findings-acl)

Copied to clipboard

Challenge: Existing jailbreak methods create a forced instruction-following scenario, or search adversarial prompts with prefix or suffix tokens to achieve a specific representation manually or automatically.
Approach: They propose a method that rewrites the original instruction to achieve a jailbreak . they propose rewriting the original instructions to improve the attack strategy .
Outcome: The proposed method is more efficient and easier to identify since no additional features are introduced.
R2F: A General Retrieval, Reading and Fusion Framework for Document-level Natural Language Inference (2022.emnlp-main)

Copied to clipboard

Challenge: Document-level natural language inference (DOCNLI) is a new task in natural language processing.
Approach: They propose a document-level natural language inference framework that fuses sentence-level tasks into a set of sentence-based tasks.
Outcome: The proposed framework improves interpretability and performance with evidence.
CR-GIS: Improving Conversational Recommendation via Goal-aware Interest Sequence Modeling (2022.coling-1)

Copied to clipboard

Challenge: Existing methods to determine a goal item by sequentially tracking users’ interests ignore the rich goal-aware implicit interest sequence patterns in a dialog.
Approach: They propose to model goal-aware implicit user interest sequence patterns in a dialog and a hierarchical Star Transformer to guide multi-turn utterances generation.
Outcome: The proposed framework achieves more accurate recommendations with more fluent and coherent dialog utterances.
Hybrid Self-evolving Structured Memory for Computer-Use Agents (2026.findings-acl)

Copied to clipboard

Challenge: despite advances in vision–language models, real-world computer-use tasks remain challenging due to long-horizon workflows, diverse interfaces, and frequent intermediate errors.
Approach: They propose a graph-based memory that couples discrete symbolic nodes with continuous trajectory embeddings.
Outcome: The proposed system outperforms closed-source models in Qwen2.5-VL-7B and Gemini2.5-Pro-Vision on desktop and mobile platforms.
FinanceReasoning: Benchmarking Financial Numerical Reasoning More Credible, Comprehensive and Challenging (2025.acl-long)

Copied to clipboard

Challenge: Compared to existing benchmarks, FinanceReasoning provides three key advancements: (1) credibility; (2) comprehensiveness; (3) numerical precision; (4) complexity; (5) complexity; and (6) complexity.
Approach: They propose a benchmark to evaluate the reasoning capabilities of large reasoning models (LRMs) in financial numerical reasoning problems.
Outcome: The proposed benchmark exceeds existing benchmarks in 67.8% of financial concepts and formulas and is credible, comprehensive, and challenging.
TaxPraBen: A Scalable Benchmark for Structured Evaluation of LLMs in Chinese Real-World Tax Practice (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models excel in general domains but lack real-world practical capabilities.
Approach: They propose a benchmark for Chinese taxation practice that combines 10 traditional application tasks with 3 pioneering real-world scenarios.
Outcome: The proposed benchmark combines 10 traditional tasks with 3 pioneering real-world scenarios.
AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)

Copied to clipboard

Challenge: Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning.
Approach: AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks.
Outcome: Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% .
STORM-BORN: A Challenging Mathematical Derivations Dataset Curated via a Human-in-the-Loop Multi-Agent Framework (2025.findings-acl)

Copied to clipboard

Challenge: Existing datasets suffer from outdated and insufficient challenging content, neglecting human-like reasoning, and limited reliability due to single-LLM generation.
Approach: They propose a human-in-the-loop, multi-agent data generation framework that integrates reasoning-dense filters, multiagent collaboration, and human mathematicians’ evaluations to ensure the reliability and quality of the dataset.
Outcome: The proposed framework improves accuracy and quality of the 2,000-synthesized datasets by integrating reasoning-dense filters, multi-agent collaboration, and human mathematicians’ evaluations.
JARVIS or Ultron? A Survey on the Safety and Security Threats of Computer-Using Agents (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in computer-using agents have created new safety and security risks . despite the impressive capabilities of CUAs, there are still significant security risks.
Approach: They propose a systematization of knowledge on the safety and security threats of Computer-Using Agents.
Outcome: The proposed framework provides a framework for assessing the safety and security risks of computer-using agents.
Reinforcement Learning on Pre-Training Data (2026.acl-long)

Copied to clipboard

Challenge: Recent progress in large language models is driven by scaling of training compute through pre-training with nexttoken prediction (NTP) or post-training (RL) Pre-training using NTP enables models to acquire extensive knowledge and skills from general data, but it suffers from data inefficiency and catastrophic forgetting in continual learning settings.
Approach: They propose to scale training compute through pre-training with next-token prediction (NTP) or post-training by scaling reinforcement learning (RL) to improve learning from general data.
Outcome: Experiments on multiple benchmarks and models show that the proposed approach improves continual pre-training and provides a strong foundation for post-training on Qwen3-8B-Base.
Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Persona (2023.acl-long)

Copied to clipboard

Challenge: Existing personalized dialogue agents model persona profiles from sparse or dense persona descriptions and dialogue histories.
Approach: They propose a model that clusters dense persona descriptions into sparse categories and generates personalized responses from dialogue histories.
Outcome: The proposed model improves on Chinese and English datasets.
Context-Aware Hierarchical Taxonomy Generation for Scientific Papers via LLM-Guided Multi-Aspect Clustering (2025.emnlp-main)

Copied to clipboard

Challenge: Existing taxonomy construction methods lack coherence and granularity . Existing approaches rely on manual or narrowly defined schemes .
Approach: They propose a context-aware hierarchical taxonomy generation framework that integrates LLMs with dynamic clustering.
Outcome: The proposed method outperforms existing methods in taxonomy coherence, granularity, and interpretability.
TopKG: Target-oriented Dialog via Global Planning on Knowledge Graph (2022.coling-1)

Copied to clipboard

Challenge: Existing target-oriented dialogs take a local and greedy strategy for response generation, where global planning is absent.
Approach: They propose a global planning method for target-oriented dialog on a commonsense knowledge graph to adjust local response generation towards the global target.
Outcome: The proposed method can reach the target with a higher success rate, fewer turns, and more coherent responses.
DEMO: Reframing Dialogue Interaction with Fine-grained Element Modeling (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) enabled dialogue systems are one of the central modes in human-machine interaction.
Approach: They propose a benchmark task for dialogue element MOdeling and Element Awareness and a new benchmark for dialogue agent interaction that allows the agent to model dialogue elements via imitation learning.
Outcome: The proposed agent performs well in both dialogue element modeling and out-of-domain tasks.
Harder Task Needs More Experts: Dynamic Routing in MoE Models (2024.acl-long)

Copied to clipboard

Challenge: Unlike existing MoE approaches that rely on fixed TopK Routing, our dynamic expert selection framework dynamically allocates experts based on the confidence level in expert selection for each input.
Approach: They propose a dynamic expert selection framework that dynamically allocates experts based on the confidence level in expert selection for each input.
Outcome: The proposed method achieves an average improvement of 0.7% with less than 90% activated parameters and outperforms dense models in QA and machine translation tasks.
A Comparison between Pre-training and Large-scale Back-translation for Neural Machine Translation (2021.findings-acl)

Copied to clipboard

Challenge: BERT is a promising technique to improve NMT, but how it outperforms standard NMT is understudied.
Approach: We compare MT engines trained with pre-trained BERT and back-translation with incrementally larger amounts of data.
Outcome: The proposed technique outperforms standard NMT models on morphology and syntax.
Question Tells You Where the Answer Is: Intention-aware Long-Context KV Cache Compression (2026.acl-long)

Copied to clipboard

Challenge: Recent methods to reduce the KV cache size fail to identify crucial KVs for generation while excluding others accurately, resulting in severe information loss.
Approach: They propose an intention-aware KV cache eviction method that identifies and retains crucial KVs according to the attention distribution of intention, which semantically reflects the user’s goal and determines which part of the context is relevant.
Outcome: The proposed method can maintain the model performance while reducing the KV cache size from 128K to 2K, leading to a 6.3x increase in decoding speed and 7.8x enhancement in memory efficiency compared to the default setting.
SoMeLVLM: A Large Vision Language Model for Social Media Processing (2024.findings-acl)

Copied to clipboard

Challenge: Genereal domain large models lack nuanced multimodal understanding of social media . general domain models focus more on text than other modalities, which is not consistent with real-world user habits.
Approach: They propose a Large Vision Language Model for Social Media Processing that combines five key capabilities to understand and generate real social media behavior.
Outcome: The proposed model achieves state-of-the-art performance in multiple social media tasks.
MTGP: Multi-turn Target-oriented Dialogue Guided by Generative Global Path with Flexible Turns (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches focus on global planning, which plans toward the target before the conversation.
Approach: They propose to generate a global path as a natural language sentence instead of a sequence of nodes.
Outcome: The proposed method has fewer turns, more coherent semantics, and higher success rate than baselines.
Towards Effective and Efficient Continual Pre-training of Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Continual pre-training (CPT) has been an important approach for adapting language models to specific domains or tasks.
Approach: They propose a Continual pre-training method that can greatly improve Chinese language ability and scientific reasoning ability of LLMs.
Outcome: The proposed method can greatly improve Chinese language ability and scientific reasoning ability of LLMs.
Length Controlled Generation for Black-box LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing length control methods involve fine-tuning the parameters of LLMs, which is inefficient and suboptimal for practical use.
Approach: They propose an iterative sampling framework that regulates LLMs to generate length-constrained text without modifying the underlying parameters.
Outcome: The proposed method achieves 100% success rates on Llama3.1 tasks with minimal additional computational overhead.
KMatrix-2: A Comprehensive Heterogeneous Knowledge Collaborative Enhancement Toolkit for Large Language Model (2025.emnlp-demos)

Copied to clipboard

Challenge: Existing studies on K-LLMs systems focus on declarative knowledge and procedural knowledge (rules) .
Approach: They propose to build a toolkit that supports comprehensive heterogeneous knowledge collaborative enhancement for Large Language Models (LLMs).
Outcome: The proposed toolkit provides unified knowledge integration and joint knowledge retrieval methods to achieve more comprehensive heterogeneous knowledge collaborative enhancement.
SplitThenMerge: Token-Level Skill-Compositional Sparse Mixture-of-Experts for Complex Domain-Specific Tasks (2026.findings-acl)

Copied to clipboard

Challenge: Existing domain adaptation methods train heterogeneous skills together, making it difficult to reliably coordinate multiple skills when solving complex tasks.
Approach: They propose a framework that decomposes domain competence into atomic skills and composes them dynamically during generation.
Outcome: The proposed framework decomposes domain competence into atomic skills, trains them independently, and composes them dynamically during generation.
PuzzleClone: A DSL-Powered Framework for Synthesizing Verifiable Data (2026.findings-acl)

Copied to clipboard

Challenge: Existing datasets with verifiable answers are limited in reliability, diversity, and scalability . a new approach to generate verifikatable data at scale is needed to improve models' performance .
Approach: They propose a formal framework for synthesizing verifiable data at scale using a novel DSL-driven approach.
Outcome: The proposed framework improves performance on a wide range of puzzles and logic benchmarks.
Noisy-Labeled NER with Confidence Estimation (2021.naacl-main)

Copied to clipboard

Challenge: Recent studies in deep learning have shown significant progress in named entity recognition (NER) . however, most existing works assume clean data annotation, while real-world data typically involve a large amount of noises.
Approach: They propose a confidence estimation approach for named entity recognition using noisy labels using local and global independence assumptions.
Outcome: The proposed method marginalizes out labels of low confidence with a CRF model and integrates it into a self-training framework for boosting performance.
PASUM: A Pre-training Architecture for Social Media User Modeling Based on Text Graph (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies have incorporated different digital traces to better learn the representations of social media users, limited by overloaded text information and hard-to-collect social network information.
Approach: They propose a Pre-training Architecture for Social Media User Modeling based on Text Graph and combine microblogs to represent social media users based upon the text graph model.
Outcome: The proposed framework can represent users based on text even without social network information on microblogs.
What Have We Achieved on Text Summarization? (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for text summarization have been investigated, but there are still gaps between them and human professionals.
Approach: They analyze 8 major sources of errors on 10 representative summarization models manually.
Outcome: Aiming to gain more understanding of summarization systems with respect to their strengths and limitations on a fine-grained syntactic and semantic level, we use 8 major sources of errors on 10 representative summarizing models.
"I Don’t Know What to Say": A Fact-Filling Questionnaire Method to Help Non-Experts Talk to LegalAI Assistant (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have greatly expanded the scope of legal AI.
Approach: They propose a method that generates questionnaires to help users refine queries . they leverage an iterative training process that collects valuable questionnaires .
Outcome: The proposed method improves the completeness of queries and ensures the performance of domain-specific models in downstream legal tasks.
Structured Self-Supervised Pretraining for Commonsense Knowledge Graph Completion (2021.tacl-1)

Copied to clipboard

Challenge: Existing approaches focus on generating concepts that have direct and obvious relationships with existing concepts and lack an ability to generate unobvious concepts.
Approach: They propose a general graph-to-paths pretraining framework that leverages high-order structures in CKGs to capture high-level relationships between concepts.
Outcome: The proposed framework can capture high-order relationships between concepts in four special cases: long path, path-to-path, router, and graph-node-path.
Guiding Dialogue Agents to Complex Semantic Targets by Dynamically Completing Knowledge Graph (2023.findings-acl)

Copied to clipboard

Challenge: Existing knowledge graphs are incomplete in tracking complex semantic relations of the target-oriented dialogue.
Approach: They combine methods of knowledge retrieval and relationship prediction to construct a context-related dynamic KG and a metric to evaluate the tracked path automatically.
Outcome: The proposed method can control the agent more logically and smoothly toward the complex target.
Do Not Guess, Verify: Logic-Guided Adaptive Reasoning for Multimodal Misinformation Detection (2026.findings-acl)

Copied to clipboard

Challenge: Existing multimodal misinformation detection paradigms rely on passive aggregation of multimodal features and social signals.
Approach: They propose a verification-oriented framework that integrates large vision–language models into multimodal misinformation detection through explicit rationale-guided reasoning.
Outcome: The proposed framework outperforms state-of-the-art methods on multimodal misinformation detection benchmarks while significantly reducing computational cost.
Aligning Recommendation and Conversation via Dual Imitation (2022.emnlp-main)

Copied to clipboard

Challenge: Existing conversational recommendation systems ignore the advantage of user interest shift in connecting recommendation and conversation, leading to an ineffective loose coupling structure.
Approach: They propose a dual imitation to explicitly align recommendation and conversation paths . they propose to generate high-quality responses with accurate recommendations and coherent explanations .
Outcome: The proposed model outperforms the state-of-the-art models on recommendation and conversation performance with automatic, human, and novel explainability metrics.
Parrot: Enhancing Multi-Turn Instruction Following for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Existing studies overlook the multi-turn instruction following ability of large language models (LLMs) Extensive experiments show that Parrot improves current LLMs by up to 7.2% in multi- turn instruction following.
Approach: They propose a method for collecting multi-turn instructions that feature human-like queries, such as anaphora and ellipsis, and a context-aware preference optimization strategy to further enhance LLMs for complex queries.
Outcome: The proposed method improves existing LLMs by up to 7.2% in multi-turn instruction following.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations