Papers by Kun Jiang
ReFSQL: A Retrieval-Augmentation Framework for Text-to-SQL Generation (2023.findings-emnlp)
Copied to clipboard
Kun Zhang, Xiexiong Lin, Yuanzhuo Wang, Xin Zhang, Fei Sun, Cen Jianhe, Hexiang Tan, Xuhui Jiang, Huawei Shen
| Challenge: | Existing methods that align natural language with SQL Language underestimate inherent structural characteristics of SQL and lead to structure errors. |
| Approach: | They propose a retrieval-argument framework that aligns natural language with SQL Language and trains one encoder-decoder-based model to fit all questions. |
| Outcome: | The proposed framework improves accuracy and robustness of text-to-SQL generation on five datasets. |
TexSmart: A System for Enhanced Natural Language Understanding (2021.acl-demo)
Copied to clipboard
Lemao Liu, Haisong Zhang, Haiyun Jiang, Yangming Li, Enbo Zhao, Kun Xu, Linfeng Song, Suncong Zheng, Botong Zhou, Dick Zhu, Xiao Feng, Tao Chen, Tao Yang, Dong Yu, Feng Zhang, ZhanHui Kang, Shuming Shi
| Challenge: | TexSmart supports fine-grained named entity recognition (NER) Large-scale fine-granular entity types are expected to provide richer semantic information for downstream NLP applications. |
| Approach: | They introduce TexSmart, a text understanding system that supports fine-grained named entity recognition (NER) and enhanced semantic analysis functionalities. |
| Outcome: | The proposed system supports fine-grained named entity recognition (NER) and enhanced semantic analysis functions. |
A Unified Framework for Synaesthesia Analysis (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Synaesthesia is a cognitive phenomenon structuring human thought and action, which makes understanding it challenging. |
| Approach: | They propose a framework for annotating synaesthetic elements and exploring their relationship . they propose to include sensory modalities, cues and stimuli in the framework . |
| Outcome: | The proposed framework yields state-of-the-art results, demonstrating its effectiveness. |
Evolving Knowledge Distillation with Large Language Models and Active Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have focused on the direct use of large language models for text generation and labeling, without fully exploring their potential to comprehend the target task and acquire valuable knowledge. |
| Approach: | They propose to distill the knowledge of large language models into smaller models by generating annotated data. |
| Outcome: | The proposed method improves the performance of small domain models while enhancing the ability of large language models. |
StructGPT: A General Framework for Large Language Model to Reason over Structured Data (2023.emnlp-main)
Copied to clipboard
| Challenge: | Experiments conducted on three types of structured data show that StructGPT greatly improves the performance of LLMs. |
| Approach: | They propose an iterative Reading-then-Reasoning framework to solve question answering tasks based on structured data. |
| Outcome: | The proposed framework improves the reasoning ability of large language models over structured data under the few-shot and zero-shot settings. |
Emotion Transfer with Enhanced Prototype for Unseen Emotion Recognition in Conversation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing research on emotion recognition in conversation does not reach a consensus on classification theories . despite this, there is no clear consensus on how to recognize previously unseen emotions in real-world applications. |
| Approach: | They propose a prototype-based emotion transfer framework that can be used in real-world applications. |
| Outcome: | The proposed framework shows promise but still faces key challenges in the field of emotion recognition in conversation. |
KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge Graph (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to design the interaction strategy between large language models and knowledge graphs (KGs) are not effective for large language model (LLM)s to solve complex tasks due to the large volume and structured format of KG data. |
| Approach: | They propose an LLM-based agent framework that enables small LLMs to actively make decisions over knowledge graphs. |
| Outcome: | The proposed framework outperforms existing methods on in-domain and out-domain datasets using 10K samples. |
AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving (2025.findings-emnlp)
Copied to clipboard
Kangan Qian, Sicong Jiang, Yang Zhong, Ziang Luo, Zilin Huang, Tianze Zhu, Kun Jiang, Mengmeng Yang, Zheng Fu, Jinyu Miao, Yining Shi, He Zhe Lim, Li Liu, Tianbao Zhou, Hongyi Wang, Huang Yu, Yifei Hu, Guang Li, Guang Chen, Hao Ye, Lijun Sun, Diange Yang
| Challenge: | Vision-Language Models struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning. |
| Approach: | AgentThink integrates Chain-of-Thought reasoning with dynamic, agent-style tool invocation for autonomous driving tasks. |
| Outcome: | Experiments on the DriveLMM-o1 benchmark show AgentThink significantly boosts overall reasoning scores by 53.91% and enhances answer accuracy by 33.54% . |
Great~Truths~are ~Always ~Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Models (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to enhance pre-trained language models (PTMs) with a knowledge-aware graph neural network (GNN) encoder that models a commonsense knowledge graph (CSKG) can't explain how external knowledge resources improve the reasoning capacity of PTMs. |
| Approach: | They propose to use relation features from CSKGs to enhance the reasoning capacity of pre-trained language models (PTMs) by encoding a commonsense knowledge graph (CSKG) |
| Outcome: | The proposed approach reduces the parameters for encoding CSKGs and improves on five benchmarks. |
DyLex: Incorporating Dynamic Lexicons into BERT for Sequence Labeling (2021.emnlp-main)
Copied to clipboard
Baojun Wang, Zhao Zhang, Kun Xu, Guang-Yuan Hao, Yuyang Zhang, Lifeng Shang, Linlin Li, Xiao Chen, Xin Jiang, Qun Liu
| Challenge: | Existing approaches to integrate lexical knowledge into deep learning models are limited by large-scale dynamic lexicons. |
| Approach: | They propose a plug-in lexicon incorporation approach for BERT based sequence labeling tasks . they adopt word-agnostic tag embeddings to avoid re-training the representation . |
| Outcome: | The proposed framework achieves new SOTA even with large scale lexicons, the authors show . they adopt word-agnostic tag embeddings to avoid re-training the representation . |
Reinforcement Learning on Pre-Training Data (2026.acl-long)
Copied to clipboard
Siheng Li, Kejiao Li, Zenan Xu, Guanhua Huang, Kun Li, Haoyuan Wu, null Wujiajia, Zihao Zheng, Chenchen Zhang, Kun Shi, Xue Gong, Qi Yi, Ruibin Xiong, Tingqiang Xu, Yuhao Jiang, Jianfeng Yan, Yuyuan Zeng, Guanghui Xu, Jinbao Xue, Zhijiang xu, Zheng Fang, Shuai LI, Qibin Liu, Xiaoxue Li, Zhuoyu Li, Yangyu Tao, Fei Gao, Cheng Jiang, Bochao Wang, Kai Liu, Jianchen Zhu, Wai Lam, Bo Zhou, Di Wang
| Challenge: | Recent progress in large language models is driven by scaling of training compute through pre-training with nexttoken prediction (NTP) or post-training (RL) Pre-training using NTP enables models to acquire extensive knowledge and skills from general data, but it suffers from data inefficiency and catastrophic forgetting in continual learning settings. |
| Approach: | They propose to scale training compute through pre-training with next-token prediction (NTP) or post-training by scaling reinforcement learning (RL) to improve learning from general data. |
| Outcome: | Experiments on multiple benchmarks and models show that the proposed approach improves continual pre-training and provides a strong foundation for post-training on Qwen3-8B-Base. |
YuLan-Mini: Pushing the Limits of Open Data-efficient Language Model (2025.acl-long)
Copied to clipboard
Hu Yiwen, Huatong Song, Jie Chen, Jia Deng, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Zican Dong, Yang Lu, Xu Miao, Xin Zhao, Ji-Rong Wen
| Challenge: | prevailing pre-training approaches for large language models involve several complexities. |
| Approach: | They propose a low-cost training recipe and a robust optimization approach to mitigate training instability . they also propose synthesis, curriculum, and data selection pipelines to integrate data . |
| Outcome: | The proposed model achieves top-tier performance among models with similar parameter scale . it is comparable to industry-leading models that require significantly more data . |
InspireDebate: Multi-Dimensional Subjective-Objective Evaluation-Guided Reasoning and Optimization for Debating (2025.acl-long)
Copied to clipboard
| Challenge: | Existing LLMs focus on responding to specific arguments while neglecting objective assessments such as authenticity and logical validity. |
| Approach: | They propose a multi-dimensional evaluation system and an optimized debating framework . they propose to use coT reasoning enhancement, web-based Retrieval Augmented Generation to optimize across various dimensions. |
| Outcome: | The proposed framework outperforms baseline models in argument quality assessment and debate process simulation by 57%. |
Meta-CQG: A Meta-Learning Framework for Complex Question Generation over Knowledge Bases (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods train one encoder-decoder-based model to fit all questions . however, such a one-size-fits-all strategy may not perform well for complex questions involving multiple KB relations or functional constraints. |
| Approach: | They propose a meta-learning framework for complex question generation over knowledge bases . they propose he meta-trained generator can acquire universal meta-knowledge . |
| Outcome: | The proposed framework can acquire universal and transferable meta-knowledge and quickly adapt to long-tailed samples under different dimensions. |
Towards Effective and Efficient Continual Pre-training of Large Language Models (2025.acl-long)
Copied to clipboard
Jie Chen, Zhipeng Chen, Jiapeng Wang, Kun Zhou, Yutao Zhu, Jinhao Jiang, Yingqian Min, Xin Zhao, Zhicheng Dou, Jiaxin Mao, Yankai Lin, Ruihua Song, Jun Xu, Xu Chen, Rui Yan, Zhewei Wei, Di Hu, Wenbing Huang, Ji-Rong Wen
| Challenge: | Continual pre-training (CPT) has been an important approach for adapting language models to specific domains or tasks. |
| Approach: | They propose a Continual pre-training method that can greatly improve Chinese language ability and scientific reasoning ability of LLMs. |
| Outcome: | The proposed method can greatly improve Chinese language ability and scientific reasoning ability of LLMs. |
On the In-context Generation of Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have the ability of in-context generation (ICG) when given an in-text prompt, they can implicitly recognize the pattern of the examples and complete the prompt in the desired way. |
| Approach: | They propose a plausible latent variable model to model the distribution of pretrained corpora and formalize ICG as a problem of next topic prediction. |
| Outcome: | The proposed model can model the distribution of pretrained corpora and then formalize ICG as a problem of next topic prediction. |
Can LLMs Really Judge? A Progressive Argumentation-Mining Framework for Distinguishing Understanding from Aggregation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluations of large language models rely on dataset-based generation accuracy . however, generative correctness does not guarantee discriminative capability to verify solutions . |
| Approach: | They propose a diagnostic framework that explicitly controls context and isolates discriminative behaviors. |
| Outcome: | The proposed framework explicitly controls context and isolates discriminative behaviors. |
LeCoDe: A Benchmark Dataset for Interactive Legal Consultation Dialogue Evaluation (2026.acl-long)
Copied to clipboard
Weikang Yuan, Kaisong Song, Zhuoren Jiang, Junjie Cao, Yujie Zhang, Jun Lin, Kun Kuang, Ji Zhang, Xiaozhong Liu
| Challenge: | Current systems for legal consultation are insufficient to handle the knowledge-intensive nature of real-world consultations. |
| Approach: | They propose a multi-turn benchmark dataset to evaluate LLMs in legal consultation settings. |
| Outcome: | The proposed framework assesses LLMs’ consultation capabilities in terms of (1) clarification capability and (2) professional advice quality. |
Latent Attention Denoising: A Training-Free Energy-Based Framework for Mitigating Hallucinations in Vision-Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing models for large vision-Language Models lack reliable visual hallucination . despite advances in multimodal perception, they are still limited in real-world applications . |
| Approach: | They propose a framework that recasts attention calibration as a one-step score-based denoising process. |
| Outcome: | The proposed framework achieves superior performance on generative and discriminative tasks while maintaining efficiency comparable to standard decoding. |
Latent Learningscape Guided In-context Learning (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to select demonstrations based on surface-level semantic similarities fall short of identifying the most fitting ones. |
| Approach: | They propose a method that characterizes latent learningscape features of demonstrations and uses them to create more effective prompts. |
| Outcome: | The proposed method outperforms leading models in arithmetic, commonsense, and symbolic reasoning tasks showing an average increase in scores by 7.4 percentage points. |
Following the Autoregressive Nature of LLM Embeddings via Compression and Alignment (2025.emnlp-main)
Copied to clipboard
Jingcheng Deng, Zhongtao Jiang, Liang Pang, Zihao Wei, Liwei Chen, Kun Xu, Yang Song, Huawei Shen, Xueqi Cheng
| Challenge: | Experimental results demonstrate that our method significantly outperforms traditional contrastive learning approaches when using the same amount of data. |
| Approach: | They propose a new contrastive learning method built on embedding conditional probability distributions that integrates two tasks: information compression and conditional distribution alignment. |
| Outcome: | The proposed method outperforms traditional contrastive learning approaches and achieves comparable performance to state-of-the-art models when using the same amount of data. |
Few-shot Temporal Pruning Accelerates Diffusion Models for Text Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing acceleration methods for text generation ignore the importance of the distribution of sampling steps, resulting in slow sampling rates. |
| Approach: | They propose a technique to accelerate diffusion models for text generation without additional training by using a Bayesian optimization approach. |
| Outcome: | The proposed technique achieves 400x acceleration even with minimal sampling steps after down to less than 1 minute of optimization yielding a competitive performance even with minimum sampling steps. |
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)
Copied to clipboard
Xueyu Hu, Tao Xiong, Biao Yi, Zishu Wei, Ruixuan Xiao, Yurun Chen, Jiasheng Ye, Meiling Tao, Xiangxin Zhou, Ziyu Zhao, Yuhuai Li, Shengze Xu, Shenzhi Wang, Xinchen Xu, Shuofei Qiao, Zhaokai Wang, Kun Kuang, Tieyong Zeng, Liang Wang, Jiwei Li, Yuchen Eleanor Jiang, Wangchunshu Zhou, Guoyin Wang, Keting Yin, Zhou Zhao, Hongxia Yang, Fan Wu, Shengyu Zhang, Fei Wu
| Challenge: | a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide. |
| Approach: | They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions . |
| Outcome: | The proposed agents are based on operating systems (OS) and operating systems frameworks. |
ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graph (2023.emnlp-main)
Copied to clipboard
| Challenge: | Question Answering over Knowledge Graph (KGQA) aims to find answer entities for natural language questions based on knowledge graphs. |
| Approach: | They propose a subgraph-aware self-attention mechanism to imitate the graph neural network (GNN) based module to perform multi-hop reasoning on KG. |
| Outcome: | The proposed method surpasses state-of-the-art models by a large margin even with fewer updated parameters and less training data. |
BackdoorAgent: A Unified Framework for Backdoor Attacks on LLM-based Agents (2026.findings-acl)
Copied to clipboard
Yunhao Feng, Yige Li, Yutao Wu, Yingshui Tan, Yanming Guo, Yifan Ding, Kun Zhai, Xingjun Ma, Yu-Gang Jiang
| Challenge: | Large language model (LLM) agents execute tasks through multi-step workflows that combine planning, memory, and tool use. |
| Approach: | They propose a modular framework that provides a unified view of backdoor threats in LLM agents. |
| Outcome: | The proposed framework provides a unified, agent-centric view of backdoor threats in LLM agents. |