Papers by Kun Kuang

37 papers
C2DLM: Causal Concept-Guided Diffusion Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Autoregressive (AR) and diffusion language models (DLMs) suffer from insufficient reasoning capabilities.
Approach: They propose a fully connected Diffusion Language Model that uses a concept-level causal graph to guide attention to learn causal relationships between concepts.
Outcome: The proposed model achieves a 12% improvement and 3.2 training speedup on the COT-OrderPerturb task, along with an average gain of 1.31% across six downstream reasoning tasks.
Learning to Solve Domain-Specific Calculation Problems with Knowledge-Intensive Programs Generator (2025.naacl-long)

Copied to clipboard

Challenge: Domain Large Language Models (LLMs) are developed for domain-specific tasks based on general LLMs, but it still requires professional knowledge to facilitate the expertise for some domain- specific tasks.
Approach: They propose a pipeline to solve domain-specific calculation problems with KIPG . they use it to extract key variables and calculate outcomes dependent on domain knowledge .
Outcome: The proposed pipeline solves domain-specific calculation problems more effectively . it generates knowledge-intensive programs according to the domain- specific documents .
Dependency Parsing as MRC-based Span-Span Prediction (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for dependency parsing address the issue that edges should be constructed at the text span/subtree level rather than word level.
Approach: They propose a method that constructs dependency trees by directly modeling span-span relations by modeling subtree-subtree relationships.
Outcome: The proposed method constructs dependency trees by modeling span-span relations . it can retrieve missing spans in the span proposal stage, which leads to higher recall .
Rewrite to Jailbreak: Discover Learnable and Transferable Implicit Harmfulness Instruction (2025.findings-acl)

Copied to clipboard

Challenge: Existing jailbreak methods create a forced instruction-following scenario, or search adversarial prompts with prefix or suffix tokens to achieve a specific representation manually or automatically.
Approach: They propose a method that rewrites the original instruction to achieve a jailbreak . they propose rewriting the original instructions to improve the attack strategy .
Outcome: The proposed method is more efficient and easier to identify since no additional features are introduced.
Tailoring Diagnostic Modeling to Individual Learners: Personalized Distractor Generation via MCTS-Guided Reasoning Reconstruction (2026.acl-long)

Copied to clipboard

Challenge: Current distractor generation methods produce shared distractors for all students, ignoring individual variations in reasoning, which limits their diagnostic effectiveness.
Approach: They propose a method which tailors distractors to each student’s specific cognitive flaws, inferred from their past question-answering (QA) history.
Outcome: The proposed framework outperforms existing methods in generating plausible distractors and adapts to group-level settings.
Evolving Knowledge Distillation with Large Language Models and Active Learning (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies have focused on the direct use of large language models for text generation and labeling, without fully exploring their potential to comprehend the target task and acquire valuable knowledge.
Approach: They propose to distill the knowledge of large language models into smaller models by generating annotated data.
Outcome: The proposed method improves the performance of small domain models while enhancing the ability of large language models.
De-Biased Court’s View Generation with Causality (2020.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to court’s view generation can be used to address this problem, but neglecting the confounding bias in data can limit the model performance and pollute learning outcomes.
Approach: They propose a novel Attentional and Counterfactual based Natural Language Generation method consisting of an attentional encoder and a pair of innovative counterfactual decoders to generate judgment-discriminative court's views.
Outcome: The proposed method is able to generate judgment-discriminative court's views (both supportive and non-supportive views) under both quantitative and qualitative evaluation metrics.
Enhancing Court View Generation with Knowledge Injection and Guidance (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods of natural language generation (NLG) rely on the extensive parameters of pretrained language models (PLMs) but their effectiveness may be compromised by insufficient domain-specific knowledge.
Approach: They propose a knowledge-injected prompt encoder to incorporate domain knowledge during the training stage, thereby reducing computational overhead.
Outcome: The proposed approach outperforms established baselines on real-world data in responsivity of claims and in the ability to transfer domain knowledge.
From Graph to Word Bag: Introducing Domain Knowledge to Confusing Charge Prediction (2024.lrec-main)

Copied to clipboard

Challenge: Existing charge prediction methods have shown impressive performance, but they face significant challenges when dealing with confusing charges, such as Snatch and Robbery.
Approach: They propose a novel approach which introduces domain knowledge regarding constituent elements to guide the model in making judgments on confusing charges, much like a judge’s reasoning process.
Outcome: The proposed approach maintains exceptional performance in imbalanced label distributions.
Gold Panning in Vocabulary: An Adaptive Method for Vocabulary Expansion of Domain-Specific LLMs (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) struggle when it comes to specialized domains due to limited domain-specific knowledge.
Approach: They propose an adaptive method that automatically identifies valuable words from a given domain vocabulary.
Outcome: The proposed method has been validated on three Chinese datasets and performed on general tasks.
Towards Interactivity and Interpretability: A Rationale-based Legal Judgment Prediction Framework (2022.emnlp-main)

Copied to clipboard

Challenge: Existing models lack interpretability due to the neglect of rationale in the prediction process.
Approach: They propose a rationale-based legal judgment prediction framework that follows the judge's real trial logic and provides good interactivity and interpretability.
Outcome: The proposed framework provides good interactivity and interpretability which enables practical use.
LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wild (2024.findings-acl)

Copied to clipboard

Challenge: Low-Rank Adaptation (LoRA) is an effective yet efficient solution for fine-tuning large language models.
Approach: They propose a low-rank Adaptation framework that retrieves and composes multiple LoRAs according to input prompts.
Outcome: Experimental results show that LoraRetriever outperforms baselines in terms of performance and versatility.
Investigating the Robustness of Natural Language Generation from Logical Forms via Counterfactual Samples (2022.emnlp-main)

Copied to clipboard

Challenge: State-of-the-art methods based on pre-trained models have achieved remarkable performance on the standard test dataset.
Approach: They propose to incorporate hierarchical structure of logical forms into the model and exploit automatically generated counterfactual data for training.
Outcome: The proposed method is effective to alleviate spurious correlations between the headers of the tables and operators of the logical form.
UniLR: Unleashing the Power of LLMs on Multiple Legal Tasks with a Unified Legal Retriever (2025.acl-long)

Copied to clipboard

Challenge: Existing retrieval methods are designed for general domains, struggling with legal knowledge, or tailored for specific legal tasks, unable to handle diverse legal knowledge types.
Approach: They propose a novel retrieval method that integrates specialized knowledge into LLMs.
Outcome: The proposed method can perform multiple legal retrieval tasks for LLMs.
Unleashing the Power of LLMs in Court View Generation by Stimulating Internal Knowledge and Incorporating External Knowledge (2024.findings-naacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have made remarkable strides in language generation, but they encounter difficulties in the knowledge-intensive legal domain.
Approach: They propose to decompose court views into different parts, stimulate internal knowledge, and incorporate external information to unleash the power of LLMs in the task.
Outcome: The proposed method generates more accurate and reliable court views on two real-world datasets LAIC2021 and CJO2022.
RexUIE: A Recursive Method with Explicit Schema Instructor for Universal Information Extraction (2023.findings-emnlp)

Copied to clipboard

Challenge: Named Entity Recognition (NER) and Relation Extraction (RE) models have limited success when extracting general schemas such as quadruples and quintuples.
Approach: They propose a formal formulation that covers almost all extraction schemas and a Recursive Method with Explicit Schema Instructor for UIE.
Outcome: The proposed method shows strong performance under full-shot and few-shot settings and achieves state-of-the-art results on the tasks of extracting complex schemas.
More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs (2024.emnlp-main)

Copied to clipboard

Challenge: a recent study shows that performance on general tasks decreases after Large Language Models are fine-tuned on domain-specific tasks.
Approach: They propose a general capability integration approach to integrate general capabilities and domain knowledge within a single instance.
Outcome: The proposed method improves performance on domain-specific tasks by integrating general capabilities and domain knowledge.
CoEvo: Coevolution of LLM and Retrieval Model for Domain-Specific Information Retrieval (2025.emnlp-main)

Copied to clipboard

Challenge: Recent methods to enhance queries by generating intermediary elements can degrade retrieval performance . combining LLMs and retrievers can be difficult, resulting in unreliable or irrelevant intermediaries .
Approach: They propose a framework that facilitates the coevolution of large language models and retrieval models.
Outcome: The proposed framework facilitates the coevolution of LLMs and retrieval models.
Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaboration (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in deep learning have enabled a variety of techniques to be used to solve the LJP task.
Approach: They propose a framework that leverages the strength of both LLMs and domain-specific models in the context of precedents.
Outcome: The proposed framework leverages the strength of both LLM and domain models in the context of precedents.
SoMeLVLM: A Large Vision Language Model for Social Media Processing (2024.findings-acl)

Copied to clipboard

Challenge: Genereal domain large models lack nuanced multimodal understanding of social media . general domain models focus more on text than other modalities, which is not consistent with real-world user habits.
Approach: They propose a Large Vision Language Model for Social Media Processing that combines five key capabilities to understand and generate real social media behavior.
Outcome: The proposed model achieves state-of-the-art performance in multiple social media tasks.
RED: Unleashing Token-Level Rewards from Holistic Feedback via Reward Redistribution (2025.emnlp-main)

Copied to clipboard

Challenge: Experimental results demonstrate the superiority of our approach to aligning large language models with human preferences.
Approach: They propose a method that evaluates and assigns specific credit to each token using an off-the-shelf reward model.
Outcome: The proposed method evaluates and assigns specific credit to each token using an off-the-shelf reward model.
ClaimGen-CN: A Large-scale Chinese Dataset for Legal Claim Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Currently, legal claims are not being used by non-professionals.
Approach: They construct a dataset for Chinese legal claim generation task and then use it to evaluate the generated claims.
Outcome: The proposed dataset is the first for the Chinese legal claim generation task and will be made publicly available.
Fine-tuning Large Language Models for Improving Factuality in Legal Question Answering (2025.coling-main)

Copied to clipboard

Challenge: Hallucination remains a critical challenge in large language models (LLMs) in high-stake domains such as legal question answering.
Approach: They propose a method to mitigate hallucination in legal question answering by using behavior cloning and a novel Hard Sample-aware Direct Preference Optimization.
Outcome: The proposed method improves non-hallucinated Statute Rate, Statute Relevance Rate, Legal Claim Truthfulness, and traditional metrics.
Optimizing Language Models with Fair and Stable Reward Composition in Reinforcement Learning (2024.emnlp-main)

Copied to clipboard

Challenge: Recent research has developed algorithms for reinforcement learning from human feedback and AI-generated feedback.
Approach: They propose a method for reinforcement learning from human feedback and AI-generated feedback that incorporates weighting, ranking, and constraining to handle disparate rewards.
Outcome: The proposed method reduces disparity and enhances stability among rewards . empirical results show that the proposed method is efficient and straightforward .
SplitThenMerge: Token-Level Skill-Compositional Sparse Mixture-of-Experts for Complex Domain-Specific Tasks (2026.findings-acl)

Copied to clipboard

Challenge: Existing domain adaptation methods train heterogeneous skills together, making it difficult to reliably coordinate multiple skills when solving complex tasks.
Approach: They propose a framework that decomposes domain competence into atomic skills and composes them dynamically during generation.
Outcome: The proposed framework decomposes domain competence into atomic skills, trains them independently, and composes them dynamically during generation.
LeCoDe: A Benchmark Dataset for Interactive Legal Consultation Dialogue Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Current systems for legal consultation are insufficient to handle the knowledge-intensive nature of real-world consultations.
Approach: They propose a multi-turn benchmark dataset to evaluate LLMs in legal consultation settings.
Outcome: The proposed framework assesses LLMs’ consultation capabilities in terms of (1) clarification capability and (2) professional advice quality.
BertGCN: Transductive Text Classification by Combining GNN and BERT (2021.findings-acl)

Copied to clipboard

Challenge: Text classification is a core task in natural language processing (NLP) Graph neural networks (GNNs) serve as an effective approach for transductive learning.
Approach: They propose a model that combines large scale pretraining and transductive learning for text classification.
Outcome: The proposed model achieves SOTA performance on a wide range of datasets.
Chain-of-Quizzes: Pedagogy-inspired Example Selection in In-Context-Learning (2024.findings-acl)

Copied to clipboard

Challenge: In-context learning (ICL) is a powerful tool for enhancing large language models (LLMs) by mimicking the human learning process.
Approach: They propose a Chain-of-Quizzes framework that uses LLMs to answer a quiz to sift 'good' examples, combine them iteratively with the increasing complexity, and utilize a final exam to gauge the combined example chains.
Outcome: The proposed framework outperforms baseline models on diverse reasoning datasets and shows that it is scalable and can be used in future research.
Exploiting Contrastive Learning and Numerical Evidence for Confusing Legal Judgment Prediction (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies fail to distinguish different classification errors with a standard cross-entropy classification loss and ignore the numbers in the fact description for predicting the term of penalty.
Approach: They propose to extract crime amounts from fact description and use them to learn distinguishable representations to exploit the numbers in the fact description for predicting the term of penalty.
Outcome: The proposed method achieves state-of-the-art results on real-world datasets and ablation studies demonstrate the effectiveness of each component.
Latent Learningscape Guided In-context Learning (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods to select demonstrations based on surface-level semantic similarities fall short of identifying the most fitting ones.
Approach: They propose a method that characterizes latent learningscape features of demonstrations and uses them to create more effective prompts.
Outcome: The proposed method outperforms leading models in arithmetic, commonsense, and symbolic reasoning tasks showing an average increase in scores by 7.4 percentage points.
Legal Judgment Prediction based on Knowledge-enhanced Multi-Task and Multi-Label Text Classification (2025.naacl-long)

Copied to clipboard

Challenge: Legal judgment prediction (LJP) is an essential task for legal AI, aiming at predicting judgments based on the facts of a case.
Approach: They propose a knowledge-enhanced approach that incorporates 'label-level knowledge' to enhance the representation of case facts for each task and 'task-level' knowledge to improve synergy.
Outcome: The proposed method is effective in comparison to state-of-the-art (SOTA) baselines.
Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are becoming increasingly popular in education, enabling researchers to simulate students' learning patterns and learning patterns.
Approach: They propose a training-free framework for student simulation that takes into account student cognitive diversity and realism.
Outcome: The proposed model outperforms baseline models and achieves 100% improvement in simulation accuracy and realism.
Focus-aware Response Generation in Inquiry Conversation (2023.findings-acl)

Copied to clipboard

Challenge: Existing studies on response generation focus on relevance and fluency, rarely paying attention to the focus.
Approach: They propose a Focus-aware response generation method that takes the focus into consideration and optimizes a multi-level encoder and focal decoder to generate multiple candidate responses.
Outcome: The proposed method generates candidate responses that correspond to different focuses and performs better on two orthogonal inquiry conversation datasets.
Evaluating Test-Time Scaling LLMs for Legal Reasoning: OpenAI o1, DeepSeek-R1, and Beyond (2025.findings-emnlp)

Copied to clipboard

Challenge: Experimental results show that Legal-R1 delivers competitive performance across diverse tasks.
Approach: They propose to evaluate 12 large language models across 17 legal tasks across statutory and case-law traditions to determine their general reasoning performance.
Outcome: The proposed model performs well across 17 legal tasks across statutory and case-law traditions.
"I Don’t Know What to Say": A Fact-Filling Questionnaire Method to Help Non-Experts Talk to LegalAI Assistant (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have greatly expanded the scope of legal AI.
Approach: They propose a method that generates questionnaires to help users refine queries . they leverage an iterative training process that collects valuable questionnaires .
Outcome: The proposed method improves the completeness of queries and ensures the performance of domain-specific models in downstream legal tasks.
OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use (2025.acl-long)

Copied to clipboard

Challenge: a new generation of (M)LLMs is enabling the creation of superintelligent AI assistants . OS Agents can complete tasks autonomously and have the potential to significantly enhance the lives of billions of users worldwide.
Approach: They propose to build OS Agents that operate within operating systems' GUIs and GUIs . they examine evaluation metrics and benchmarks to identify promising directions .
Outcome: The proposed agents are based on operating systems (OS) and operating systems frameworks.
CAT: Causal Attention Tuning For Injecting Fine-grained Causal Knowledge into Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing fine-tuning paradigms focus on aligning LLMs with task-specific objectives.
Approach: They propose a pipeline that leverages human priors to automatically generate token-level causal signals and introduce the Re-Attention mechanism to guide training.
Outcome: The proposed pipeline achieves an average improvement of 5.76% on the STG dataset and 1.56% on downstream tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations