Papers by Jing Wan

10 papers
CroAno : A Crowd Annotation Platform for Improving Label Consistency of Chinese NER Dataset (2021.emnlp-demo)

Copied to clipboard

Challenge: Existing crowd annotation tools for named entity recognition (NER) focus on efficiency and don't consider consistency of datasets.
Approach: They propose a crowd annotation platform for Chinese named entity recognition (NER) CroAno provides a systematic solution for improving label consistency of Chinese NER datasets.
Outcome: The proposed platform improves label consistency of Chinese NER datasets.
ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Currently, tool-augmented large language models (LLMs) only achieve total scores of 45.3 and 37.0, respectively, on a scale of 100.
Approach: They propose a multi-level diagnostic process to assess the LLM's hallucinations through two perspectives: depth and breadth.
Outcome: The proposed diagnostic process assesses the hallucinations of large language models through two perspectives: depth and breadth.
Flipping Knowledge Distillation: Leveraging Small Models’ Expertise to Enhance LLMs in Text Matching (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable capabilities in acquiring diverse knowledge, making them highly effective across a wide range of tasks.
Approach: They propose a flipped knowledge distillation paradigm where LLM learns from SLM . they propose to reinterpret LLMs as encoder-decoder models using LoRA .
Outcome: The proposed model has been deployed in an online application environment and validated on financial and healthcare benchmarks and real-world applications.
SrDetection: A Self-Referential Framework for Data Leakage Detection in Code Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for evaluating code large language models assume access to proprietary training corpora or use external reference sets with manually tuned, non-generalizable thresholds.
Approach: They propose a framework for self-referential leakage detection for gray-box and black-box settings.
Outcome: The proposed framework improves average F1 by 21.52 points in the gray-box setting and 14.46 points in black-box settings over strong baselines.
UNComp: Can Matrix Entropy Uncover Sparsity? — A Compressor Design from an Uncertainty-Aware Perspective (2025.emnlp-main)

Copied to clipboard

Challenge: Deploying large language models (LLMs) for long-context inference remains challenging due to their substantial memory and computational demands.
Approach: They propose an uncertainty-aware framework that leverages truncated matrix entropy to identify areas of low information content.
Outcome: The proposed framework reduces the KV cache size to 4.74% of the original and achieves a 6% speedup.
MEIT: Multimodal Electrocardiogram Instruction Tuning on Large Language Models for Report Generation (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies have focused on classifying cardiac conditions using ECG data but have overlooked ECG report generation, which is time-consuming and requires clinical expertise.
Approach: They propose a Multimodal ECG Instruction Tuning framework that extends the capability of large language models (LLMs) for the task.
Outcome: The proposed framework outperforms open-source LLMs and LLM backbones across two large-scale ECG datasets.
LLM Inductive Reasoning Through Multi-Agent Enhanced Monte Carlo Tree Search (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for enhancing inductive reasoning of large language models often lack explicit optimization guidance and effective error correction.
Approach: They propose a plug-and-play test-time framework that integrates multi-agent coordination with Monte Carlo Tree Search to improve inductive reasoning.
Outcome: The proposed framework outperforms existing methods on four benchmarks and shows consistent improvements on QWQ-32B and Deepseek-V3 .
When Cantonese NLP Meets Pre-training: Progress and Challenges (2022.aacl-tutorials)

Copied to clipboard

Challenge: Cantonese is an influential Chinese variant with a large population of speakers worldwide.
Approach: This tutorial will review Cantonese's progress in linguistics and NLP . it will introduce transformer-based pre-training methods for a wide range of downstream tasks .
Outcome: This tutorial will present the main challenges for Cantonese NLP in relation to Cantonesian language idiosyncrasies of colloquialism and multilingualism.
DAMON: A Dialogue-Aware MCTS Framework for Jailbreaking Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for multi-turn attacks mainly utilize a predefined dialogue pattern, limiting their effectiveness in realistic situations.
Approach: They propose a multi-turn jailbreak attack method that leverages Monte Carlo Tree Search to explore multi-turned conversational spaces and identifies sub-instruction sequences that induce harmful responses.
Outcome: The proposed method can induce undesired behaviors across five LLMs and three datasets.
Transferable Direct Prompt Injection via Activation-Guided MCMC Sampling (2025.emnlp-main)

Copied to clipboard

Challenge: Experimental results show superior cross-model transferability . Prompt injection attacks are among the most critical threats .
Approach: They propose an activations-guided prompt injection attack framework to address the impracticality of existing white-box/gray-box methods and the poor transferability of black-box approaches.
Outcome: The proposed framework achieves 49.6% success rate and 34.6% improvement over human-crafted prompts on five mainstream LLMs.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations