Papers by Xiusheng Huang
Named Entity Recognition via Noise Aware Training Mechanism with Data Filter (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition (NER) do not distinguish noisy from hard samples. |
| Approach: | They propose a noise-aware-with-filter method to help model identify noisy samples . they propose 'incomplete trust' loss function which boosts L CRF with a robust term . |
| Outcome: | The proposed method outperforms the existing methods on six real-world Chinese and English NER datasets. |
Know-MRI: A Knowledge Mechanisms Revealer&Interpreter for Large Language Models (2025.acl-demo)
Copied to clipboard
Jiaxiang Liu, Boxuan Xing, Chenhao Yuan, ChenxiangZhang ChenxiangZhang, Di Wu, Xiusheng Huang, Haida Yu, Chuhan Lang, Pengfei Cao, Jun Zhao, Kang Liu
| Challenge: | Existing interpretation methods only support tasks with specific inputs, limiting their practical applications. |
| Approach: | They propose an extensible module that matches different input data with interpretation methods and consolidates the interpreting outputs. |
| Outcome: | The proposed module can match different input data with interpretation methods and consolidate the interpreting outputs. |
If an LLM Were a Character, Would It Know Its Own Story? Evaluating Lifelong Learning in LLMs (2026.acl-long)
Copied to clipboard
Siqi Fan, Xiusheng Huang, Yiqun Yao, Xuezhi Fang, Kang Liu, Peng Han, Shuo Shang, Aixin Sun, Yequan Wang
| Challenge: | Existing benchmarks for large language models (LLMs) fail to capture these dynamics, focusing on static, open-ended evaluations. |
| Approach: | They propose a benchmark to assess lifelong learning in large language models . they use two episodic datasets rich in narrative structure and character interactions . |
| Outcome: | Experiments on LLMs show that non-parametric methods outperform parametric ones in managing stateful learning. |
HiSVD: Principled Low-Rank Approximation of LLMs via Hierarchical Modeling of Information Capacity and Spectral Structure (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for generating layer importance ignore the fine-grained influence of spectral distribution shape. |
| Approach: | They propose a hierarchical rank allocation framework with two stages to address this gap . they propose SVD-based lowrank approximation that exploits spectral heterogeneity . |
| Outcome: | Experiments show that HiSVD outperforms state-of-the-art methods on LLMs . |
Break Through the Compression Bottleneck: From Theory to Practice (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing compression methods suffer from bottleneck issues when compression ratio is increased. |
| Approach: | They propose a novel approach to combine low-rank decomposition and quantization methods to reduce the compression bottleneck. |
| Outcome: | The proposed method reduces the computational and memory overhead of existing methods while maintaining model accuracy. |
Document-Level Relation Extraction via Pair-Aware and Entity-Enhanced Representation Learning (2022.coling-1)
Copied to clipboard
| Challenge: | Existing document-level relation extraction methods are sparse in relational entity pairs and the representation of entity pairs is insufficient. |
| Approach: | They propose a Pair-Aware and Entity-Enhanced(PAEE) model to solve two challenges . they propose predicting potential relational entity pairs and assembling directional entity pairs . |
| Outcome: | The proposed model can obtain state-of-the-art performance on four benchmark datasets . it can predict potential relational entity pairs and assemble directional entity pairs . |
Theory-optimal Quantization Based on Flatness (2026.acl-long)
Copied to clipboard
| Challenge: | Recent approaches to quantization of Large Language Models (LLMs) have been widely adopted due to activation outliers, which degrade model performance especially at lower bit precision. |
| Approach: | They propose a new metric for quantization that strategically distributes outlier magnitudes across matrix dimensions via optimized diagonal operations. |
| Outcome: | The proposed framework achieves less than 1% accuracy drop in W4A4 quantization on the LLaMA-3-8B model and reduces the performance gap by 39.1% on the more challenging W2A4KV16 model. |
Commonsense Knowledge Editing Based on Free-Text in LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge editing methods focus on editing triple-based facts such as entity-relation pairs and events (multiple triplets). |
| Approach: | They propose a Knowledge Localization for Free-Text method which uses a Dynamics-aware Module to locate the parameter positions corresponding to commonsense knowledge and a knowledge editing module to update knowledge. |
| Outcome: | The proposed method exploits the potential of the MLP and Attention layers and edits commonsense knowledge based on free-text. |