Papers by Chunyang Chen
D2PCM:A Multi-Turn Dialogue Dataset with Personalized Contextual Memory (2026.findings-acl)
Copied to clipboard
| Challenge: | Conventional interactive algorithms have predominantly treated memory as a contextual element, neglecting the nuanced cognitive processes involved in individualized memory encoding and retrieval. |
| Approach: | They propose a multi-turn dialogue dataset with Personalized Contextual Memory to facilitate advanced research on personalized memory processing. |
| Outcome: | The proposed datasets provide a comprehensive benchmark to facilitate advanced research on personalized memory processing. |
A Semantic-Aware Layer-Freezing Approach to Computation-Efficient Fine-Tuning of Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing work on how to finetune but neglects the issue of where to fine-tune language models is expensive. |
| Approach: | They propose to use transition traces of latent representation to compute deviations (or loss) and then estimate the gain of each layer in reducing deviation (or gain). |
| Outcome: | The proposed approach outperforms baseline methods and is cost-benefit balanced. |
AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora (2026.acl-long)
Copied to clipboard
Jiaxin Bai, Wei Fan, Qi Hu, Qing Zong, Chunyang Li, Hong Ting Tsang, Hongyu Luo, Yauwai Yim, Haoyu Huang, Xiao Zhou, Feng Qin, Tianshi Zheng, Xi Peng, Xin Yao, Huiwen Yang, Leijie Wu, JI Yi, Gong Zhang, Renhai Chen, Yangqiu Song
| Challenge: | Existing knowledge graph construction frameworks require predefined schemas, limiting their scalability and domain coverage. |
| Approach: | They propose a framework for fully autonomous knowledge graph construction that eliminates the need for predefined schemas. |
| Outcome: | The proposed framework outperforms state-of-the-art models on multi-hop QA tasks and enhances LLM factuality. |
Beyond Neural Incompatibility: Cross-Scale Knowledge Transfer in Large Language Models through Latent Semantic Alignment (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods that reuse layer parameters are limited by incompatibility . a central challenge is to make cross-scale knowledge transfer effective and efficient . |
| Approach: | They propose a method that uses latent semantic alignment to facilitate cross-scale knowledge transfer . they use activations to pair target and source layers in latent space to achieve alignment . |
| Outcome: | The proposed method is effective when source and target models differ in architecture and parameterization. |
FaLA: Fast Linear Adaptation for Replacing Backbone Models on Edge Devices (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Current NLP models heavily rely on pre-trained models, such as BERT and RoBERTa. |
| Approach: | They propose a lightweight method for personalized NLP classification tasks post-backbone replacement using a personalized matrix calculated from documents corresponding to users' old and new backbones. |
| Outcome: | The proposed method achieves over 1000 times computation reduction in Flops for backpropagation and brings the user-specific initialization for personal matrix yielding significant performance boost compared with popular transfer learning methods. |