Papers by Xinshuai Dong
Mitigating Data Sparsity for Short Text Topic Modeling by Topic-Semantic Contrastive Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing topic models do not make full use of word co-occurrence information to model latent topics. |
| Approach: | They propose a novel short text topic modeling framework, Topic-Semantic Contrastive Topic Model, which uses augmented data and the data characteristic to learn the relations among samples. |
| Outcome: | The proposed framework outperforms state-of-the-art baselines regardless of the data augmentation availability, producing high-quality topics and topic distributions. |
Gradient-Boosted Decision Tree for Listwise Context Model in Multimodal Review Helpfulness Prediction (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have shown that FCNNs perform inefficient splitting for review features, making it difficult to clearly differentiate helpful from unhelpful reviews. |
| Approach: | They propose a listwise attention network that captures the MRHP ranking context and a pairwise optimization objective that enhances model generalization. |
| Outcome: | The proposed framework achieves state-of-the-art results and polished generalization performance on two large-scale MRHP benchmark datasets. |
Modeling Dynamic Topics in Chain-Free Fashion by Evolution-Tracking Contrastive Learning and Unassociated Word Exclusion (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing dynamic topic models lack the ability to reveal the evolution of topics . Existing models suffer from repetitive topic and unassociated topic issues . |
| Approach: | They propose a new evolution-tracking contrastive learning method that builds the similarity relations among dynamic topics and an unassociated word exclusion method to avoid unassociated topics. |
| Outcome: | The proposed model outperforms state-of-the-art models on downstream tasks and is robust to evolution intensities. |
Representation Interventions Enable Lifelong Knowledge Memory Control in LLMs (2026.acl-long)
Copied to clipboard
Xuyuan Liu, Shengyu Chen, Xinshuai Dong, Yanchi Liu, Xujiang Zhao, Haoyu Wang, Yujun Yan, Haifeng Chen, Zhengzhang Chen
| Challenge: | Large language models (LLMs) produce outdated or inaccurate content. Updating their knowledge efficiently and accurately without costly retraining is a major challenge. |
| Approach: | They propose a robust and scalable method that treats knowledge control as interventions within the model’s representation space. |
| Outcome: | The proposed method achieves fine-grained control over complex, unstructured knowledge while maintaining general utility with frozen base weights. |
DemaFormer: Damped Exponential Moving Average Transformer with Energy-Based Modeling for Temporal Language Grounding (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Temporal Language Grounding (TLG) is a task to determine temporal boundaries of video moments that correspond to a language query. |
| Approach: | They propose an energy-based model framework to explicitly learn moment-query distributions. |
| Outcome: | The proposed model outperforms the state-of-the-art models on four public temporal language grounding datasets. |
Advancing Reasoning in Diffusion Language Models with Denoising Process Rewards (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for improving reasoning in diffusion language models rely on outcome-based rewards that provide no direct supervision over the denoising process. |
| Approach: | They propose a method that provides a process-level reinforcement signal over denoising trajectory of diffusion language models. |
| Outcome: | Experiments on challenging reasoning benchmarks show that the proposed model improves reasoning stability, interpretability and overall performance. |