Papers by Shuyang Li
Interview: Large-scale Modeling of Media Dialog with Discourse Patterns and Knowledge Grounding (2020.emnlp-main)
Copied to clipboard
| Challenge: | Discourse analysis has been limited to small news corpora, but this study is expanding to tens of thousands of interviews. |
| Approach: | They propose a large-scale analysis of discourse in media dialog and its impact on dialog modeling with a focus on interrogative patterns and use of external knowledge. |
| Outcome: | The proposed model outperforms strong discourse-agnostic baselines for dialog modeling, generating more specific and topical responses in interview-style conversations. |
Zero-shot Generalization in Dialog State Tracking through Generative Question Answering (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for Dialog State Tracking do not generalize well to new domains and unseen slots. |
| Approach: | They propose an ontology-free framework that queries for unseen constraints and slots in multi-domain task-oriented dialogs using a conditional language model pre-trained on substantive English sentences. |
| Outcome: | The proposed framework improves goal accuracy in zero-shot domain adaptation settings by up to 9% over the previous state-of-the-art on the MultiWOZ 2.1 dataset. |
Self-Improvement of Non-autoregressive Model via Sequence-Level Distillation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing non-autoregressive Transformers (NAT) models generate the entire sequence in parallel, but the multimodality problem limits their performance. |
| Approach: | They propose a method to generate distilled data by the NAT model itself, eliminating the need for additional teacher networks. |
| Outcome: | The proposed method can generate distilled data by the NAT model without teacher networks and adapt to different NAT models without precise adjustments. |
SumCSE: Summary as a transformation for Contrastive Learning (2024.findings-naacl)
Copied to clipboard
| Challenge: | Sentence embedding models are typically trained using contrastive learning (CL) using human annotations directly or by repurposing other annotated datasets. |
| Approach: | They propose to use generative language models to generate CL data using annotated data. |
| Outcome: | The proposed method outperforms the previous best unsupervised method by 1.8 points and SimCSE, a strong supervised baseline by 0.3 points on the semantic text similarity (STS) benchmark. |
SHARE: a System for Hierarchical Assistive Recipe Editing (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing recipe websites do not provide options for users with dietary restrictions . a growing population follows some form of dietary restriction, with many people following it for a variety of reasons . |
| Approach: | They propose a system for hierarchical assistive recipe editing that performs simultaneous ingredient substitution before generating natural-language steps using the edited ingredients. |
| Outcome: | The proposed system can adapt a recipe to satisfy a user-specified dietary constraint. |
EpiGEN: An Efficient Multi-Api Code GENeration Framework under Enterprise Scenario (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to large language models fail to meet expectations for code generation tasks . existing approaches are faced with drawbacks of high resource consumption and inadequate handling of multi-API tasks. |
| Approach: | They propose an Efficient multi-Api code GENeration framework that uses private APIs to pre-train LLMs. |
| Outcome: | The proposed framework shows good acceptability and readability on single-GPU tasks compared to fully fine-tuned LLMs with a larger number of parameters. |
Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer (2025.acl-long)
Copied to clipboard
Guodong Du, Zitao Fang, Jing Li, Junlin Li, Runhua Jiang, Shuyang Yu, Yifei Guo, Yangneng Chen, Sim Kuan Goh, Ho-Kin Tang, Daojing He, Honghai Liu, Min Zhang
| Challenge: | Foundational models and their checkpoints have advanced deep learning, boosting performance across applications. |
| Approach: | They propose a method for pruning fine-tuned models by calculating differences between them and original model. |
| Outcome: | The proposed method can improve performance across vision, NLP, and multi-modal benchmarks. |
Assistive Recipe Editing through Critiquing (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for generating recipes that satisfy dietary restrictions are inconsistent or incoherent and paired datasets are not available at scale. |
| Approach: | They propose to build a hierarchical denoising auto-encoder that edits recipes given ingredient-level critiques by interacting with the predicted ingredients. |
| Outcome: | The proposed model can more effectively edit recipes compared to strong language models and iteratively rewrites recipes to satisfy user feedback. |
Eliciting Medical Reasoning with Knowledge-enhanced Data Synthesis: A Semi-Supervised Reinforcement Learning Approach (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to enhance medical reasoning lack high-quality data. |
| Approach: | They propose a medical knowledge-enhanced data Synthesis and Semi-supervised Reinforcement learning framework that uses rare disease knowledge to synthesize distribution-controllable reasoning questions. |
| Outcome: | The proposed method outperforms existing methods across ten medical benchmarks and achieves up to 5.93% gain on rare diseases tasks. |
HyperAdaLoRA: Accelerating LoRA Rank Allocation During Training via Hypernetworks without Sacrificing Performance (2026.findings-acl)
Copied to clipboard
Hao Zhang, Zhenjia Li, Yifan Gao, Xi Xiao, Heng Zhang, Shuyang Zhang, null Xiaoxincc, Bo Huang, Yuhang Wu, Tianyang Wang, Hao Xu
| Challenge: | Low-Rank Adaptation (LoRA) assumes a uniform rank r for each incremental matrix, not accounting for the varying significance of weight matrices across modules and layers. |
| Approach: | They propose a framework that allows for faster convergence of low-rank adaptive models . they use a hypernetwork to prune the outputs of the hypernetworks to generate parameters . |
| Outcome: | The proposed framework accelerates convergence of AdaLoRA by leveraging a hypernetwork. |
To See a World in a Spark of Neuron: Disentangling Multi-Task Interference for Training-Free Model Merging (2025.emnlp-main)
Copied to clipboard
Zitao Fang, Guodong Du, Shuyang Yu, Yifei Guo, Yiwei Zhang, Yiyao Cao, Jing Li, Ho-Kin Tang, Sim Kuan Goh
| Challenge: | Existing approaches to model merging ignore the fundamental roles of neurons, connectivity and activation. |
| Approach: | They propose a framework that relies on neuronal mechanisms to mitigate task interference . they decomposed task-specific representations into two complementary subspaces . their results offer new insights into mitigating task interference and improving knowledge fusion . |
| Outcome: | The proposed framework reduces task interference within neurons and improves knowledge fusion. |
Instilling Type Knowledge in Language Models via Multi-Task QA (2022.findings-naacl)
Copied to clipboard
| Challenge: | Current methods to learn entity types rely on coarse, noisy labels . current methods rely only on text-to-text pre-training on type-centric questions . |
| Approach: | They propose to instill fine-grained type knowledge in language models by pre-training on type-centric questions. |
| Outcome: | The proposed model achieves state-of-the-art in zero-shot dialog state tracking benchmarks and can accurately infer entity types in Wikipedia articles. |
Knowledge Fusion By Evolving Weights of Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Experimental results on mainstream language models show that Evolver outperforms previous state-of-the-art models by large margins due to the high training costs of large language models. |
| Approach: | They propose a method to integrate multiple models from diverse training scenarios into a unified model. |
| Outcome: | The proposed method outperforms state-of-the-art models on mainstream language models by large margins. |
Generating Personalized Recipes from Historical User Preferences (D19-1)
Copied to clipboard
| Challenge: | Existing methods to recipe generation are unable to create recipes for users with culinary preferences but incomplete knowledge of ingredients in specific dishes. |
| Approach: | They propose to expand a name and incomplete ingredient details into complete natural-text instructions aligned with the user’s historical preferences. |
| Outcome: | The proposed model generates plausible recipes from user-aware representations of recipes from 180K recipes and 700K interactions. |