Papers by Rongsheng Li
Youling: an AI-assisted Lyrics Creation System (2020.emnlp-demos)
Copied to clipboard
Rongsheng Zhang, Xiaoxi Mao, Le Li, Lin Jiang, Lin Chen, Zhiwei Hu, Yadong Xi, Changjie Fan, Minlie Huang
| Challenge: | Recent studies have focused on a single pass of lyrics generation with little human intervention. |
| Approach: | They propose an AI-assisted lyrics creation system that supports one pass full-text generation and interactive generation modes. |
| Outcome: | The proposed system supports full-text generation and interactive generation modes . it also provides a revision module which enables users to revise undesired lyrics repeatedly. |
Conditioned Masked Language and Image Modeling for Image-Text Dense Retrieval (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Large-scale two-stream pre-trained models like CLIP have achieved tremendous success in image-text retrieval. |
| Approach: | They propose a cross-modal framework for image-text retrieval using two-stream pre-trained models . they embed images and texts into instance representations with two separate encoders . experimental results on MSCOCO and Flickr30k reveal the effectiveness of their framework . |
| Outcome: | The proposed framework improves image-text retrieval performance on two popular cross-modal retrieval benchmarks. |
Depth Aware Hierarchical Replay Continual Learning for Knowledge Based Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | Continual learning models adapt well to the latest data but lose ability to remember past data due to changes in the data source. |
| Approach: | They propose a hierarchical replay framework that allows models to keep a small memory of previous learned data that uses replay. |
| Outcome: | The proposed model outperforms previous continual learning methods in mitigating catastrophic forgetting. |
Neural Relation Classification with Text Descriptions (C18-1)
Copied to clipboard
| Challenge: | State-of-the-art methods for relation classification suffer from data sparsity issue greatly. |
| Approach: | They propose a new neural relation classification method which integrates entities’ text descriptions into deep neural networks models. |
| Outcome: | The proposed method achieves much better experimental results than other state-of-the-art methods on the SemEval 2010 dataset. |
Metaphor Detection with Context Enhancement and Curriculum Learning (2024.naacl-long)
Copied to clipboard
| Challenge: | Metaphor detection is a challenging task for natural language processing systems . previous work failed to adequately utilize internal and external semantic relationships . |
| Approach: | They propose a model that leverages the difference between literal and external meanings of words and sentences as the sentence external difference. |
| Outcome: | The proposed model achieves competitive performance across multiple datasets with improved convergence speed compared to other models. |
A General Knowledge Injection Framework for ICD Coding (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to improve ICD coding focus on a single type of knowledge and design specialized modules that are complex and incompatible with each other. |
| Approach: | They propose a general knowledge injection framework that integrates three key types of knowledge without specialized design of additional modules. |
| Outcome: | The proposed framework outperforms baseline models and is comparable to models relying on extra human annotations. |
Easy and Efficient Transformer: Scalable Inference Solution For Large NLP Model (2022.naacl-industry)
Copied to clipboard
Gongzheng Li, Yadong Xi, Jingzhen Ding, Duan Wang, Ziyang Luo, Rongsheng Zhang, Bai Liu, Changjie Fan, Xiaoxi Mao, Zeng Zhao
| Challenge: | Recent studies show that transformer-based models are effective over many tasks, but they are expensive to deploy in the industrial application. |
| Approach: | They propose a transformer-based inference solution that optimizes kernels for long inputs and large hidden sizes and a flexible CUDA memory manager to reduce the memory footprint when deploying a large model. |
| Outcome: | The proposed solution achieves an average speedup of 1.40-4.20x on the transformer decoder layer with an A100 GPU. |
Training a Better Chinese Spelling Correction Model via Prior-knowledge Guided Teacher (2024.findings-acl)
Copied to clipboard
| Challenge: | Chinese Spelling Correction models are prone to over-correct and poor generalization for error patterns outside the standard distribution. |
| Approach: | They propose a teacher network guided by prior knowledge for distillation learning of CSC models. |
| Outcome: | The proposed method significantly enhances the CSC model’s language modeling capabilities, crucial for minimizing over-correction. |