Papers by Renliang Sun
ShifCon: Enhancing Non-Dominant Language Capabilities with a Shift-based Multilingual Contrastive Framework (2025.acl-long)
Copied to clipboard
Hengyuan Zhang, Chenming Shang, Sizhe Wang, Dongdong Zhang, Yiyao Yu, Feng Yao, Renliang Sun, Yujiu Yang, Furu Wei
| Challenge: | Experiments show that ShifCon significantly enhances the performance of non-dominant languages due to the imbalance in training data across languages. |
| Approach: | They propose a Shift-based multilingual Contrastive framework that aligns the internal forward process of other languages toward that of the dominant one. |
| Outcome: | The proposed framework significantly improves performance of non-dominant languages, particularly for low-resource ones. |
Nearest Neighbor Knowledge Distillation for Neural Machine Translation (2022.naacl-main)
Copied to clipboard
| Challenge: | k-nearest-neighbor machine translation (kNN-MT) is a state-of-the-art machine translation technique . however, it requires conducting kNN searches for each decoding step, which increases the cost of decoding . |
| Approach: | They propose to move the time-consuming kNN search forward to the preprocessing phase and introduce k Nearest Neighbor Knowledge Distillation (kNN-KD) that trains the base NMT model to directly learn the knowledge of kN. |
| Outcome: | The proposed method improves over the state-of-the-art model while maintaining the same training and decoding speed as the standard model. |
CAPE: A Chinese Dataset for Appraisal-based Emotional Generation in Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing LLMs fail to capture the nuances of human emotions, making their interactions seem impersonal or inadequate. |
| Approach: | They propose a two-stage automatic data generation framework to generate a Chinese dataset called CAPE . their data is a cognitive appraisal theory-based Emotional corpus that accounts for personal and situational factors. |
| Outcome: | The proposed framework can generate human-like responses in conversation with large language models. |
On the Helpfulness of Document Context to Sentence Simplification (2020.coling-main)
Copied to clipboard
| Challenge: | Text simplification is a hot issue in the field of natural language generation (NLG). |
| Approach: | They propose to use Wikipedia context to improve sentence simplification by using neural networks to learn the effects of preceding and following sentences on current sentences. |
| Outcome: | The proposed model outperforms the best performing model on the baseline dataset by 2.46 (7.22%). |
Stop When Enough: Adaptive Early-Stopping for Chain-of-Thought Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Chain-of-Thought reasoning has driven recent gains of large language models (LLMs) on reasoning-intensive tasks by externalizing intermediate steps. |
| Approach: | They propose a training-free framework that adaptively determines when to stop reasoning to mitigate overthinking. |
| Outcome: | The proposed framework reduces token usage by 20-55% while maintaining or improving accuracy compared to standard CoT prompting. |
Protein Large Language Models: A Comprehensive Survey (2025.findings-emnlp)
Copied to clipboard
Yijia Xiao, Wanjia Zhao, Junkai Zhang, Yiqiao Jin, Han Zhang, Zhicheng Ren, Renliang Sun, Haixin Wang, Guancheng Wan, Pan Lu, Xiao Luo, Yu Zhang, James Zou, Yizhou Sun, Wei Wang
| Challenge: | Existing studies focus on specific aspects or applications, but this study provides a comprehensive overview of Protein-specific large language models. |
| Approach: | This paper proposes a structured taxonomy of state-of-the-art ProteinLLMs . they analyze how they leverage large-scale protein sequence data for improved accuracy . |
| Outcome: | The proposed model covers their architectures, training datasets, evaluation metrics, and diverse applications. |
Exploiting Summarization Data to Help Text Simplification (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing text simplification datasets are limited to Wikipedia and Newsela, restricting further development of this field. |
| Approach: | They propose an alignment algorithm to extract sentence pairs from summarization datasets and a method to filter suitable pairs. |
| Outcome: | The proposed algorithm can extract sentence pairs from summarization datasets and perform well with real datasets. |
Document-Level Text Simplification: Dataset, Criteria and Baseline (2021.emnlp-main)
Copied to clipboard
| Challenge: | Text simplification is a valuable technique, but research on it is limited. |
| Approach: | They propose a document-level simplification task using Wikipedia dumps as a dataset and propose an automatic evaluation metric called D-SARI. |
| Outcome: | The proposed metric is more suitable for document-level simplification task. |
A New Benchmark and Reverse Validation Method for Passage-level Hallucination Detection (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are capable of working with humans in real-world scenarios, but they are prone to generate hallucinations and misinformation when deployed for mission-critical tasks. |
| Approach: | They propose a self-check approach to detect factual errors in a zero-resource fashion by using reverse validation to generate a hallucination detection benchmark. |
| Outcome: | The proposed method outperforms baseline methods while costing fewer tokens and less time. |
Teaching the Pre-trained Model to Generate Simple Texts for Text Simplification (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing strategies to teach pre-trained models to generate simple texts are inadequate. |
| Approach: | They propose a continued pre-training strategy to teach pre-trained models to generate simple texts by randomly masking text spans in ordinary texts. |
| Outcome: | The proposed strategy improves on lexical simplification, sentence simplification and document-level simplification tasks over existing models. |
A New Dataset and Empirical Study for Sentence Simplification in Chinese (2023.acl-long)
Copied to clipboard
| Challenge: | Sentence simplification is a valuable technique that can benefit language learners and children. |
| Approach: | They propose a dataset for assessing sentence simplification in Chinese using manual simplifications from human annotators. |
| Outcome: | The proposed dataset shows that Chinese sentences are more accessible to children and nonnative readers than English sentences. |