Papers by Siqi Cai
Distributional Clarity: The Hidden Driver of RL-Friendliness in Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | RL-friendly models exhibit intra-class compactness and inter-class separation in probability assignments . under identical training, Qwen models achieve substantial gains, while others like Llama yield limited improvements. |
| Approach: | They propose a method to quantify distributional clarity in probability space . they show distributional clearness is a trainable property underlying RL-Friendliness . |
| Outcome: | The proposed model families achieve substantial gains under identical training, while others like Llama yield limited improvements. |
Can LLMs Learn From Mistakes? An Empirical Study on Reasoning Tasks (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work has shown that simple learning can enhance the chain-of-thought (CoT) reasoning of large language models. |
| Approach: | They construct mistake-correction datasets to identify and correct mistakes in CoTs . they conclude that LLMs can learn from mistakes to enhance their CoT reasoning . |
| Outcome: | The proposed datasets show that LLMs can learn from mistakes to enhance their CoT reasoning performance. |
Revisiting Scaling Laws for Language Models: The Role of Data Quality and Training Strategies (2025.acl-long)
Copied to clipboard
| Challenge: | Existing scaling laws suggest augmenting model size and training data results in enhanced performance, but recent studies reveal deviations, particularly in large language models, where performance improvements decelerate—a phenomenon known as sub-scaling. |
| Approach: | They propose a sub-optimal scaling law that better predicts performance in sub-scaling regimes by examining data quality and training strategies. |
| Outcome: | The proposed scaling law better predicts performance in sub-scaling regimes, highlighting the importance of data quality and diversity. |
STAND-Guard: A Small Task-Adaptive Content Moderation Model (2025.coling-industry)
Copied to clipboard
| Challenge: | Content moderation is important for developing welcoming online platforms and responsible large language models. |
| Approach: | They propose a small task-adaptive coNtent moDeration model that can be easily adapted to new or customized content moderation tasks without extensive model tuning. |
| Outcome: | The proposed model is comparable to GPT-3.5-Turbo on unseen English binary classification tasks. |
Query Enhanced Knowledge-Intensive Conversation via Unsupervised Joint Modeling (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to retrieve knowledge-intensive conversations are based on external resources such as Wikipedia databases or search engine results. |
| Approach: | They propose an unsupervised query enhanced approach for knowledge-intensive conversations . they conduct experiments on three knowledge- intensive conversation datasets . |
| Outcome: | The proposed approach performs better than all unsupervised methods across three datasets and achieves competitive performance compared to supervised methods. |