Papers by Luke Dai
Can Transformer Models Measure Coherence In Text: Re-Thinking the Shuffle Test (2021.acl-short)
Copied to clipboard
| Challenge: | Recent work shows that modern NLP models can detect shuffled text without supervision. |
| Approach: | They propose to use Shuffle Test to evaluate whether NLP models can measure coherence in text . they argue that this is unlikely to lead to a good model of text coherency . |
| Outcome: | The Shuffle Test is the most common task to evaluate whether NLP models can measure coherence in text. |
Scaling Down, Serving Fast: Compressing and Deploying Efficient LLMs for Recommendation Systems (2025.emnlp-industry)
Copied to clipboard
Kayhan Behdin, Ata Fatahibaarzi, Qingquan Song, Yun Dai, Aman Gupta, Zhipeng Wang, Hejian Sang, Shao Tang, Gregory Dexter, Sirou Zhu, Siyu Zhu, Tejas Dharamsi, Vignesh Kothapalli, Zhoutong Fu, Yihan Cao, Pin-Lun Hsu, Fedor Borisyuk, Natesh S. Pillai, Luke Simon, Rahul Mazumder
| Challenge: | Large language models (LLMs) have demonstrated remarkable performance across a wide range of industrial applications. |
| Approach: | They propose two techniques for training and deploying small language models that deliver high performance for a variety of industry use cases. |
| Outcome: | The proposed techniques retain much of the quality of larger models while reducing training/serving costs and latency. |