Papers by Vu Dang
Aurora-M: Open Source Continual Pre-training for Multilingual Language and Code (2025.coling-industry)
Copied to clipboard
Taishi Nakamura, Mayank Mishra, Simone Tedeschi, Yekun Chai, Jason T. Stillerman, Felix Friedrich, Prateek Yadav, Tanmay Laud, Vu Minh Chien, Terry Yue Zhuo, Diganta Misra, Ben Bogin, Xuan-Son Vu, Marzena Karpinska, Arnav Varma Dantuluri, Wojciech Kusa, Tommaso Furlanello, Rio Yokota, Niklas Muennighoff, Suhas Pai, Tosin Adewumi, Veronika Laippala, Xiaozhe Yao, Adalberto Barbosa Junior, Aleksandr Drozd, Jordan Clive, Kshitij Gupta, Liangyu Chen, Qi Sun, Ken Tsui, Nour Moustafa-Fahmy, Nicolo Monti, Tai Dang, Ziyang Luo, Tien-Tung Bui, Roberto Navigli, Virendra Mehta, Matthew Blumberg, Victor May, Hiep Nguyen, Sampo Pyysalo
| Challenge: | Pretrained language models are integral part of AI applications, but their high computational cost limits accessibility. |
| Approach: | They evaluate Aurora-M, a 15B parameter multilingual open-source model trained on English, Finnish, Hindi, Japanese, Vietnamese, and code. |
| Outcome: | The proposed model outperforms existing models on English, Finnish, Hindi, Japanese, Vietnamese, and code. |
Large-scale Exploration of Neural Relation Classification Architectures (D18-1)
Copied to clipboard
| Challenge: | Existing studies on relation classification have been limited to a very narrow range of datasets, making comparisons between approaches difficult. |
| Approach: | They propose a multi-channel LSTM model combined with a CNN that takes advantage of all currently popular linguistic and architectural features. |
| Outcome: | The proposed model achieves state-of-the-art on two datasets and provides direct insights into the challenges faced by language models on relation classification. |
Introducing a Large-Scale Dataset for Vietnamese POS Tagging on Conversational Texts (2020.lrec-1)
Copied to clipboard
| Challenge: | POS taggers are trained on informal texts which contain many informal inputs such as acronyms, abbreviations, out-of-vocabulary words, etc. |
| Approach: | They propose a large-scale human-labeled dataset for the Vietnamese POS tagging task on conversational texts and develop an annotation guideline to manually annotate 16.310K sentences using this guideline. |
| Outcome: | The proposed tagging scheme achieved 93.36% accuracy score and higher than the model with handcrafted features and fine-tuning BERT. |