Papers by Anh-Duc Vu
What Do Transformers Know about Government? (2024.lrec-main)
Copied to clipboard
Jue Hou, Anisia Katinskaia, Lari Kotilainen, Sathianpong Trangcasanchai, Anh-Duc Vu, Roman Yangarber
| Challenge: | Currently, data is lacking for the research community working on grammatical constructions, and government in particular. |
| Approach: | They use transformer language models to study how government relations are encoded . they use morphologically rich languages to train a classifier capable of discovering new types of government . |
| Outcome: | The proposed classifiers can learn new types of government, the authors show . they find that the classifier can learn government relations in two languages . |
Effects of sub-word segmentation on performance of transformer language models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Language models are a fundamental task in natural language processing, but few studies focus on the effect of sub-word segmentation on the performance of models. |
| Approach: | They compare GPT and BERT models trained with statistical segmentation algorithm BPE to unsupervised morphological segmentation algorithms Morfessor and StateMorph. |
| Outcome: | The proposed model trains for several languages and compares them with two unsupervised morphological segmentation algorithms. |