Papers by Bang Nguyen
Enhancing Healthcare LLM Trust with Atypical Presentations Recalibration (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for eliciting and calibrating large language models have focused on general reasoning datasets, yielding only modest improvements. |
| Approach: | They propose a method which leverages atypical presentations to adjust model confidence estimates. |
| Outcome: | The proposed method reduces calibration errors by approximately 60% on three medical question answering datasets and outperforms existing methods such as vanilla verbalized confidence, CoT verbalised confidence and others. |
Reference-based Metrics Disprove Themselves in Question Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing metrics for question generation are based on human-written references . however, the results of the metrics on our study disprove the metrics themselves . |
| Approach: | They propose to use human-written references to evaluate question generation . they propose to combine criteria such as naturalness, answerability, and complexity . |
| Outcome: | The proposed model is based on multi-dimensional criteria such as naturalness, answerability, and complexity, utilizing large language models. |
Introducing a Large-Scale Dataset for Vietnamese POS Tagging on Conversational Texts (2020.lrec-1)
Copied to clipboard
| Challenge: | POS taggers are trained on informal texts which contain many informal inputs such as acronyms, abbreviations, out-of-vocabulary words, etc. |
| Approach: | They propose a large-scale human-labeled dataset for the Vietnamese POS tagging task on conversational texts and develop an annotation guideline to manually annotate 16.310K sentences using this guideline. |
| Outcome: | The proposed tagging scheme achieved 93.36% accuracy score and higher than the model with handcrafted features and fine-tuning BERT. |
QG-SMS: Enhancing Test Item Analysis via Student Modeling and Simulation (2025.acl-long)
Copied to clipboard
| Challenge: | Question Generation (QG) tasks are often evaluated using reference-based metrics such as ROUGE and BLEU. |
| Approach: | They propose a QG evaluation framework that leverages Large Language Model for Student Modeling and Simulation to perform test item analysis. |
| Outcome: | The proposed framework improves the QG task and human-simulated student profiles. |