Papers by Steven Truong
Persona-Augmented Benchmarking: Evaluating LLMs Across Diverse Writing Styles (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current benchmarks for evaluating Large Language Models do not capture the rich variety of communication patterns exhibited by humans. |
| Approach: | They propose a low-cost method to emulate diverse writing styles by rewriting evaluation prompts using persona-based LLM prompting. |
| Outcome: | The proposed method improves the external validity of the benchmarks for Large Language Models (LLMs) based on persona-based prompting. |
RadGraph-XL: A Large-Scale Expert-Annotated Dataset for Entity and Relation Extraction from Radiology Reports (2024.findings-acl)
Copied to clipboard
Jean-Benoit Delbrouck, Pierre Chambon, Zhihong Chen, Maya Varma, Andrew Johnston, Louis Blankemeier, Dave Van Veen, Tan Bui, Steven Truong, Curtis Langlotz
| Challenge: | RadGraph-XL is an expert-annotated dataset for structured clinical data extraction. |
| Approach: | They propose a large-scale, expert-annotated dataset for clinical entity and relation extraction using radiology reports. |
| Outcome: | The proposed model outperforms existing methods by up to 52% and outperfies GPT-4 in this domain. |
HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts (2023.emnlp-main)
Copied to clipboard
Truong Do, Le Khiem, Quang Pham, TrungTin Nguyen, Thanh-Nam Doan, Binh Nguyen, Chenghao Liu, Savitha Ramasamy, Xiaoli Li, Steven Hoi
| Challenge: | Recent studies suggest that fixing the routers can achieve competitive performance by alleviating the collapsing problem, where all experts eventually learn similar representations. |
| Approach: | They propose a method that dynamically generates router parameters through a fixed hypernetwork and trainable embeddings to achieve a balance between training the routers and freezing them to learn an improved routing policy. |
| Outcome: | Experiments on a wide range of tasks show that the proposed method performs better than existing methods. |