Papers by Hy Nguyen
Do Text-to-Vis Benchmarks Test Real Use of Visualisations? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing benchmarks for visualisations are limited and do not reflect real-world use. |
| Approach: | They analysed visualisation code from Python, R, Javascript, and Vega to find similarities and differences between real-world and benchmark datasets. |
| Outcome: | The results show that benchmark datasets do not test the same distribution of chart types, attributes, and actions as real-world examples. |
Meeting Decision Tracker: Making Meeting Minutes with De-Contextualized Utterances (2022.aacl-demo)
Copied to clipboard
| Challenge: | Existing systems to itemize meetings' decisions are lacking in their raw form due to utterance collapse. |
| Approach: | They propose a prototype system to construct decision items that deal with utterance collapse in natural conversation. |
| Outcome: | The proposed system improves the user experience by dealing with utterance collapse in natural conversation. |
OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching (2025.acl-long)
Copied to clipboard
| Challenge: | Text-to-speech systems have seen significant advances in recent years, driven by improvements in deep learning and neural network architectures. |
| Approach: | They propose a method to explore optimal transport conditional flow matching with one-step sampling and a learned prior as the condition, effectively disregarding preceding states and reducing the number of sampling steps. |
| Outcome: | The proposed method achieves promising performance over existing methods in content accuracy, naturalness, prosody generation, and speaker style preservation. |
SilVar: Speech-Driven Multimodal Model for Reasoning Visual Question Answering and Object Localization (2025.emnlp-main)
Copied to clipboard
| Challenge: | Visual Language Models have demonstrated remarkable capabilities across various tasks, including visual question answering and image captioning. |
| Approach: | They propose an end-to-end multimodal model that leverages speech instructions for reasoning-based visual question answering. |
| Outcome: | The proposed model can process and explain visual scenes from spoken input, moving beyond simple object recognition to reasoning-based interactions. |
HierarchyNet: Learning to Summarize Source Code with Heterogeneous Representations (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing code summarization approaches ignore the interplay of dependencies among program elements and code hierarchy. |
| Approach: | They propose a code summarization approach utilizing Heterogeneous Code Representations (HCRs) and HierarchyNet. |
| Outcome: | The proposed method improves on existing models and pre-trained models. |
Sentiment Reasoning for Healthcare (2025.acl-industry)
Copied to clipboard
| Challenge: | Sentiment Reasoning is an auxiliary task in sentiment analysis where the model predicts both the sentiment label and generates the rationale behind it based on the input transcript. |
| Approach: | They propose a task - Sentiment Reasoning - for both speech and textmodalities and propose 'multimodal multitask framework' . they propose to use a model that generates the rationale behind each predicted label and provides a rationale for model prediction with quality semantically comparable to humans. |
| Outcome: | The proposed task improves model transparency by providing rationale for model prediction with quality semantically comparable to humans while improving model’s classification performance. |
Medical Spoken Named Entity Recognition (2025.naacl-industry)
Copied to clipboard
Khai Le-Duc, David Thulke, Hung-Phong Tran, Long Vo-Dang, Khai-Nguyen Nguyen, Truong-Son Hy, Ralf Schlüter
| Challenge: | Named Entity Recognition (NER) aims to extract named entities from speech and categorise them into types like person, location, organization, etc. |
| Approach: | They present a spoken NER dataset in the medical domain using pre-trained models that are encoder-only and sequence-to-sequence. |
| Outcome: | The dataset is the largest spoken NER dataset in the world regarding the number of entity types, featuring 18 distinct types. |
ViDeBERTa: A powerful pre-trained language model for Vietnamese (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing models for Vietnamese that perform well on downstream tasks, such as Question answering, are based on Transformer. |
| Approach: | They propose a pre-trained monolingual Vietnamese model with three versions . they fine-tune and evaluate the model on three important natural language downstream tasks, Part-of-speech tagging, Named-entity recognition, and Question answering. |
| Outcome: | The proposed model outperforms the existing model on three important natural language downstream tasks, Part-of-speech tagging, Named-entity recognition, and Question answering. |