Enriching Biomedical Knowledge for Low-resource Language Through Large-scale Translation (2023.eacl-main)
Copied to clipboard
| Challenge: | Biomedical data and benchmarks are highly valuable but limited in low-resource languages such as English. |
| Approach: | They propose a translation model in Vietnamese that trains a pretrained Encoder-Decoder Transformer model on 20 million translated abstracts. |
| Outcome: | The proposed model can translate and produce both pretrained and supervised biomedical data in two biomedically important domains. |
Similar Papers
Improving Vietnamese-English Medical Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing high-quality Vietnamese-English parallel datasets are inadequate for translation training. |
| Approach: | They introduce a high-quality Vietnamese-English parallel dataset for medical translation . they compare Google Translate, ChatGPT, and pre-trained bilingual/multilingual models . |
| Outcome: | The proposed dataset is compared with translation models from Google Translate and ChatGPT. |
PhoMT: A High-Quality and Large-Scale Benchmark Dataset for Vietnamese-English Machine Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | We present a high-quality and large-scale Vietnamese-English parallel dataset . our dataset is 2.9M pairs larger than the benchmark Vietnamese- English corpus . |
| Approach: | They present a large-scale Vietnamese-English parallel dataset with 3.02M sentence pairs . they compare strong neural baselines and well-known automatic translation engines . |
| Outcome: | The proposed dataset is 2.9M pairs larger than the benchmark Vietnamese-English corpus IWSLT15. |
ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language Generation (2022.naacl-srw)
Copied to clipboard
| Challenge: | Existing models for the English language have been used to train on large corpus of high-quality texts. |
| Approach: | They present a pretrained Transformer-based encoder-decoder model for the Vietnamese language . they benchmark ViT5 on two downstream text generation tasks . |
| Outcome: | The proposed model outperforms existing models on Vietnamese Abstractive Summarization and Named Entity Recognition tasks. |
MedINST: Meta Dataset of Biomedical Instructions (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Medical data and tasks require extensive preprocessing and standardization for effective use in training LLMs. |
| Approach: | They propose to use MedINST as a meta-dataset to evaluate LLMs' generalization ability. |
| Outcome: | The meta-dataset of biomedical instruction measures the generalization ability of LLMs across multiple open-domain tasks. |
Biomed-Enriched: Data-Efficient Biomedical Pretraining via Paragraph-Level Annotation (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models have demonstrated remarkable capabilities across a wide range of general tasks, from question answering to code generation. |
| Approach: | They use a paragraph-level pipeline to annotate PubMed Central paragraphs . they use XLM-RoBERTa to fine-tune the pipeline and propagate annotations to the full corpus . |
| Outcome: | The proposed approach improves performance on 11 tasks while using 2.5x fewer tokens and only public data. |
MultiMed: Multilingual Medical Speech Recognition via Attention Encoder Decoder (2025.acl-industry)
Copied to clipboard
Khai Le-Duc, Phuc Phan, Tan-Hanh Pham, Bach Phan Tat, Minh-Huong Ngo, Thanh Nguyen-Tang, Truong-Son Hy
| Challenge: | Multilingual automatic speech recognition (ASR) in the medical domain is a critical foundational task, serving a wide range of downstream applications such as speech translation, spoken language understanding, and voice-activated assistants. |
| Approach: | They present the first multilingual medical ASR dataset and the first collection of small-to-large end-to end medical APR models spanning five languages: Vietnamese, English, German, French, and Mandarin Chinese. |
| Outcome: | The proposed model covers Vietnamese, English, German, French, and Mandarin Chinese, and is the first multilingual ASR dataset across five languages. |
ViMedAQA: A Vietnamese Medical Abstractive Question-Answering Dataset and Findings of Large Language Model (2024.acl-srw)
Copied to clipboard
| Challenge: | Existing abstractive question-answering datasets in Vietnamese are lacking . |
| Approach: | They propose to introduce a Vietnamese abstractive question-answering corpus to address this gap . they propose to use Vietnamese abstractives to generate answers to questions . |
| Outcome: | The proposed dataset examines the capability of large language models in the Vietnamese medical domain, including reasoning, memorizing and awareness of essential information. |
MedMT5: An Open-Source Multilingual Text-to-Text LLM for the Medical Domain (2024.lrec-main)
Copied to clipboard
Iker García-Ferrero, Rodrigo Agerri, Aitziber Atutxa Salazar, Elena Cabrio, Iker de la Iglesia, Alberto Lavelli, Bernardo Magnini, Benjamin Molinet, Johana Ramirez-Romero, German Rigau, Jose Maria Villa-Gonzalez, Serena Villata, Andrea Zaninello
| Challenge: | Existing studies on large language models for medical applications have focused on a single language . medical mT5 outperforms both encoders and similar sized text-to-text models in English, French, and Italian benchmarks . |
| Approach: | They propose to train Medical mT5, the first open-source text-to-text multilingual model for the medical domain. |
| Outcome: | The proposed model outperforms encoders and similar sized models on the Spanish, French, and Italian benchmarks while being competitive with current state-of-the-art models in English. |
MultiMed-ST: Large-scale Many-to-many Multilingual Medical Speech Translation (2025.emnlp-main)
Copied to clipboard
Khai Le-Duc, Tuyen Tran, Bach Phan Tat, Nguyen Kim Hai Bui, Quan Dang Anh, Hung-Phong Tran, Thanh Thuy Nguyen, Ly Nguyen, Tuan Minh Phan, Thi Thu Phuong Tran, Chris Ngo, Khanh Xuan Nguyen, Thanh Nguyen-Tang
| Challenge: | Multilingual speech translation (ST) and machine translation (MT) in the medical domain enhances patient care by enabling efficient communication across language barriers. |
| Approach: | They present a large-scale ST dataset for the medical domain spanning all translation directions in Vietnamese, English, German, French, and Simplified/Traditional Chinese, together with the models. |
| Outcome: | The multi-language speech translation (ST) and machine translation (MT) in the medical domain is the largest medical MT dataset and the largest many-to-many multilingual ST among all domains. |
On Creating an English-Thai Code-switched Machine Translation in Medical Domain (2024.findings-emnlp)
Copied to clipboard
Parinthapat Pengpun, Krittamate Tiankanon, Amrest Chinkamol, Jiramet Kinchagawat, Pitchaya Chairuengjitjaras, Pasit Supholkhan, Pubordee Aussavavirojekul, Chiraphat Boonnag, Kanyakorn Veerakanjana, Hirunkul Phimsiri, Boonthicha Sae-jia, Nattawach Sataudom, Piyalitt Ittichaiwong, Peerat Limkonchotiwat
| Challenge: | despite advances in English-Thai MT, common MT approaches often underperform in the medical field due to their inability to precisely translate medical terminologies. |
| Approach: | They propose to maintain medical terminology in English within translated text through code-switched translation. |
| Outcome: | The proposed method shows that medical professionals prefer CS translations that maintain critical English terms accurately, even if it slightly compromises fluency. |