A Large-Scale Benchmark for Vietnamese Sentence Paraphrases (2025.findings-naacl)
Copied to clipboard
| Challenge: | 1.2M original–paraphrase pairs were generated using a hybrid approach to generate high-quality paraphrases. |
| Approach: | They present a high-quality Vietnamese dataset for sentence paraphrasing . they used automatic paraphrase generation and manual evaluation to ensure high quality . |
| Outcome: | The proposed dataset is the first large-scale study on Vietnamese paraphrasing . it combines automatic paraphrase generation with manual evaluation to ensure high quality . |
Similar Papers
PhoMT: A High-Quality and Large-Scale Benchmark Dataset for Vietnamese-English Machine Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | We present a high-quality and large-scale Vietnamese-English parallel dataset . our dataset is 2.9M pairs larger than the benchmark Vietnamese- English corpus . |
| Approach: | They present a large-scale Vietnamese-English parallel dataset with 3.02M sentence pairs . they compare strong neural baselines and well-known automatic translation engines . |
| Outcome: | The proposed dataset is 2.9M pairs larger than the benchmark Vietnamese-English corpus IWSLT15. |
ViGLUE: A Vietnamese General Language Understanding Benchmark and Analysis of Vietnamese Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing benchmarks for natural language understanding have been suggested, but there is a lack of such a benchmark in Vietnamese due to the difficulty in accessing datasets or the scarcity of task-specific datasets. |
| Approach: | They propose to use a benchmark to evaluate Vietnamese language models in a variety of tasks and areas to explore the relationship between specific tasks and the number of shots. |
| Outcome: | The proposed benchmark contains twelve tasks and encompasses over ten areas and subjects, enabling it to evaluate models comprehensively over a broad spectrum of aspects. |
ViGPTQA - State-of-the-Art LLMs for Vietnamese Question Answering: System Overview, Core Models Training, and Evaluations (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Large language models (LLMs) and their applications in low-resource languages are limited due to lack of training data and benchmarking datasets. |
| Approach: | They propose a question-response system for Vietnamese that uses LLMs . they propose to open-source the model and train it on benchmark datasets based on Vietnamese data . |
| Outcome: | The proposed question answering system for Vietnamese is open-source and performant . it can learn and capture human-like text, but there is a gap in evaluations for Vietnamese . |
VMLU Benchmarks: A comprehensive benchmark toolkit for Vietnamese LLMs (2025.acl-long)
Copied to clipboard
Cuc Thi Bui, Nguyen Truong Son, Truong Van Trang, Lam Viet Phung, Pham Nhut Huy, Hoang Anh Le, Quoc Huu Van, Phong Nguyen-Thuan Do, Van Le Tran Truc, Duc Thanh Chau, Le-Minh Nguyen
| Challenge: | The evolution of Large Language Models (LLMs) has underscored the need for benchmarks designed for various languages and cultural contexts. |
| Approach: | They propose to use Vietnamese multitask language understanding (VMLU) benchmarks to assess different capabilities of LLMs, including general knowledge, reading comprehension, reasoning, and conversational skills. |
| Outcome: | The VMLU Benchmarks assess LLMs' general knowledge, reading comprehension, reasoning, and conversational skills. |
Which Works Best for Vietnamese? A Practical Study of Information Retrieval Methods across Domains (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing studies on Large Language Models (LLMs) are limited to single domains or curated datasets. |
| Approach: | They propose a domain-normalized, multi-domain benchmark for Vietnamese IR . they evaluate lexical, neural-sparse, late-interaction, dense, and hybrid paradigms . |
| Outcome: | The proposed benchmarks cover six domains and ten datasets across education, legal, healthcare, customer support, lifestyle reviews, and open-domain knowledge. |
VIMQA: A Vietnamese Dataset for Advanced Reasoning and Explainable Multi-hop Question Answering (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing Vietnamese Question Answering (QA) datasets do not explore the model’s ability to perform advanced reasoning and provide evidence to explain the answer. |
| Approach: | They propose to use Vietnamese as a question-answer dataset with 10,000 Wikipedia-based multi-hop question-and-answ pairs to test model's ability to reason and explain the answer. |
| Outcome: | The proposed dataset is in Vietnamese, a low-resource language. |
PhoBERT: Pre-trained language models for Vietnamese (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that PhoBERT outperforms the recent best pre-trained multilingual model XLM-R in multiple Vietnamese-specific NLP tasks. |
| Approach: | They present PhoBERT with two versions, Phobert-base and PhoBRET-large, which are pre-trained for Vietnamese. |
| Outcome: | The proposed model outperforms the best pre-trained model XLM-R and improves the state-of-the-art in multiple Vietnamese-specific NLP tasks including Part-of speech tagging, Dependency parsing, Named-entity recognition and Natural language inference. |
Paraphrasing with Large Language Models (D19-56)
Copied to clipboard
| Challenge: | Recent work has shown large language models are adept at text generation and fine-tuning for downstream NLP tasks. |
| Approach: | They propose a system that generates paraphrased examples in autoregressive fashion using a neural network without the need for techniques such as top-k word selection or beam search. |
| Outcome: | The proposed system generates paraphrased examples in autoregressive fashion without the need for techniques such as top-k word selection or beam search. |
ParaNMT-50M: Pushing the Limits of Paraphrastic Sentence Embeddings with Millions of Machine Translations (P18-1)
Copied to clipboard
| Challenge: | Using neural machine translation, we generate more than 50 million sentential paraphrase pairs from a large parallel corpus. |
| Approach: | They use a dataset of more than 50 million English-English sentential paraphrase pairs to generate them automatically using neural machine translation. |
| Outcome: | The proposed dataset outperforms all supervised systems on every SemEval semantic textual similarity competition and shows how it can be used for paraphrase generation. |
ParaAMR: A Large-Scale Syntactically Diverse Paraphrase Dataset by AMR Back-Translation (2023.acl-long)
Copied to clipboard
| Challenge: | Paraphrase generation is a long-standing task in natural language processing (NLP). |
| Approach: | They propose to generate large-scale syntactically diverse paraphrase datasets by abstract meaning representation back-translation. |
| Outcome: | The proposed dataset is syntactically more diverse than existing datasets while maintaining good semantic similarity. |