Humanistic Buddhism Corpus: A Challenging Domain-Specific Dataset of English Translations for Classical and Modern Chinese (2024.lrec-main)
Copied to clipboard
| Challenge: | Compared to existing machine translation datasets, HBC presents unique challenges . classical and modern Chinese texts are often translated in distant languages . |
| Approach: | They propose a dataset containing 80,000 Chinese-English parallel phrases extracted and translated from publications in the domain of Buddhism. |
| Outcome: | The Humanistic Buddhism Corpus (HBC) contains 80,000 parallel Chinese-English phrases extracted and translated from publications in the domain of Buddhism. |
Similar Papers
The DReaM Corpus: A Multilingual Annotated Corpus of Grammars for the World’s Languages (2020.lrec-1)
Copied to clipboard
| Challenge: | Until recently, language descriptions were available in paper form only, with indexes as the only search aid. |
| Approach: | They propose to digitize a multilingual corpus of language descriptions and annotate it with various meta, word, and text attributes to make searching and analysis easier and more useful. |
| Outcome: | The proposed corpus is searchable through a couple of well-established corpus infrastructures. |
The Johns Hopkins University Bible Corpus: 1600+ Tongues for Typological Exploration (2020.lrec-1)
Copied to clipboard
Arya D. McCarthy, Rachel Wicks, Dylan Lewis, Aaron Mueller, Winston Wu, Oliver Adams, Garrett Nicolai, Matt Post, David Yarowsky
| Challenge: | Our corpus spans 1611 diverse written languages, with constituents of more than 90 language families. |
| Approach: | They propose to scrape and merge online resources and merge them with existing corpora to create a verse-parallel scheme for all translations. |
| Outcome: | The results show that the Bible provides high coverage of core vocabulary. |
Samayik: A Benchmark and Dataset for English-Sanskrit Translation (2024.lrec-main)
Copied to clipboard
Ayush Maheshwari, Ashim Gupta, Amrith Krishna, Atul Kumar Singh, Ganesh Ramakrishnan, Anil Kumar Gourishetty, Jitin Singla
| Challenge: | Existing Sanskrit corpora focus on poetry and offer limited coverage of contemporary written materials. |
| Approach: | They release a dataset of 53,000 parallel English-Sanskrit sentences . they use spoken content that covers contemporary world affairs and interpretations . |
| Outcome: | a new dataset of 53,000 parallel English-Sanskrit sentences is released . the dataset outperforms existing models trained on older classical-era poetry datasets . |
MANTA: A Scalable Pipeline for Transmuting Massive Web Corpora into Instruction Datasets (2025.findings-emnlp)
Copied to clipboard
| Challenge: | MANTA-1M generates high-quality large-scale instruction fine-tuning datasets from web corpora . scalability and diversity of the datasets are preserved, allowing expansion into domains requiring intensive knowledge. |
| Approach: | a team of researchers introduce a pipeline that fine-tunes large-scale instruction datasets from web corpora with minimal human intervention. |
| Outcome: | MANTA generates high-quality large-scale instruction fine-tuning datasets from web corpora . leveraging high-performance LLMs, MANTE outperforms other methods in knowledge-intensive tasks . |
Embeddings models for Buddhist Sanskrit (2022.lrec-1)
Copied to clipboard
| Challenge: | Despite extensive scholarly endeavors, much uncertainty still surrounds this body of literature, especially regarding matters of chronology, authorship, compositional history. |
| Approach: | They propose a corpus of Buddhist texts, a general corpus and word similarity and word analogy datasets for embeddings models. |
| Outcome: | The proposed models perform better on semantic similarity and word analogy tasks than on contextual models. |
CKnowEdit: A New Chinese Knowledge Editing Dataset for Linguistics, Facts, and Logic Error Correction in LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | CKnowEdit is the first-ever knowledge editing dataset designed to correct linguistic, factual, and logical errors in Large Language Models. |
| Approach: | They propose a Chinese knowledge editing dataset to correct linguistic, factual, and logical errors in Large Language Models. |
| Outcome: | The proposed dataset highlights the challenges that LLMs face in mastering Chinese . CKnowEdit can correct linguistic, factual, and logical errors in Chinese, the authors show . |
Discourse-Centric Evaluation of Document-level Machine Translation with a New Densely Annotated Parallel Corpus of Novels (2023.acl-long)
Copied to clipboard
| Challenge: | Several recent papers claim to have achieved human parity at sentence-level machine translation. |
| Approach: | They propose to use a dataset with rich discourse annotations to evaluate MT performance . they find that MT outputs differ fundamentally from human translations in terms of latent discourse structures. |
| Outcome: | The proposed dataset builds upon the large-scale parallel corpus BWB . it covers 15,095 entity mentions in both languages and compares them to human translations . |
From Shijing to English and German: Resources and Evaluation for LLM Translation of Early Chinese Poetry (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) show promise in literary translation, but their performance in poetry remains unexplored. |
| Approach: | They propose a framework that integrates knowledge-driven, rule-based, and LLM-as-judge metrics into a Shijing corpus . their code, lexical KB, and corpus reconstruction protocols are available at https://github.com/ML-KULeuven/ShijingLLMTrans. |
| Outcome: | The proposed framework achieves higher human correlation than traditional metrics and high statistical stability. |
A Multilingual Multiway Evaluation Data Set for Structured Document Translation of Asian Languages (2022.findings-aacl)
Copied to clipboard
| Challenge: | a lack of evaluation data sets for structured content limits progress in machine translation . a common use case of machine translation is the translation of structured or formatted documents . |
| Approach: | They propose a multilingual multiway evaluation data set for machine translation of structured documents of Asian languages Japanese, Korean and Chinese. |
| Outcome: | The proposed data set is well suited for multilingual evaluation and contains richer annotation tag sets than existing data sets. |
Translation via Annotation: A Computational Study of Translating Classical Chinese into Japanese (2026.eacl-long)
Copied to clipboard
| Challenge: | Ancient people translated classical Chinese into Japanese using a system of annotations placed around characters. |
| Approach: | They propose to introduce an LLM-based annotation pipeline and construct a dataset from digitized open-source translation data to improve sequence tagging tasks. |
| Outcome: | The proposed method achieves high scores on direct machine translation, but could serve as a supplement to LLMs to improve the quality of character’s annotation. |