Papers by Charitha Rathnayaka
Improving the Quality of Web-mined Parallel Corpora of Low-Resource Languages using Debiasing Heuristics (2025.emnlp-main)
Copied to clipboard
| Challenge: | Parallel Data Curation (PDC) techniques aim to filter out noisy parallel sentences from web-mined corpora. |
| Approach: | They propose to rank parallel sentences using similarity scores on sentence embeddings derived from Pre-trained Multilingual Language Models (multiPLMs) . previous research has shown that the choice of multiPLM significantly impacts the quality of the filtered parallel corpus. |
| Outcome: | The proposed methods reduce disparities between multiPLMs while producing better results. |