Automatic Spanish Translation of SQuAD Dataset for Multi-lingual Question Answering (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods to train multilingual QA systems are limited for other languages . cross-lingual learning is a technique that transfers knowledge from source to target language with fewer training data. |
| Approach: | They propose a translation method to translate the Stanford Question Answering Dataset to Spanish and a multilingual-BERT model to train Spanish QA systems. |
| Outcome: | The proposed method outperforms the previous benchmarks for cross-lingual extractive QA. |
Similar Papers
MLQA: Evaluating Cross-lingual Extractive Question Answering (2020.acl-main)
Copied to clipboard
| Challenge: | Question answering (QA) models have shown rapid progress enabled by the availability of large, high-quality benchmark datasets. |
| Approach: | They present a multi-way aligned extractive QA evaluation benchmark in 7 languages . they evaluate state-of-the-art cross-lingual models and machine-translation-based baselines . |
| Outcome: | The proposed model is based on MLQA, which has over 12K instances in english and 5K in each other language. |
Semi-supervised Training Data Generation for Multilingual Question Answering (L18-1)
Copied to clipboard
| Challenge: | Existing datasets for question answering (QA) tasks mostly support only English . however, existing resources for these tasks are labor intensive . |
| Approach: | They propose to combine Korean QA datasets with machine-translated English resources to build seed resources. |
| Outcome: | The proposed approach leads to 71.50 F1 on Korean QA (comparable to 77.3 F1) |
Towards more equitable question answering systems: How much more data do you need? (2021.acl-short)
Copied to clipboard
| Challenge: | Question answering datasets in English are relatively new, but lack of linguistic diversity in the field is a challenge. |
| Approach: | They propose to use translation and cross-lingual transfer to produce QA systems in multiple languages to improve their performance. |
| Outcome: | The proposed approaches take advantage of existing resources to produce QA systems in multiple languages. |
UQA: Corpus for Urdu Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | Urdu is a low-resource language with over 70 million native speakers . expanding the reach of NLP to languages other than English is crucial for advancing multilingual AI systems. |
| Approach: | They introduce a novel dataset for question answering and text comprehension in Urdu . they use a technique called EATS which preserves the answer spans in translated context paragraphs . |
| Outcome: | The proposed dataset preserves answer spans in translated context paragraphs. |
PAXQA: Generating Cross-lingual Question Answering Examples at Training Scale (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing question answering systems rely on large, high-quality training data. |
| Approach: | They propose a synthetic data generation method which decomposes cross-lingual QA into two stages . they apply a question generation model to the English side and annotation projection to translate both questions and answers. |
| Outcome: | The proposed method outperforms existing methods on cross-lingual QA datasets. |
XQA: A Cross-lingual Open-domain Question Answering Dataset (P19-1)
Copied to clipboard
| Challenge: | Open-domain question answering aims to answer questions through text retrieval and reading comprehension . but, the success of these models relies on a massive volume of training data, which is not available in other languages . a new dataset aims at investigating cross-lingual OpenQA . |
| Approach: | They propose to use a dataset for cross-lingual OpenQA research to test models . they use XQA dataset to train models with large volumes of labeled data . |
| Outcome: | The proposed model achieves best results in almost all target languages while the performance is lower than that of English. |
From Monolingual to Multilingual FAQ Assistant using Multilingual Co-training (D19-61)
Copied to clipboard
Mayur Patidar, Surabhi Kumari, Manasi Patwardhan, Shirish Karande, Puneet Agarwal, Lovekesh Vig, Gautam Shroff
| Challenge: | Recent research on cross-lingual transfer shows state-of-the-art results on benchmark datasets using pre-trained language representation models like BERT. |
| Approach: | They propose a method to augment an annotated dataset with machine translations in target languages and fine-tune the PLRM jointly. |
| Outcome: | The proposed approach provides consistent gains on multiple benchmark datasets while requiring a single model for multiple languages. |
Cross-lingual and Cross-domain Evaluation of Machine Reading Comprehension with Squad and CALOR-Quest Corpora (2020.lrec-1)
Copied to clipboard
| Challenge: | a recent study has shown that language mismatch and domain mismatch can affect performance of a machine reading task . a factor between language mismatched and domain-mismatched has the strongest influence on performance . |
| Approach: | They compare the cross-language and cross-domain capabilities of BERT on a machine reading comprehension task on two corpora: SQuAD and a new French Machine Reading dataset. |
| Outcome: | The proposed model matches human performance on a machine reading comprehension task with BERT on Chinese and French documents with interesting results. |
Question Translation Training for Better Multilingual Reasoning (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models have shown compelling performance on reasoning tasks but they tend to perform much worse in languages other than English. |
| Approach: | They propose to train a model to translate reasoning questions into English by fine tuning on X-English parallel question data. |
| Outcome: | The proposed approach improves on LLaMA2-13B on the MGSM and MSVAMP multilingual reasoning benchmarks. |
Multi-Domain Multilingual Question Answering (2021.emnlp-tutorials)
Copied to clipboard
| Challenge: | Question answering (QA) is one of the most challenging tasks in natural language processing. |
| Approach: | a tutorial examines the state-of-the-art approaches to multi-domain and multilingual QA . they introduce standard benchmarks and discuss out-of the-box training with open-domain QA systems . |
| Outcome: | This tutorial aims to bridge the gap between open-domain and multilingual QA. |