Challenge: a dataset of 40k information-seeking questions across seven languages is used to answer multilingual question answering tasks.
Approach: They propose a task framework that allows questions from one language to be answered via answer content from another language.
Outcome: The proposed framework can be used to answer questions from one language to another . the dataset was built on 40K questions across 7 languages, but could not find same-language answers .

Similar Papers

Towards more equitable question answering systems: How much more data do you need? (2021.acl-short)

Copied to clipboard

Challenge: Question answering datasets in English are relatively new, but lack of linguistic diversity in the field is a challenge.
Approach: They propose to use translation and cross-lingual transfer to produce QA systems in multiple languages to improve their performance.
Outcome: The proposed approaches take advantage of existing resources to produce QA systems in multiple languages.
Addressing Issues of Cross-Linguality in Open-Retrieval Question Answering Systems For Emergent Domains (2023.eacl-demo)

Copied to clipboard

Challenge: a lack of cross-lingual training data in emergent domains makes it difficult to train on emerging domains.
Approach: They propose a cross-lingual open-retrieval question answering system for COVID-19 . their system adopts a corpus of scientific articles to ensure that retrieved documents are reliable.
Outcome: The proposed system outperforms BM25 baselines in cross-lingual settings.
XQA: A Cross-lingual Open-domain Question Answering Dataset (P19-1)

Copied to clipboard

Challenge: Open-domain question answering aims to answer questions through text retrieval and reading comprehension . but, the success of these models relies on a massive volume of training data, which is not available in other languages . a new dataset aims at investigating cross-lingual OpenQA .
Approach: They propose to use a dataset for cross-lingual OpenQA research to test models . they use XQA dataset to train models with large volumes of labeled data .
Outcome: The proposed model achieves best results in almost all target languages while the performance is lower than that of English.
Multi-Domain Multilingual Question Answering (2021.emnlp-tutorials)

Copied to clipboard

Challenge: Question answering (QA) is one of the most challenging tasks in natural language processing.
Approach: a tutorial examines the state-of-the-art approaches to multi-domain and multilingual QA . they introduce standard benchmarks and discuss out-of the-box training with open-domain QA systems .
Outcome: This tutorial aims to bridge the gap between open-domain and multilingual QA.
TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages (2020.tacl-1)

Copied to clipboard

Challenge: Existing models for multilingual modeling are based on a set of typological features that are used to express meaning in languages such as English.
Approach: They present a question-answer-typed question-referenced dataset that covers 11 typologically diverse languages with 204K question-and-answered pairs.
Outcome: The proposed dataset covers 11 typologically diverse languages with 204K question-answer pairs.
MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering (2021.tacl-1)

Copied to clipboard

Challenge: Existing multilingual QA datasets lack linguistic diversity and comparable evaluation between languages.
Approach: They propose a multilingual question-answer evaluation set with 10k English queries and human translations of them into 25 additional languages and dialects.
Outcome: The proposed model is based on a multilingual knowledge questions and answers evaluation set with 26 languages.
Cross-Lingual Open-Domain Question Answering with Answer Sentence Generation (2022.aacl-main)

Copied to clipboard

Challenge: Open-Domain Generative Question Answering has achieved impressive performance in English . combining document-level retrieval with answer generation can generate complete sentences .
Approach: They propose an open-domain approach that combines document retrieval with answer generation to generate complete sentences in English . they propose a cross-lingual generative model that exploits passages written in multiple languages .
Outcome: The proposed model outperforms answer sentence selection baselines for all 5 languages and monolingual pipelines for three out of five languages.
xPQA: Cross-Lingual Product Question Answering in 12 Languages (2023.acl-industry)

Copied to clipboard

Challenge: Existing work on product question answering systems focuses mainly on English, but in practice there is need to support multiple customer languages while leveraging product information available in English.
Approach: They present a large-scale annotated cross-lingual PQA dataset in 12 languages and evaluate three approaches to generating a natural-sounding non-English answer.
Outcome: The proposed dataset supports crosslingual product question answering (PQA) systems that provide answers to customers’ questions as they shop for products.
McCrolin: Multi-consistency Cross-lingual Training for Retrieval Question Answering (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches struggle with consistency across multiple languages and multi-size input scenarios.
Approach: They propose a cross-lingual training framework that leverages multi-task learning to enhance cross-linguistic consistency and ranking stability.
Outcome: The proposed training framework outperforms competitors on various input sizes and architectures.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations