A logical-based corpus for cross-lingual evaluation (D19-61)

Copied to clipboard

Challenge: a recent study shows that deep learning models can be used to solve textual inference tasks using simple linguistic patterns.
Approach: They propose a set of syntactic tasks focused on contradiction detection that exploit linguistic patterns.
Outcome: The proposed tasks can be implemented in English and Portuguese.

Similar Papers

Baselines and Test Data for Cross-Lingual Inference (L18-1)

Copied to clipboard

Challenge: Recent research on textual entailment is limited to English, but it is expanding to other languages.
Approach: They propose to extend the research in SNLI-style natural language inference toward multilingual evaluation by using cross-lingual word embeddings and machine translation.
Outcome: The proposed system scores an average accuracy of just over 75%, but it is not perfect.
Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models (2023.findings-acl)

Copied to clipboard

Challenge: Existing pre-trained language models that ignore the logical structures underlying natural language text often lack the ability to capture and encode key logical information in the input sequences.
Approach: They propose to construct logic-aware input embeddings for transformer language models through logic detection, logic mapping and hierarchical logical projections and then develop a new modeling paradigm that can upgrade existing transformer language model into logical transformers to boost their performance.
Outcome: The proposed model can achieve superior performance on four important and challenging tasks.
A Deep Transfer Learning Method for Cross-Lingual Natural Language Inference (2022.lrec-1)

Copied to clipboard

Challenge: Natural Language Inference (NLI) is a crucial task in AI and natural language processing.
Approach: They propose an effective transfer learning approach for cross-lingual NLI . they perform experiments on English-Hindi language pairs in cross-linguistic setting .
Outcome: The proposed model improves the baseline model by 10% over the state-of-the-art model.
Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models (2021.findings-acl)

Copied to clipboard

Challenge: Multilingual Transformer-based language models have been shown to be excellent learners in crosslingual transfer tasks.
Approach: They evaluate the syntactic generalization capabilities of BERT and RoBERTa models on English and Spanish tests.
Outcome: The proposed models perform well on English and Spanish tests, and the proposed tests are compared against models on the same language and models on two different languages.
Emerging Cross-lingual Structure in Pretrained Language Models (2020.acl-main)

Copied to clipboard

Challenge: Recent work has shown that multilingual pretraining works, but is unable to measure these effects.
Approach: They propose to use multilingual masked language modeling to train a model on concatenated text from multiple languages to find universal latent symmetries in embedding spaces.
Outcome: The proposed models can be trained on concatenated text from multiple languages without shared vocabulary or domain similarity.
XNLI: Evaluating Cross-lingual Sentence Representations (D18-1)

Copied to clipboard

Challenge: State-of-the-art natural language processing systems rely on annotated data to learn competent models.
Approach: They extend the development and test sets of the Multi-Genre Natural Language Inference Corpus to 14 languages, including Swahili and Urdu.
Outcome: The proposed evaluation set extends the development and test sets of the Multi-Genre Natural Language Inference Corpus (MultiNLI) to 14 languages including low-resource languages such as Swahili and Urdu.
Combining Deep Generative Models and Multi-lingual Pretraining for Semi-supervised Document Classification (2021.eacl-main)

Copied to clipboard

Challenge: Semi-supervised learning and multilingual pretraining have been shown to be effective for task-specific labelled data shortages.
Approach: They propose to combine semi-supervised deep generative models and multi-lingual pretraining to form a pipeline for document classification task.
Outcome: The proposed method outperforms state-of-the-art models in low-resource settings across several languages and outperformed existing models in English.
New Datasets for Automatic Detection of Textual Entailment and of Contradictions between Sentences in French (2024.lrec-main)

Copied to clipboard

Challenge: DACCORD is a dataset for automatic detection of contradictions between sentences . it is the first dataset exclusively dedicated to this task .
Approach: They introduce DACCORD, a dataset in French for automatic detection of contradictions between sentences.
Outcome: The proposed datasets are more challenging than existing datasets for the mainstream task in French.
Model-Agnostic Cross-Lingual Training for Discourse Representation Structure Parsing (2024.lrec-main)

Copied to clipboard

Challenge: Discourse Representation Structure (DRS) parsers are constrained when trained exclusively on monolingual data.
Approach: They propose a cross-lingual training strategy that leverages cross-linguistic training data to train models in multiple languages.
Outcome: The proposed method improves clause and graph parsing in English, German, Italian and Dutch.
A Checkpoint on Multilingual Misogyny Identification (2022.acl-srw)

Copied to clipboard

Challenge: a study on hate speech against minorities in Italian tweets found that 1 women are the most targeted group.
Approach: They propose to train monolingual transformers and multilingual transformer models with monolingual data in English, Italian, and Spanish to detect misogyny in tweets.
Outcome: The proposed model achieves state-of-the-art on English, Italian, and Spanish.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations