From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text (2021.acl-long)
Copied to clipboard
| Challenge: | a computational model for code-switching text is lacking in the corpus of real text. |
| Approach: | They propose a neural machine translation model to generate Hindi-English code-switched sentences using monolingual Hindi sentences. |
| Outcome: | The proposed model reduces perplexity on a language modeling task and improves on linguistic inference tasks. |
Similar Papers
Code-switched Language Models Using Dual RNNs and Same-Source Pretraining (D18-1)
Copied to clipboard
| Challenge: | Using recurrent neural networks to build language models for code-switched text is an important problem with implications to downstream applications such as speech recognition and machine translation. |
| Approach: | They propose a novel recurrent neural network unit with dual components that focus on each language in the code-switched text separately and a generative model estimated using the training data. |
| Outcome: | The proposed techniques yield significant reductions in perplexity on Mandarin-English task and improve on baseline models. |
A Semi-supervised Approach to Generate the Code-Mixed Text using Pre-trained Encoder and Transfer Learning (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to train neural network-based models for code-mixing are limited due to language specificity of code-mixed text. |
| Approach: | They propose a deep learning approach to generate code-mixed text from English to multiple languages without any parallel data. |
| Outcome: | The proposed approach generates a code-mixed text from English to multiple languages without any parallel data. |
CoCoa: An Encoder-Decoder Model for Controllable Code-switched Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Generating code-switched text with fine-grained control on the degree of code-witching and the lexical choices used to convey formality has been well-explored. |
| Approach: | They propose to generate code-switched text with fine-grained control on the degree of code-changing and lexical choices used to convey formality. |
| Outcome: | The proposed model can be invoked at test-time to synthesize code-switched text faithful to syntactic and lexical attributes relevant to code-witching. |
Exploring Enhanced Code-Switched Noising for Pretraining in Neural Machine Translation (2023.findings-eacl)
Copied to clipboard
| Challenge: | Multilingual pretraining approaches to denoise synthetic code-switched data have shown that they generate the noise using non-contextual, one-to-one word translations obtained from lexicons. |
| Approach: | They propose an approach where contextual, many-to-many word translations are generated using a ‘base’ NMT model. |
| Outcome: | The proposed approach improves on 3 different language families and shows that small models can perform better than massive models like mBART50 and mRASP2 . |
Code-Mixed Probes Show How Pre-Trained Models Generalise on Code-Switched Text (2024.lrec-main)
Copied to clipboard
| Challenge: | Code-switching is a prevalent linguistic phenomenon in which multilingual individuals seamlessly alternate between languages. |
| Approach: | They propose to use pre-trained language models to generalise to code-switched text . they use a dataset of well-formed naturalistic code-witched texts and parallel translations into the source languages to examine their results. |
| Outcome: | The proposed model generalises to code-switched text, shedding light on their ability to generalise representations to CS corpora. |
LLM-based Code-Switched Text Generation for Grammatical Error Correction (2024.emnlp-main)
Copied to clipboard
| Challenge: | Code-switching (CSW) is a part of multilingual conversation and is gaining popularity in social and professional settings. |
| Approach: | They propose to use synthetic data to generate a model capable of correcting grammatical errors in CSW texts. |
| Outcome: | The proposed model improves on existing systems on an authentic dataset from English as a second language learners. |
Data Augmentation Techniques for Machine Translation of Code-Switched Texts: A Comparative Study (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Code-switching (CSW) text generation is a popular solution to address data scarcity. |
| Approach: | They compare linguistic theories, lexical replacements and back-translation approaches to Egyptian Arabic-English CSW. |
| Outcome: | The proposed methods perform best on machine translation and quality evaluation. |
Code-Switched Text Synthesis in Unseen Language Pairs (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing efforts on text synthesis for code-switching require training on code-witched texts in the target language pairs. |
| Approach: | They propose a model that synthesizes code-switched texts for language pairs absent from training data by adding an additional code-sharing module to a pre-trained machine translation model. |
| Outcome: | The proposed model synthesizes code-switched texts for language pairs lacking from training data. |
Universal Dependency Parsing for Hindi-English Code-Switching (N18-1)
Copied to clipboard
| Challenge: | Code-switching data often need additional processes such as language identification, normalization and/or back-transliteration to be processed. |
| Approach: | They propose a neural stacking model that leverages part-of-speech tags and syntactic tree annotations in tweets to parse code-switching data. |
| Outcome: | The proposed model is 1.5% better than the augmented model and 3.8% better than one which uses first-best normalization and/or back-transliteration. |
Automatic and Human-AI Interactive Text Generation (with a focus on Text Simplification and Revision) (2024.acl-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we focus on text-to-text generation, a class of natural language generation tasks, that takes a piece of text as input and then generates a revision that is improved according to some specific criteria. |
| Approach: | This tutorial focuses on text-to-text generation, a class of natural language generation tasks that takes a piece of text as input and generates a revision that is improved according to some specific criteria. |
| Outcome: | This tutorial focuses on text-to-text generation, a class of natural language generation tasks, that takes a piece of text as input and generates a revision that is improved according to some specificcriteria. |