Minority Positive Sampling for Switching Points - an Anecdote for the Code-Mixing Language Modeling (2020.lrec-1)
Copied to clipboard
| Challenge: | Multilingual people code-mix using English phonetic typing and insertion of anglicisms in their native language. |
| Approach: | They propose to use minority positive sampling to selectively induce more sample to achieve better performance. |
| Outcome: | The proposed model performs better than other models, but switching points are the main challenge . |
Similar Papers
Exploring Methods for Building Dialects-Mandarin Code-Mixing Corpora: A Case Study in Taiwanese Hokkien (2022.findings-emnlp)
Copied to clipboard
| Challenge: | CM is a challenging task when mixed languages include dialects. |
| Approach: | They propose to construct a Hokkien-Mandarin CM dataset to overcome the limitation . they propose to use a linguistics-based toolkit to train the model for translation tasks . |
| Outcome: | The proposed model achieves good results on CM data translation while maintaining monolingual translation quality. |
Language Modeling for Code-Mixing: The Role of Linguistic Theory based Synthetic Data (P18-1)
Copied to clipboard
| Challenge: | Code-mixed (CM) language training is a difficult problem because of lack of data and the increased confusability due to the presence of more than one language. |
| Approach: | They propose a computational technique for creating grammatically valid artificial CM data based on the Equivalence Constraint Theory. |
| Outcome: | The proposed method reduces the perplexity of the model and does not reduce the perceptibility of the models. |
Processing and Understanding Mixed Language Data (D19-2)
Copied to clipboard
| Challenge: | Multilingual communities exhibit code-mixing, mixing of two or more languages in a single conversation . social media and other informal interactive platforms are allowing code-switching in user-generated text . |
| Approach: | a tutorial aims to provide a foundation for researchers to study code-mixing in multilingual communities. |
| Outcome: | a tutorial aims to provide new researchers with a foundation in linguistics and computational aspects of code-mixing. |
SyMCoM - Syntactic Measure of Code Mixing A Study Of English-Hindi Code-Mixing (2022.findings-acl)
Copied to clipboard
| Challenge: | Recent work on code mixing in computational settings has leveraged social media code mixed texts to train NLP models. |
| Approach: | They propose to use language ID tags to measure syntactic variety in code-mixed text and their relationship with computational model performance. |
| Outcome: | The proposed measure can be applied to English(en)-hindi(hi) code-mixed datasets and compares them with other measures. |
Lost in the Mix: Evaluating LLM Understanding of Code-Switched Text (2026.acl-long)
Copied to clipboard
| Challenge: | Code-switching (CSW) is widespread in multilingual communities and increasingly prevalent in online content. |
| Approach: | They propose a pipeline for producing linguistically grounded CSW variants of established benchmarks across five typologically diverse languages. |
| Outcome: | The proposed model sets show that inserting non-English tokens into English reduces accuracy on comprehension and reasoning benchmarks, whereas embedding English into non- English contexts often improves it. |
Beyond Monolingual Assumptions: A Survey on Code-Switched NLP in the Era of Large Language Models across Modalities (2026.acl-long)
Copied to clipboard
| Challenge: | Amidst the rapid advances of large language models, most LLMs struggle with mixed-language inputs, limited Code-switching datasets, and evaluation biases. |
| Approach: | They propose a roadmap for inclusive datasets, fair evaluation, and linguistically grounded models to achieve truly multilingual intelligence. |
| Outcome: | The proposed frameworks are based on 327 studies spanning five research areas, 15+ NLP tasks, 30+ datasets, and 80+ languages. |
From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text (2021.acl-long)
Copied to clipboard
| Challenge: | a computational model for code-switching text is lacking in the corpus of real text. |
| Approach: | They propose a neural machine translation model to generate Hindi-English code-switched sentences using monolingual Hindi sentences. |
| Outcome: | The proposed model reduces perplexity on a language modeling task and improves on linguistic inference tasks. |
CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languages (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing benchmarks for large language models (LLMs) are limited by their narrow language pairs and tasks, failing to adequately assess their code-mixing abilities. |
| Approach: | They propose a benchmark to assess large language models' (LLMs) code-mixing abilities that covers eight tasks and 18 languages from seven language families. |
| Outcome: | The proposed method combines word substitution with GPT-4 prompting to generate large-scale synthetic code-mixed texts. |
MaCmS: Magahi Code-mixed Dataset for Sentiment Analysis (2024.lrec-main)
Copied to clipboard
| Challenge: | Sociolinguists and psychologists have been studying these variations in the lexicons and the language from the 50's . code-mixing is a popular method for understanding people's emotions and attitudes towards various subjects, but low-resourced languages often have a mix of scripts and languages. |
| Approach: | They introduce a new sentiment data, MaCMS, for Magahi-Hindi-English code-mixed language, where Magai is a less-resourced minority language. |
| Outcome: | The proposed dataset is the first Magahi-Hindi-English code-mixed dataset for sentiment analysis tasks. |
Code-Mixed Probes Show How Pre-Trained Models Generalise on Code-Switched Text (2024.lrec-main)
Copied to clipboard
| Challenge: | Code-switching is a prevalent linguistic phenomenon in which multilingual individuals seamlessly alternate between languages. |
| Approach: | They propose to use pre-trained language models to generalise to code-switched text . they use a dataset of well-formed naturalistic code-witched texts and parallel translations into the source languages to examine their results. |
| Outcome: | The proposed model generalises to code-switched text, shedding light on their ability to generalise representations to CS corpora. |