Challenge: Recent work on code mixing in computational settings has leveraged social media code mixed texts to train NLP models.
Approach: They propose to use language ID tags to measure syntactic variety in code-mixed text and their relationship with computational model performance.
Outcome: The proposed measure can be applied to English(en)-hindi(hi) code-mixed datasets and compares them with other measures.

Similar Papers

Minority Positive Sampling for Switching Points - an Anecdote for the Code-Mixing Language Modeling (2020.lrec-1)

Copied to clipboard

Challenge: Multilingual people code-mix using English phonetic typing and insertion of anglicisms in their native language.
Approach: They propose to use minority positive sampling to selectively induce more sample to achieve better performance.
Outcome: The proposed model performs better than other models, but switching points are the main challenge .
MHE: Code-Mixed Corpora for Similar Language Identification (2022.lrec-1)

Copied to clipboard

Challenge: a new corpus of code-mixed data-sets is presented for similar language identification . the data-settings are based on a more-resourced minority language, Magahi .
Approach: They propose a Magahi-Hindi-English code-mixed corpus for similar language identification . they discuss the complexity of the data-set and provide a few baselines .
Outcome: The proposed corpus provides a language id at two levels: word and sentence.
Processing and Understanding Mixed Language Data (D19-2)

Copied to clipboard

Challenge: Multilingual communities exhibit code-mixing, mixing of two or more languages in a single conversation . social media and other informal interactive platforms are allowing code-switching in user-generated text .
Approach: a tutorial aims to provide a foundation for researchers to study code-mixing in multilingual communities.
Outcome: a tutorial aims to provide new researchers with a foundation in linguistics and computational aspects of code-mixing.
TweetTaglish: A Dataset for Investigating Tagalog-English Code-Switching (2022.lrec-1)

Copied to clipboard

Challenge: a large dataset is available to study Tagalog-English code-switching in low-resource settings.
Approach: They propose to use a large dataset to investigate Tagalog-English code-switching . they use linguistic data from Tagalogue and Tagalit-English to investigate their results .
Outcome: The proposed dataset achieves a strong performance benchmark for Tagalog-English code-switching.
CodeMixBench: Evaluating Code-Mixing Capabilities of LLMs Across 18 Languages (2025.emnlp-main)

Copied to clipboard

Challenge: Existing benchmarks for large language models (LLMs) are limited by their narrow language pairs and tasks, failing to adequately assess their code-mixing abilities.
Approach: They propose a benchmark to assess large language models' (LLMs) code-mixing abilities that covers eight tasks and 18 languages from seven language families.
Outcome: The proposed method combines word substitution with GPT-4 prompting to generate large-scale synthetic code-mixed texts.
Exploring Methods for Building Dialects-Mandarin Code-Mixing Corpora: A Case Study in Taiwanese Hokkien (2022.findings-emnlp)

Copied to clipboard

Challenge: CM is a challenging task when mixed languages include dialects.
Approach: They propose to construct a Hokkien-Mandarin CM dataset to overcome the limitation . they propose to use a linguistics-based toolkit to train the model for translation tasks .
Outcome: The proposed model achieves good results on CM data translation while maintaining monolingual translation quality.
Do LLMs model human linguistic variation? A case study in Hindi-English Verb code-mixing (2026.findings-eacl)

Copied to clipboard

Challenge: Existing large language models (LLMs) do not reliably classify verb language preferences to match native speaker judgments.
Approach: They investigate whether large language models (LLMs) model linguistic variation by comparing Hindi-English verb code-mixing with English verb karna.
Outcome: The proposed models do not reliably classify verb language preferences to match native speaker judgments, but with specific supervision, some models do predict human preference to an extent.
Lost in the Mix: Evaluating LLM Understanding of Code-Switched Text (2026.acl-long)

Copied to clipboard

Challenge: Code-switching (CSW) is widespread in multilingual communities and increasingly prevalent in online content.
Approach: They propose a pipeline for producing linguistically grounded CSW variants of established benchmarks across five typologically diverse languages.
Outcome: The proposed model sets show that inserting non-English tokens into English reduces accuracy on comprehension and reasoning benchmarks, whereas embedding English into non- English contexts often improves it.
MaCmS: Magahi Code-mixed Dataset for Sentiment Analysis (2024.lrec-main)

Copied to clipboard

Challenge: Sociolinguists and psychologists have been studying these variations in the lexicons and the language from the 50's . code-mixing is a popular method for understanding people's emotions and attitudes towards various subjects, but low-resourced languages often have a mix of scripts and languages.
Approach: They introduce a new sentiment data, MaCMS, for Magahi-Hindi-English code-mixed language, where Magai is a less-resourced minority language.
Outcome: The proposed dataset is the first Magahi-Hindi-English code-mixed dataset for sentiment analysis tasks.
Language Modeling for Code-Mixing: The Role of Linguistic Theory based Synthetic Data (P18-1)

Copied to clipboard

Challenge: Code-mixed (CM) language training is a difficult problem because of lack of data and the increased confusability due to the presence of more than one language.
Approach: They propose a computational technique for creating grammatically valid artificial CM data based on the Equivalence Constraint Theory.
Outcome: The proposed method reduces the perplexity of the model and does not reduce the perceptibility of the models.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations