XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyond (2022.lrec-1)
Copied to clipboard
| Challenge: | Language models are ubiquitous in NLP, but current analyses focus on (multilingual variants of) standard benchmarks and task-specific corpora as multilingual signals. |
| Approach: | They propose a model to train and evaluate multilingual language models in Twitter using a set of Twitter datasets in eight different languages and a XLM-T model. |
| Outcome: | The proposed model trains and evaluates multilingual models on Twitter. |
Similar Papers
M2SA: Multimodal and Multilingual Model for Sentiment Analysis of Tweets (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies on sentiment analysis of tweets focus on the English language . however, there is still a challenge of processing lower-resourced languages . |
| Approach: | They transform tweet sentiment dataset into a multimodal format through a straightforward curation process. |
| Outcome: | The proposed approach performs exceptionally well in unimodal and multimodal configurations. |
Bernice: A Multilingual Pre-trained Encoder for Twitter (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing language models for Twitter are monolingual, adapted from other domains, or trained on limited amount of in-domain data. |
| Approach: | They propose a multilingual RoBERTa language model that is trained from scratch on 2.5 billion tweets with a custom tweet-focused tokenizer. |
| Outcome: | The proposed model outperforms or matches models trained on monolingual and multilingual tweets on a variety of benchmarks and is more efficient compute- and data-wise to train completely on in-domain data with a specialized domain-specific tokenizer. |
NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis (2022.lrec-1)
Copied to clipboard
Shamsuddeen Hassan Muhammad, David Ifeoluwa Adelani, Sebastian Ruder, Ibrahim Sa’id Ahmad, Idris Abdulmumin, Bello Shehu Bello, Monojit Choudhury, Chris Chinenye Emezue, Saheed Salahudeen Abdullahi, Anuoluwapo Aremu, Alípio Jorge, Pavel Brazdil
| Challenge: | Sentiment analysis is one of the most widely studied applications in NLP, but most work focuses on languages with large amounts of data. |
| Approach: | They propose a large-scale human-annotated Twitter sentiment dataset for the four most widely spoken languages in Nigeria. |
| Outcome: | The proposed dataset includes 30,000 tweets and a significant fraction of code-mixed tweets. |
Improving Sentiment Analysis over non-English Tweets using Multilingual Transformers and Automatic Translation for Data-Augmentation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing models for sentiment analysis over tweets require a substantial amount of text to adapt to a domain where the syntax is different. |
| Approach: | They propose to use a multilingual transformer model to train over tweets in five different languages to adapt the model to non-English languages. |
| Outcome: | The proposed model improves over small corpora of tweets in non-English languages. |
BERTweet: A pre-trained language model for English Tweets (2020.emnlp-demos)
Copied to clipboard
| Challenge: | Experiments show that BERTweet outperforms strong baselines RoBERTa-base and XLM-R-base on three Tweet NLP tasks: Part-of-speech tagging, Named-entity recognition and text classification. |
| Approach: | They propose to train a pre-trained language model for English Tweets using the RoBERTa pre training procedure and use it to train the model. |
| Outcome: | Experiments show that the model outperforms baseline models on three Tweet NLP tasks: Part-of-speech tagging, Named-entity recognition and text classification. |
A Checkpoint on Multilingual Misogyny Identification (2022.acl-srw)
Copied to clipboard
| Challenge: | a study on hate speech against minorities in Italian tweets found that 1 women are the most targeted group. |
| Approach: | They propose to train monolingual transformers and multilingual transformer models with monolingual data in English, Italian, and Spanish to detect misogyny in tweets. |
| Outcome: | The proposed model achieves state-of-the-art on English, Italian, and Spanish. |
TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classification (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Modern NLP systems are typically ill-equipped when applied to noisy user-generated text. |
| Approach: | They propose a new evaluation framework consisting of seven Twitter-specific classification tasks. |
| Outcome: | The proposed framework is based on seven heterogeneous Twitter-specific classification tasks. |
Exploring Multilingual Pre-trained Language Model for Aspect-based Sentiment Analysis (2026.findings-acl)
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis studies have focused on English datasets, but labeled data is scarce. |
| Approach: | They propose a multilingual pre-trained language model that leverages bilingual pre-training to leverage aspects-based sentiment analysis. |
| Outcome: | The proposed model outperforms state-of-the-art models across multiple languages. |
Predicting Foreign Language Usage from English-Only Social Media Posts (N18-2)
Copied to clipboard
| Challenge: | Social media is known for its multi-cultural and multilingual interactions, a natural product of which is code-mixing. |
| Approach: | They analyze 6 million tweets produced by 27 thousand multilingual users speaking 12 other languages besides English to build predictive models to infer non-English languages users speak exclusively from their tweets. |
| Outcome: | The proposed models are based on a corpus of 6 million tweets produced by 27 thousand multilingual users speaking 12 other languages besides English . they show that content, style and syntax are the most predictive of non-English languages that users speak on Twitter. |
ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in natural language processing (NLP) have led to significant breakthroughs in the field. |
| Approach: | They evaluate ChatGPT over multiple tasks with diverse languages and large datasets to provide more comprehensive information for multilingual NLP applications. |
| Outcome: | The proposed model can process and generate texts for multiple languages due to its multilingual training data. |