Challenge: We analyze the performance disparities between AAE and Mainstream American English (MAE) because of Twitter-specific conventions and dialectal language.
Approach: They develop a dataset of 500 tweets, 250 of which are in AAE, within the Universal Dependencies 2.0 framework and annotate it.
Outcome: The proposed model improves performance for AAE tweets with no or very little in-domain labeled data and assesses its lexical and syntactic features.

Similar Papers

Parsing Tweets into Universal Dependencies (N18-1)

Copied to clipboard

Challenge: a new tweet treebank for English is designed to analyze tweets with universal dependencies (UD).
Approach: They extend the universal dependencies guidelines to include special constructions in tweets that affect tokenization, part-of-speech tagging, and labeled dependencies.
Outcome: The proposed method outperforms state-of-the-art parsers on other treebanks in accuracy and speed.
An In-depth Analysis of the Effect of Lexical Normalization on the Dependency Parsing of Social Media (D19-55)

Copied to clipboard

Challenge: Existing natural language processing tools are focused on standard texts, but performance drops when used on a different domain.
Approach: They analyze the effect of manual and automatic lexical normalization for dependency parsing . they conclude that automatic normalization scores close to manually annotated normalization .
Outcome: The proposed approach improves performance on social media data for many tasks . it is unclear which replacements have the most impact and what weaknesses exist in the system .
Investigating African-American Vernacular English in Transformer-Based Text Generation (2020.emnlp-main)

Copied to clipboard

Challenge: Recent work in Natural Language Generation (NLG) uses a Transformer-based language model to generate high-quality, coherent text when prompted by arbitrary input.
Approach: They evaluate the performance of a Transformer-based model that generates high-quality, coherent text when prompted by arbitrary input.
Outcome: The proposed model improves on AAVE and SAE text with pretrained sentiment classifiers.
Leveraging Syntactic Dependencies in Disambiguation: The Case of African American English (2024.lrec-main)

Copied to clipboard

Challenge: African American English (AAE) is a low-resource language facing the challenge of inadequate annotated data for training natural language processing models.
Approach: They propose a syntactically informed classifier for automatic disambiguation of AAE's habitual be.
Outcome: The proposed classifier improves automatic disambiguation of habitual and non-habitual meanings of "be" integrating syntactic information improves disambiguations of habituality by 65 F1 points over baseline models and as much as 74 points.
TwittIrish: A Universal Dependencies Treebank of Tweets in Modern Irish (2022.acl-long)

Copied to clipboard

Challenge: Modern Irish is a minority language lacking computational resources for accurate automatic syntactic parsing of user-generated content.
Approach: They propose to use a treebank to facilitate natural language parsing of user-generated content in Irish.
Outcome: The proposed treebank enables natural language processing of user-generated content in Irish.
Normalization of Indonesian-English Code-Mixed Twitter Data (D19-55)

Copied to clipboard

Challenge: Twitter is an excellent source of textual data for NLP researches, but it is noisy and often contains typos, slang terms, and non-standard abbreviations.
Approach: They propose a standardization system for Indonesian-English code-mixed Twitter data that includes tokenization, language identification, lexical normalization, and translation.
Outcome: The proposed standardization system is based on four modules for tokenization, language identification, lexical normalization, and translation.
TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classification (2020.findings-emnlp)

Copied to clipboard

Challenge: Modern NLP systems are typically ill-equipped when applied to noisy user-generated text.
Approach: They propose a new evaluation framework consisting of seven Twitter-specific classification tasks.
Outcome: The proposed framework is based on seven heterogeneous Twitter-specific classification tasks.
PoSTWITA-UD: an Italian Twitter Treebank in Universal Dependencies (L18-1)

Copied to clipboard

Challenge: Various approaches and ad hoc resources are needed to provide proper coverage of specific linguistic phenomena.
Approach: They propose to annotate tweets using a well-known dependency-based annotation format . they propose to use the tweets for training NLP systems to improve their performance .
Outcome: The proposed resource can be used for training of NLP systems on social media texts.
Borrowing or Codeswitching? Annotating for Finer-Grained Distinctions in Language Mixing (2022.lrec-1)

Copied to clipboard

Challenge: a corpus of tweets annotated for codeswitching and borrowing between Spanish and English is presented . the annotation does not treat common “internet-speak” as codeswitched when used in an otherwise monolingual context.
Approach: They present a new corpus of tweets annotated for codeswitching and borrowing between Spanish and English.
Outcome: The proposed corpus contains 9,500 tweets annotated with codeswitches, borrowings, and named entities.
Exploiting Twitter as Source of Large Corpora of Weakly Similar Pairs for Semantic Sentence Embeddings (2021.emnlp-main)

Copied to clipboard

Challenge: Semantic sentence embeddings are usually supervisedly built minimizing distances between pairs of embeddable sentences labelled as semantically similar by annotators.
Approach: They propose a language-independent approach to build large datasets of pairs of informal texts weakly similar, without manual human effort, exploiting Twitter’s powerful signals of relatedness: replies and quotes of tweets.
Outcome: The proposed model learns classical Semantic Textual Similarity, and excels on tasks where pairs of sentences are not exact paraphrases.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations