Papers by Leonardo Neves
Style Transfer as Data Augmentation: A Case Study on Named Entity Recognition (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to increase training data in low-resource domains may not be effective due to data scarcity. |
| Approach: | They propose a method to transform a high-resource domain into a low-resourced domain by changing its style-related attributes to generate synthetic data for training. |
| Outcome: | The proposed method can significantly improve results on five domain pairs under different data regimes. |
Multimodal Named Entity Disambiguation for Noisy Social Media Posts (P18-1)
Copied to clipboard
| Challenge: | Social media posts often contain unstructured text or images, making opinion mining challenging. |
| Approach: | They propose a new task for multimodal social media captions with named entities annotated and linked to external knowledge bases. |
| Outcome: | The proposed model outperforms state-of-the-art text-only NED models . it predicts correct entities in knowledge graph embeddings space, showing its efficacy and potentials . |
Named Entity Recognition in Twitter: A Dataset and Analysis on Short-Term Temporal Shifts (2022.aacl-main)
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) is a longstanding NLP task that consists of identifying an entity in a sentence or document. |
| Approach: | They construct a dataset of seven entity types annotated over 11,382 tweets . they provide a set of language model baselines and analyze the performance of the model . |
| Outcome: | The proposed dataset contains seven entity types annotated over 11,382 tweets . the authors focus on short-term degradation of NER models over time and strategies to fine-tune a language model over different periods . |
TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classification (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Modern NLP systems are typically ill-equipped when applied to noisy user-generated text. |
| Approach: | They propose a new evaluation framework consisting of seven Twitter-specific classification tasks. |
| Outcome: | The proposed framework is based on seven heterogeneous Twitter-specific classification tasks. |
On Transferability of Bias Mitigation Effects in Language Model Fine-Tuning (2021.naacl-main)
Copied to clipboard
| Challenge: | PTLMs can exhibit biases against protected groups in a host of modeling tasks . but, fine-tuned LMs may propagate bias to downstream classifiers . |
| Approach: | They propose to use upstream bias mitigation techniques to reduce bias on downstream tasks by fine-tuning an upstream model and applying it to a downstream model. |
| Outcome: | The proposed model reduces bias on hate speech detection, toxicity detection and coreference resolution tasks over bias factors. |
LEAN-LIFE: A Label-Efficient Annotation Framework Towards Learning from Explanation (2020.acl-demos)
Copied to clipboard
Dong-Ho Lee, Rahul Khanna, Bill Yuchen Lin, Seyeon Lee, Qinyuan Ye, Elizabeth Boschee, Leonardo Neves, Xiang Ren
| Challenge: | Existing frameworks for sequence labeling and classification require massive human effort and labeling data is limited. |
| Approach: | They propose a web-based, Label-Efficient AnnotatioN framework that allows an annotator to provide the needed labels for a task and can capture explanations for each labeling decision. |
| Outcome: | The proposed framework surpasses baseline F1 scores by 5-10 percentage points while using 2X times fewer labeled instances. |
TempoWiC: An Evaluation Benchmark for Detecting Meaning Shift in Social Media (2022.coling-1)
Copied to clipboard
Daniel Loureiro, Aminette D’Souza, Areej Nasser Muhajab, Isabella A. White, Gabriel Wong, Luis Espinosa-Anke, Leonardo Neves, Francesco Barbieri, Jose Camacho-Collados
| Challenge: | Language models are often clean and time-invariant, and do little to no account of social media usage. |
| Approach: | They propose a benchmark to accelerate research in social media-based meaning shift. |
| Outcome: | The proposed benchmark is aimed at accelerating research in social media-based meaning shift. |
SuperTweetEval: A Challenging, Unified and Heterogeneous Benchmark for Social Media NLP Research (2023.findings-emnlp)
Copied to clipboard
Dimosthenis Antypas, Asahi Ushio, Francesco Barbieri, Leonardo Neves, Kiamehr Rezaee, Luis Espinosa-Anke, Jiaxin Pei, Jose Camacho-Collados
| Challenge: | specialised language models (LMs) have shown to exhibit lower perplexity and higher downstream performance across the board. |
| Approach: | They propose a benchmark for NLP evaluation in social media, SuperTweetEval. |
| Outcome: | The proposed benchmark shows that social media models perform better when compared to general-purpose models, metrics and benchmarks. |
TimeLMs: Diachronic Language Models from Twitter (2022.acl-demo)
Copied to clipboard
| Challenge: | Neural language models (LMs) are a key enabler in NLP, but lack of diachronic specialization affects both the ability to generalize to future data and the reliability of experimental results. |
| Approach: | They propose to use Twitter data to develop time-specific language models that are specialized on the time variable. |
| Outcome: | The proposed models cope with trends and peaks in activity involving specific named entities or concept drift. |
Train One Get One Free: Partially Supervised Neural Network for Bug Report Duplicate Detection and Clustering (N19-2)
Copied to clipboard
| Challenge: | Existing methods for duplicate classification require manual review and assigning bugs to the correct teams. |
| Approach: | They propose a loss function that can detect duplicate bug reports and aggregate them into latent topics without supervision. |
| Outcome: | The proposed model outperforms state-of-the-art methods for duplicate classification on both cases and can learn meaningful latent clusters without supervision. |
Twitter Topic Classification (2022.coling-1)
Copied to clipboard
Dimosthenis Antypas, Asahi Ushio, Jose Camacho-Collados, Vitor Silva, Leonardo Neves, Francesco Barbieri
| Challenge: | Existing methods to identify topics from posts are difficult to interpret and can differ from corpus to corpus. |
| Approach: | They propose a task based on tweet topic classification and release two datasets that can be used to train and test models. |
| Outcome: | The proposed task is based on two datasets from recent time periods and provides training and testing data. |
Data Augmentation for Cross-Domain Named Entity Recognition (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition focus on augmenting in-domain data in low-resource scenarios where annotated data is limited. |
| Approach: | They propose a neural architecture to transform data from high-resource to low-resourced domains by learning the patterns in the text that differentiate them. |
| Outcome: | The proposed approach improves on high-resource domain representations over high- and low-resourced domains. |
Visual Attention Model for Name Tagging in Multimodal Social Media (P18-1)
Copied to clipboard
| Challenge: | Name tagging is a key task for language understanding, but is often limited by the short textual components. |
| Approach: | They propose a novel model architecture based on visual attention that outperforms other methods . they use multimodal datasets to analyze the name tagging task on social media . |
| Outcome: | The proposed model outperforms existing methods and significantly outperformed existing methods. |
Explainability and Hate Speech: Structured Explanations Make Social Media Moderators Faster (2024.acl-short)
Copied to clipboard
Agostina Calabrese, Leonardo Neves, Neil Shah, Maarten Bos, Björn Ross, Mirella Lapata, Francesco Barbieri
| Challenge: | Existing studies have shown that explanations can support content moderators to make faster decisions, but the benefits of such models have not been studied. |
| Approach: | They propose to use structured explanations to support content moderators to make faster decisions by 7.4%. |
| Outcome: | The proposed models lower the speed of real-world moderators by 7.4% compared to generic explanations and are often ignored . previous studies have shown that explanations can support moderator's decision making by detecting violations of policies but the benefits have not been studied . |
Multimodal Named Entity Recognition for Short Social Media Posts (N18-1)
Copied to clipboard
| Challenge: | Social media posts often contain inconsistent or incomplete syntax and lexical notations with limited textual contexts. |
| Approach: | They propose a task called Multimodal Named Entity Recognition (MNER) for noisy user-generated data . they use a dataset called SnapCaptions to build upon the state-of-the-art NER models . |
| Outcome: | The proposed model outperforms existing models on noisy user-generated data . it uses a deep image network and generic modality attention module . |
The Devil is in the Details: Evaluating Limitations of Transformer-based Methods for Granular Tasks (2020.coling-main)
Copied to clipboard
| Challenge: | Contextual embeddings have shown state-of-the-art performance for various tasks such as question answering, sentiment analysis, and textual similarity. |
| Approach: | They propose to integrate transformer-based neural language models into their models to achieve relative improvements of up to 36% on granular tasks. |
| Outcome: | The proposed model outperforms baselines for more granular tasks while outperforming TF-IDF for more complex tasks. |