Papers by Alessandro Pedrani

3 papers
Regression-Free Model Updates for Spoken Language Understanding (2023.acl-industry)

Copied to clipboard

Challenge: Recent work has proposed methods for minimizing regressions caused by model updates . focus is on spoken language understanding models, which are unexplored .
Approach: They propose a focal distillation technique to reduce regressions in goal-oriented dialog systems . they also evaluate its effectiveness for key language understanding tasks .
Outcome: The proposed technique outperforms naive supervised training in mislabeled data and label expansion settings.
EPIC: Multi-Perspective Annotation of a Corpus of Irony (2023.acl-long)

Copied to clipboard

Challenge: EPIC is the first annotated corpus for irony analysis based on data perspectivism . a recent trend in natural language processing (NLP) postulates that the disagreement among annotators in a language resource is a valuable source of knowledge, rather than noise that ought to be minimized or discarded.
Approach: They propose to annotate an English perspectivist irony corpus based on data perspectivism . they validate the model by creating perspective-aware models that encode the perspectives of annotators grouped according to their demographic characteristics.
Outcome: The proposed model can capture different perspectives on irony among different groups of annotators, and is more confident than non-perspectivist models.
Mitigating the Burden of Redundant Datasets via Batch-Wise Unique Samples and Frequency-Aware Losses (2023.acl-industry)

Copied to clipboard

Challenge: Existing solutions to train deep learning models on redundant datasets are difficult to implement in industrial settings.
Approach: They propose a method to eliminate duplicates at the batch level without altering the data distribution observed by the model.
Outcome: The proposed approach reduces training times on models on redundant datasets by up to 87% and 46% on average, with a drop in model performance of 0.2% relative at worst.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations