Papers by Massimo Piccardi
Improving Vietnamese-English Medical Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing high-quality Vietnamese-English parallel datasets are inadequate for translation training. |
| Approach: | They introduce a high-quality Vietnamese-English parallel dataset for medical translation . they compare Google Translate, ChatGPT, and pre-trained bilingual/multilingual models . |
| Outcome: | The proposed dataset is compared with translation models from Google Translate and ChatGPT. |
T3L: Translate-and-Test Transfer Learning for Cross-Lingual Text Classification (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual text classification leverage text classifiers trained in a high-resource language to perform text classification in other languages with no or minimal fine-tuning. |
| Approach: | They propose to combine a neural machine translator and a text classifier trained in a high-resource language to perform text classification in other languages with no or minimal fine-tuning. |
| Outcome: | The proposed approach significantly improves over a baseline approach. |
A Multi-Document Coverage Reward for RELAXed Multi-Document Summarization (2022.acl-long)
Copied to clipboard
| Challenge: | Multi-document summarization models are limited by limited references and with maximum-likelihood objectives. |
| Approach: | They propose to fine-tune an MDS baseline with a reward that balances a reference-based metric such as ROUGE with coverage of the input documents. |
| Outcome: | The proposed model improves on the Multi-News and WCEP datasets with a low-variance estimator . the proposed model also improves the coverage of the input documents . |
Leveraging Discourse Rewards for Document-Level Neural Machine Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Document-level machine translation models are often not trained to explicitly ensure discourse quality. |
| Approach: | They propose a method that explicitly optimizes lexical cohesion and coherence metrics by using a reinforcement learning objective. |
| Outcome: | The proposed approach improves document translations over four different languages and three translation domains while maintaining faithfulness to the reference translation. |
BERTTune: Fine-Tuning Neural Machine Translation with BERTScore (2021.acl-short)
Copied to clipboard
| Challenge: | Neural machine translation models are biased toward limited translation references . BERTScore is a scoring function based on contextual embeddings that overcomes the limitations of n-gram-based metrics. |
| Approach: | They propose to fine-tune models with a new evaluation metric based on contextual embeddings to overcome the limitations of n-gram-based metrics. |
| Outcome: | The proposed training objective improves translations that are different from the translations but close in the contextual embedding space. |
Pref-CTRL: Preference Driven LLM Alignment using Representation Editing (2026.acl-short)
Copied to clipboard
| Challenge: | Recent work suggests that test-time alignment methods are inefficient because they require a large number of computational resources. |
| Approach: | They propose a preference-based training framework that uses a multi-objective value function to better reflect the structure of preference data. |
| Outcome: | The proposed framework outperforms RE-Control and shows greater generalization on out-of-domain datasets. |
BiLSTM-CRF for Persian Named-Entity Recognition ArmanPersoNERCorpus: the First Entity-Annotated Persian Dataset (L18-1)
Copied to clipboard
| Challenge: | Named-entity recognition (NER) is a natural language processing component that aims to identify all the "named entities" (NEs) in an unstructured text. |
| Approach: | They propose a deep learning approach for name-entity recognition in Persian . they publicize an entity-annotated Persian dataset and train word embeddings . |
| Outcome: | The proposed approach achieves a 77.45% CoNLL F 1 score for Persian NER based on a deep learning architecture and pre-trained word embeddings. |
XVD: Cross-Vocabulary Differentiable Training for Generative Adversarial Attacks (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to create adversarial examples using tokens are not sufficient to ensure other desirable properties such as similarity to non-adversarial examples, linguistic fluency, and so forth. |
| Approach: | They propose a method which leverages a set of pretrained language models to promote similarity to non-adversarial examples, linguistic fluency, and so forth. |
| Outcome: | The proposed approach outperforms existing methods and is competitive with token-based approaches. |
ReWE: Regressing Word Embeddings for Regularization of Neural Machine Translation Systems (N19-1)
Copied to clipboard
| Challenge: | Existing methods to regularize neural machine translation are limited in low-resource settings. |
| Approach: | They propose a method that uses regressing word embeddings to regularize neural machine translation. |
| Outcome: | The proposed system improves on a strong baseline and a state-of-the-art system. |
Attribute-Controlled Translation with Preference Optimization (2026.findings-eacl)
Copied to clipboard
| Challenge: | Attribute-controlled translation (ACT) is a natural language processing task that produces translations that satisfy specific constraints on linguistic and stylistic attributes. |
| Approach: | They propose to leverage the contrastive nature of ACT tasks with preference optimization . they also propose to exploit knowledge distillation with synthetically-generated training samples . |
| Outcome: | The proposed approach improves attribute matching and translation quality in small-medium size models. |
English-Basque Statistical and Neural Machine Translation (L18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) requires large training corpora, which is problematic for low-resource languages. |
| Approach: | They propose to use an open-domain and an IT-domain corpora to train machine translations in English-Basque. |
| Outcome: | The proposed systems outperform OpenNMT, Moses SMT and Google Translate in English-Basque translation. |
SumTra: A Differentiable Pipeline for Few-Shot Cross-Lingual Summarization (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual summarization are limited due to limited training data. |
| Approach: | They propose to re-use existing multilingual summarization and translation pipelines to perform cross-lingual summaries in a sequence. |
| Outcome: | The proposed approach outperforms existing methods in many languages with only 10% of the fine-tuning samples. |