Papers by Massimo Nicosia
mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent large language models display surprising multilingual capabilities despite being pre-trained on English data. |
| Approach: | They propose a multilingual sequence-to-sequence model that disentangles language-specific information from language-agnostic information. |
| Outcome: | The proposed model outperforms existing models on representative natural language understanding and generation tasks in 40+ languages. |
Answering Conversational Questions on Structured Data without Logical Forms (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to answering sequential questions based on structured objects do not use a logical form as an intermediate representation. |
| Approach: | They propose a novel approach to answering sequential questions based on structured objects without using a logical form as an intermediate representation. |
| Outcome: | The proposed approach is competitively tested on the Sequential Question Answering (SQA) task. |
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages (2023.findings-emnlp)
Copied to clipboard
Sebastian Ruder, Jonathan Clark, Alexander Gutkin, Mihir Kale, Min Ma, Massimo Nicosia, Shruti Rijhwani, Parker Riley, Jean-Michel Sarr, Xinyi Wang, John Wieting, Nitish Gupta, Anna Katanova, Christo Kirov, Dana Dickinson, Brian Roark, Bidisha Samanta, Connie Tao, David Adelani, Vera Axelrod, Isaac Caswell, Colin Cherry, Dan Garrette, Reeve Ingle, Melvin Johnson, Dmitry Panteleev, Partha Talukdar
| Challenge: | Existing datasets are often informed by established research directions in the NLP community. |
| Approach: | They propose a benchmark to evaluate the capabilities of language models across 88 under-represented languages over 9 key user-centric technologies including ASR, OCR, MT, and information access tasks. |
| Outcome: | The proposed benchmark evaluates the capabilities of language models across 88 under-represented languages over 9 key user-centric technologies including ASR, OCR, MT, and information access tasks. |
Semantic Linking in Convolutional Neural Networks for Answer Sentence Selection (D18-1)
Copied to clipboard
| Challenge: | Recent NLP approaches that model relations between text use complex architectures and attention. |
| Approach: | They propose to use labelled data to model semantic relations between two pieces of text . they use word representations to encode matching features directly in the word representation . |
| Outcome: | The proposed approach beats tree kernel models and neural models with similar input encodings while keeping the model simple and fast to train. |
Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Data (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to improve semantic parsing performance on target languages are limited. |
| Approach: | They propose a Translate-and-Fill method that produces silver training data for a multilingual semantic parser. |
| Outcome: | The proposed method produces silver training data for a multilingual parser. |