Papers by Puria Radmard
Who Needs Decoders? Efficient Estimation of Sequence-Level Attributes with Proxies (2024.eacl-long)
Copied to clipboard
| Challenge: | Autoregressive decoding is expensive for many sequence-to-sequence tasks, but for some downstream tasks, the actual decoding output is not needed, just attributes of the sequence. |
| Approach: | They propose non-autoregressive proxy models that can efficiently predict scalar-valued sequence-level attributes from the encodings, avoiding the expensive decoding stage. |
| Outcome: | The proposed models outperform ensembles in machine translation (MT) and automatic speech recognition (ASR) while being significantly faster. |
Subsequence Based Deep Active Learning for Named Entity Recognition (2021.acl-long)
Copied to clipboard
| Challenge: | Active Learning (AL) has been successfully applied to Deep Learning to drastically reduce the amount of data required to achieve high performance. |
| Approach: | They propose to query subsequences within sentences and propagate their labels to other sentences. |
| Outcome: | The proposed approach achieves high performance on OntoNotes 5.0 and CoNLL 2003 with only 13% of training data and 27% of the training data. |