Papers by Joao Monteiro
XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inference (2024.findings-emnlp)
Copied to clipboard
Joao Monteiro, Étienne Marcotte, Pierre-Andre Noel, Valentina Zantedeschi, David Vazquez, Nicolas Chapados, Christopher Pal, Perouz Taslakian
| Challenge: | XC-Llama uses pre-trained decoder-only models to condition generation on reference text without the prompt. |
| Approach: | They propose a model that uses cross-attention to condition generation on reference text without the prompt. |
| Outcome: | The proposed models outperform prompt-based inference methods and reduce space footprint relative to standard KV caching by two orders of magnitude. |
On The Performance of Time-Pooling Strategies for End-to-End Spoken Language Identification (2020.lrec-1)
Copied to clipboard
| Challenge: | Language identification (LID) from speech is commonly tackled using similar approaches to those employed for speaker verification/recognition. |
| Approach: | They propose to combine local descriptors and global descriptores into a single global description that can be used for downstream classification tasks. |
| Outcome: | The proposed methods outperform well-known benchmark systems and previously results based on attention only. |