Papers by Rohan Pandey
Athena 2.0: Contextualized Dialogue Management for an Alexa Prize SocialBot (2021.emnlp-demo)
Copied to clipboard
Juraj Juraska, Kevin Bowden, Lena Reed, Vrindavan Harrison, Wen Cui, Omkar Patil, Rishi Rajasekaran, Angela Ramirez, Cecilia Li, Eduardo Zamora, Phillip Lee, Jeshwanth Bheemanpally, Rohan Pandey, Adwait Ratnaparkhi, Marilyn Walker
| Challenge: | Athena 2.0 is a socialbot that has been a finalist in the last two Alexa Prize Grand Challenges. |
| Approach: | They describe Athena 2.0's dialogue management strategy and its performance in the Alexa Prize 20/21 competition. |
| Outcome: | The system is a finalist in the Alexa Prize 20/21 competition and will be shown on a live demo and recorded video recordings. |
Syntax-guided Neural Module Distillation to Probe Compositionality in Sentence Embeddings (2023.eacl-main)
Copied to clipboard
| Challenge: | Past work on sentence embedding models faces issues determining the causal impact of implicit syntax representations. |
| Approach: | They construct a neural module net based on a transformer model and train it end-to-end to approximate the sentence’s embedding. |
| Outcome: | The proposed model captures whether syntax is a strong model of its compositional ability. |
Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment (2023.acl-long)
Copied to clipboard
| Challenge: | Despite recent progress towards scaling up multimodal vision-language models, these models struggle on compositional generalization benchmarks such as Winoground. |
| Approach: | They propose to use a cross-modal attention regularization loss to enforce relation alignment by capturing the semantic relation ‘in’ to match the visual attention from the mug to the grass. |
| Outcome: | The proposed approach improves Winoground Group score by 5.75 points . |