Papers by Akshat Pandey
SpeechNet: Weakly Supervised, End-to-End Speech Recognition at Industrial Scale (2022.emnlp-industry)
Copied to clipboard
Raphael Tang, Karun Kumar, Gefei Yang, Akshat Pandey, Yajie Mao, Vladislav Belyaev, Madhuri Emmadi, Craig Murray, Ferhan Ture, Jimmy Lin
| Challenge: | End-to-end automatic speech recognition systems require thousands of hours of manual annotation and heavyweight computation to perform inference. |
| Approach: | They propose to use a third-party ASR system as a weak supervision source and labeling functions derived from implicit user feedback to reduce human labor. |
| Outcome: | The proposed system improves word-error rate and speed up 600% over third-party ASR. |
What the DAAM: Interpreting Stable Diffusion Using Cross Attention (2023.acl-long)
Copied to clipboard
Raphael Tang, Linqing Liu, Akshat Pandey, Zhiying Jiang, Gefei Yang, Karun Kumar, Pontus Stenetorp, Jimmy Lin, Ferhan Ture
| Challenge: | a new text-image attribution analysis model for text-to-image generation is understudied due to ethical constraints . corporators have restricted the general public from using the models and their weights . |
| Approach: | They perform a text-image attribution analysis on Stable Diffusion, a recently open-sourced model. |
| Outcome: | The proposed method achieves a competitive 58.8-64.8 mIoU on noun segmentation and fair to good mean opinion scores on all parts of speech rated by humans . it also achieves good attribution quality on all part of speech, rated in humans - and the first to interpret large diffusion models from a visuolinguistic perspective. |