Papers by Madhura Pande
Search Query Spell Correction with Weak Supervision in E-commerce (2023.acl-industry)
Copied to clipboard
| Challenge: | Misspelled search queries can lead to empty or irrelevant products . only 29% of the population in india is proficient in english . |
| Approach: | They propose to group spell errors into error classes and then leverage a Transformer model for contextual spell correction. |
| Outcome: | The proposed model improves on tough spell mistakes without human intervention without human input. |
On the weak link between importance and prunability of attention heads (2020.emnlp-main)
Copied to clipboard
| Challenge: | a large fraction of attention heads can be randomly pruned with limited effect on accuracy, a new study finds . a second study finds no advantage in pruning attention heads identified to be important based on the location of a head . |
| Approach: | They examine the importance of pruning attention heads on a Transformer-based model . they find no advantage in pruning attention head positions on the BERT model based on location . |
| Outcome: | The results show that pruning strategies on Transformer and BERT models are not important based on location . the results suggest that interpretation of attention heads does not strongly inform pruning strategies. |