Papers by Anup Das
Robertha: Eigenspectrum Regularized Attention for Robust Natural Language Understanding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing robustness methods sacrifice clean performance or fail to generalize to higher corruption levels. |
| Approach: | They propose a mechanism that uses semantic patterns to pull corrupted embeddings toward correct representations by Eigenspectrum Regularization. |
| Outcome: | The proposed mechanism outperforms robustness methods on 13 GLUE and SuperGLUE tasks while maintaining competitive clean performance. |