Papers by Shailendra Agarwal
Generative or Discriminative? Revisiting Text Classification in the Era of Transformers (2025.emnlp-main)
Copied to clipboard
Siva Rajesh Kasa, Karan Gupta, Sumegh Roychowdhury, Ashutosh Kumar, Yaswanth Biruduraju, Santhosh Kumar Kasa, Pattisapu Nikhil Priyatam, Arindam Bhattacharya, Shailendra Agarwal, Vijay Huddar
| Challenge: | generative classifiers exhibit lower sample complexity but higher asymptotic error in simple linear settings, a trade-off that remains unexplored in the transformer era. |
| Approach: | They propose to evaluate generative and discriminative architectures for text classification using a generative model that learns the conditional probability distribution P (y|x) generative models are known to work better in low-data settings, giving rise to the classical 'two regimes' phenomenon for classification. |
| Outcome: | The proposed models show that the classical 'two regimes' manifests distinctly across different architectures and training paradigms. |