Papers by Ankit Kumar
Best Practices for Data-Efficient Modeling in NLG:How to Train Production-Ready Neural Models with Less Data (2020.coling-industry)
Copied to clipboard
Ankit Arun, Soumya Batra, Vikas Bhardwaj, Ashwini Challa, Pinar Donmez, Peyman Heidari, Hakan Inan, Shashank Jain, Anuj Kumar, Shawn Mei, Karthik Mohan, Michael White
| Challenge: | Natural language generation (NLG) is a critical component in conversational systems . Traditionally, NLG components have been deployed using template-based solutions . however, deployment of such model-based systems has been challenging due to high latency and data needs. |
| Approach: | They propose a family of techniques to deploy data-efficient neural solutions for NLG in conversational systems to production. |
| Outcome: | The proposed techniques achieve production quality with light-weight neural network models using fraction of the data needed otherwise. |
Controlled Text Generation with Hidden Representation Transformations (2023.findings-acl)
Copied to clipboard
| Challenge: | Using a con-trolled language model, we gain attribute control by modifying the hidden representation of thebase model through learning transformations. |
| Approach: | They propose a con-trolled language generation framework that gains attribute control bymodifying the hidden representation of thebase model through learned transformations. |
| Outcome: | The proposed framework outperforms all thebaselines in detoxification, positivesentiment steering, and text simplification while minimizing the loss in linguistic qualities. |
hinglishNorm - A Corpus of Hindi-English Code Mixed Sentences for Text Normalization (2020.coling-industry)
Copied to clipboard
| Challenge: | hinglishNorm is a human annotated corpus of Hindi-English code-mixed sentences for text normalization task. |
| Approach: | They propose to annotate sentences in Hindi-English code-mixed sentences using a human annotated normalized form. |
| Outcome: | The proposed corpus contains 13494 segments annotated for text normalization. |
Building Adaptive Acceptability Classifiers for Neural NLG (2021.emnlp-main)
Copied to clipboard
Soumya Batra, Shashank Jain, Peyman Heidari, Ankit Arun, Catharine Youngs, Xintong Li, Pinar Donmez, Shawn Mei, Shiunzu Kuo, Vikas Bhardwaj, Anuj Kumar, Michael White
| Challenge: | Existing approaches to generate synthetic data using simple sentence transformations and/or model-based techniques may not generate realistic error samples with respect to the NLG models. |
| Approach: | They propose a framework to train models to classify acceptability of responses generated by natural language generation models using a 2-stage approach . they use existing sentence transformations to generate samples that better resemble the output of the generation models. |
| Outcome: | The proposed approach outperforms existing techniques and can be used in few-shot settings using self-training. |