Papers by Ratish Puduppully
IndicNLG Benchmark: Multilingual Datasets for Diverse NLG Tasks in Indic Languages (2022.emnlp-main)
Copied to clipboard
Aman Kumar, Himani Shrotriya, Prachi Sahu, Amogh Mishra, Raj Dabre, Ratish Puduppully, Anoop Kunchukuttan, Mitesh M. Khapra, Pratyush Kumar
| Challenge: | IndicNLG is a non-English language that is hampered by the scarcity of datasets. |
| Approach: | They propose to create a dataset for natural language generation for 11 Indic languages . they use a set of pre-trained models to train multilingual models . |
| Outcome: | The proposed datasets show that pre-trained models perform well in multilingual and monolingual tasks. |
How Good is Zero-Shot MT Evaluation for Low Resource Indian Languages? (2024.acl-short)
Copied to clipboard
| Challenge: | a recent study focused on machine translation evaluation for low-resource languages . linguistic aspects that vary across languages are factors that will exacerbate the problem in low-source languages due to the reliance on extensive data resources. |
| Approach: | They propose to use multi-dimensional quality metrics and DA annotations to meta-evaluate MT evaluation metrics for low-resource languages. |
| Outcome: | The proposed evaluation metrics are based on human scores on the candidate translations of assamese, maithili, and Punjabi. |
The Reasoning Lingua Franca: A Double-Edged Sword for Multilingual AI (2026.eacl-short)
Copied to clipboard
| Challenge: | Large Reasoning Models (LRMs) are highly effective on mathematical, scientific, and other question-answering tasks. |
| Approach: | They compare an LRM's reasoning in English to that of a multilingual question . they find that English reasoning traces exhibit a substantially higher presence of cognitive behaviors . |
| Outcome: | The LRMs generate reasoning sequences in English, but the language of the question is not. |
Data-to-text Generation with Entity Modeling (P19-1)
Copied to clipboard
| Challenge: | Recent approaches to data-to-text generation have shown great promise thanks to the use of large-scale datasets and the application of neural network architectures which are trained end-to end. |
| Approach: | They propose an entity-centric neural architecture for data-to-text generation which uses hierarchical attention to create entity-specific representations which are dynamically updated. |
| Outcome: | The proposed model outperforms baselines in automatic and human evaluation on the RotoWire benchmark and a five-times larger dataset on the baseball domain. |
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code (2022.emnlp-demos)
Copied to clipboard
Sebastian Gehrmann, Abhik Bhattacharjee, Abinaya Mahendiran, Alex Wang, Alexandros Papangelis, Aman Madaan, Angelina Mcmillan-major, Anna Shvets, Ashish Upadhyay, Bernd Bohnet, Bingsheng Yao, Bryan Wilie, Chandra Bhagavatula, Chaobin You, Craig Thomson, Cristina Garbacea, Dakuo Wang, Daniel Deutsch, Deyi Xiong, Di Jin, Dimitra Gkatzia, Dragomir Radev, Elizabeth Clark, Esin Durmus, Faisal Ladhak, Filip Ginter, Genta Indra Winata, Hendrik Strobelt, Hiroaki Hayashi, Jekaterina Novikova, Jenna Kanerva, Jenny Chim, Jiawei Zhou, Jordan Clive, Joshua Maynez, João Sedoc, Juraj Juraska, Kaustubh Dhole, Khyathi Raghavi Chandu, Laura Perez Beltrachini, Leonardo F . R. Ribeiro, Lewis Tunstall, Li Zhang, Mahim Pushkarna, Mathias Creutz, Michael White, Mihir Sanjay Kale, Moussa Kamal Eddine, Nico Daheim, Nishant Subramani, Ondrej Dusek, Paul Pu Liang, Pawan Sasanka Ammanamanchi, Qi Zhu, Ratish Puduppully, Reno Kriz, Rifat Shahriyar, Ronald Cardenas, Saad Mahamood, Salomey Osei, Samuel Cahyawijaya, Sanja Štajner, Sebastien Montella, Shailza Jolly, Simon Mille, Tahmid Hasan, Tianhao Shen, Tosin Adewumi, Vikas Raunak, Vipul Raheja, Vitaly Nikolaev, Vivian Tsai, Yacine Jernite, Ying Xu, Yisi Sang, Yixin Liu, Yufang Hou
| Challenge: | Evaluations in machine learning rarely use the latest metrics, datasets, or human evaluation in favor of remaining compatible with prior work. |
| Approach: | They propose to use the Generation, Evaluation, and Metrics Benchmark to integrate new evaluation methods into existing evaluations. |
| Outcome: | The proposed evaluation infrastructure bridges the gap between the advantages of leaderboards and in-depth and evolving evaluations by allowing model developers to benefit from each other's work. |
RomanLens: The Role Of Latent Romanization In Multilinguality In LLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit strong multilingual performance despite training on English-centric corpora. |
| Approach: | They propose to use Romanization as a potential bridge in multilingual processing . they propose to encode semantic concepts similarly across native and Romanized scripts . |
| Outcome: | The proposed model encodes semantic concepts across native and Romanized scripts, suggesting a shared underlying representation. |
RiddleBench: A New Generative Reasoning Benchmark for LLMs (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) show remarkable capabilities, but complex reasoning skills require deeper investigation. |
| Approach: | They propose a benchmark of 1,737 puzzles to test reasoning beyond simple pattern matching. |
| Outcome: | The proposed model performs poorly when faced with reordered constraints or irrelevant information. |
CTQScorer: Combining Multiple Features for In-context Example Selection for Machine Translation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have demonstrated the capability to perform on machine translation when the input is prompted with a few examples. |
| Approach: | They propose a regression model that combine features influencing example selection to maximize translation quality. |
| Outcome: | The proposed model outperforms random selection and strong single-factor baselines on multiple language pairs and language models. |
University of Edinburgh’s submission to the Document-level Generation and Translation Shared Task (D19-56)
Copied to clipboard
| Challenge: | University of Edinburgh participated in all six tracks: NLG, MT, and MT+NLG with English and German as targeted languages. |
| Approach: | The University of Edinburgh participated in all six tracks: NLG, MT, and MT+NLG . they submitted a multilingual system based on the Content Selection and Planning model . |
| Outcome: | The University of Edinburgh participated in all six tracks with English and German as target languages. |
IndicBART: A Pre-trained Model for Indic Natural Language Generation (2022.findings-acl)
Copied to clipboard
| Challenge: | IndicBART is a multilingual, sequence-to-sequence pre-trained model focusing on 11 Indic languages and English. |
| Approach: | They present a multilingual sequence-to-sequence pre-trained model for Indic languages . they evaluate it on two NLG tasks: Neural Machine Translation and extreme summarization . |
| Outcome: | The proposed model performs well on low-resource translation scenarios . Script sharing, multilingual training, and better utilization contribute to the performance. |
Data-to-text Generation with Variational Sequential Planning (2022.tacl-1)
Copied to clipboard
| Challenge: | Recent advances in data-to-text generation have greatly facilitated the task of generating textual output from non-linguistic input. |
| Approach: | They propose a neural model enhanced with a planning component responsible for organizing high-level information in a coherent and meaningful way. |
| Outcome: | The proposed model outperforms baseline models and is sample-efficient in the face of limited training data. |
Data-to-text Generation with Macro Planning (2021.tacl-1)
Copied to clipboard
| Challenge: | Recent approaches to data-to-text generation adopt the encoder-decoder architecture . however, these models perform poorly at selecting appropriate content and ordering it coherently . |
| Approach: | They propose a neural model with a macro planning stage followed by a generation stage . they use data from databases of records, simulations of physical systems, accounting spreadsheets . |
| Outcome: | The proposed model outperforms baselines on two data-to-text benchmarks . it uses the encoderdecoder architecture and is compared with existing models . |
DecoMT: Decomposed Prompting for Machine Translation Between Related Languages using Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent work shows the power of few-shot prompting with large language models for tasks like machine translation, summarization, and question answering. |
| Approach: | They propose a few-shot prompting approach that decomposes the translation process into word chunks. |
| Outcome: | The proposed approach outperforms established few-shot prompting models with 8 chrF++ scores across languages. |