Papers by Mayank Mishra
Prompting with Pseudo-Code Instructions (2023.emnlp-main)
Copied to clipboard
| Challenge: | ambiguity in natural language can hinder performance of large language models. |
| Approach: | They manually create a dataset of pseudo-code prompts for 132 different classification, QA, and generative language tasks, sourced from the Super-NaturalInstructions dataset. |
| Outcome: | The pseudo-code prompts improve the performance of two LLM families, BLOOM and CodeGen. |
Geometry-aware domain adaptation for unsupervised alignment of word embeddings (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for learning bilingual word embeddings have been used in natural language processing. |
| Approach: | They propose a manifold based geometric approach for learning unsupervised alignment of word embeddings between the source and target languages. |
| Outcome: | The proposed approach outperforms state-of-the-art optimal transport based approach on bilingual lexicon induction task across several language pairs. |
Aurora-M: Open Source Continual Pre-training for Multilingual Language and Code (2025.coling-industry)
Copied to clipboard
Taishi Nakamura, Mayank Mishra, Simone Tedeschi, Yekun Chai, Jason T. Stillerman, Felix Friedrich, Prateek Yadav, Tanmay Laud, Vu Minh Chien, Terry Yue Zhuo, Diganta Misra, Ben Bogin, Xuan-Son Vu, Marzena Karpinska, Arnav Varma Dantuluri, Wojciech Kusa, Tommaso Furlanello, Rio Yokota, Niklas Muennighoff, Suhas Pai, Tosin Adewumi, Veronika Laippala, Xiaozhe Yao, Adalberto Barbosa Junior, Aleksandr Drozd, Jordan Clive, Kshitij Gupta, Liangyu Chen, Qi Sun, Ken Tsui, Nour Moustafa-Fahmy, Nicolo Monti, Tai Dang, Ziyang Luo, Tien-Tung Bui, Roberto Navigli, Virendra Mehta, Matthew Blumberg, Victor May, Hiep Nguyen, Sampo Pyysalo
| Challenge: | Pretrained language models are integral part of AI applications, but their high computational cost limits accessibility. |
| Approach: | They evaluate Aurora-M, a 15B parameter multilingual open-source model trained on English, Finnish, Hindi, Japanese, Vietnamese, and code. |
| Outcome: | The proposed model outperforms existing models on English, Finnish, Hindi, Japanese, Vietnamese, and code. |
Joint Reasoning on Hybrid-knowledge sources for Task-Oriented Dialog (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing systems for task oriented dialog use knowledge present only in structured knowledge sources to generate responses. |
| Approach: | They propose a model that assumes that information is always present in a structured knowledge base . they also refine the model to take into account the fact that it can fuse information from structured and unstructured knowledge sources. |
| Outcome: | The proposed model is robust to perturbations to knowledge modality and can fuse information from structured and unstructured knowledge to generate responses. |
Clustering-based Sampling for Few-Shot Cross-Domain Keyphrase Extraction (2024.findings-eacl)
Copied to clipboard
| Challenge: | Scientific domain-specific pre-training has led to state-of-the-art keyphrase extraction performance with a majority of benchmarks being within the domain. |
| Approach: | They propose to leverage topic information available in the data to build a clustering-based sampling approach that facilitates selecting a few samples to label from the target domain . |
| Outcome: | The proposed approach leads to 26.35 points in performance when compared to selecting few-shot samples uniformly at random. |
A Simple Approach to Learning Unsupervised Multilingual Embeddings (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent work on unsupervised cross-lingual embeddings in the bilingual setting has given the impetus to learning a shared embeddable space for several languages. |
| Approach: | They propose to solve two sub-problems together to learn a shared embedding space for several languages. |
| Outcome: | The proposed approach outperforms existing methods in bilingual lexicon induction, cross-lingual word similarity, multilingual document classification, and multilingual dependency parsing tasks. |