Papers by Laks Lakshmanan
Mixture-of-Supernets: Improving Weight-Sharing Supernet Training with Architecture-Routed Mixture-of-Experts (2024.findings-acl)
Copied to clipboard
Ganesh Jawahar, Haichuan Yang, Yunyang Xiong, Zechun Liu, Dilin Wang, Fei Sun, Meng Li, Aasish Pappu, Barlas Oguz, Muhammad Abdul-Mageed, Laks Lakshmanan, Raghuraman Krishnamoorthi, Vikas Chandra
| Challenge: | Neural architecture search (NAS) uses weight-sharing supernets to generate diverse subnetworks without retraining. |
| Approach: | They propose a weight-sharing supernet that leverages mixture-of-experts to enhance supernet model expressiveness with minimal training overhead. |
| Outcome: | The proposed method achieves state-of-the-art (SoTA) performance in NAS for fast machine translation models, surpassing NAS-BERT and AutoDistil across various model sizes. |
DuRE: Dual Contrastive Self Training for Semi-Supervised Relation Extraction (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing document-level relation extraction methods require manual training and labeled data to obtain supervised learning. |
| Approach: | They propose a document-level relation extraction framework that integrates RE and text generation as a dual process. |
| Outcome: | The proposed framework significantly boosts recall and F1 score with comparable precision on two document-level RE tasks against several strong baselines. |
DetoxLLM: A Framework for Detoxification with Explanations (2024.emnlp-main)
Copied to clipboard
| Challenge: | DetoxLLM is a comprehensive end-to-end detoxification framework for toxic language. |
| Approach: | They propose a comprehensive end-to-end detoxification framework that tackles toxic language across platforms. |
| Outcome: | The proposed detoxification framework outperforms the SoTA model on human-annotated parallel corpus and offers explanation to promote transparency and trustworthiness. |
Automatic Detection of Entity-Manipulated Text using Factual Knowledge (2022.acl-short)
Copied to clipboard
| Challenge: | Current fake news detectors that exploit stylometric signals from the text are insufficient for distinguishing manipulated text from human written text. |
| Approach: | They propose a neural network detector that detects manipulated news articles by reasoning about the facts mentioned in the article. |
| Outcome: | The proposed detector outperforms the state-of-the-art detector in accuracy. |
LLM Performance Predictors are good initializers for Architecture Search (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have diverse applications, encompassing both open-ended tasks (e.g., brainstorming and chat) and closed-ended ones (eg. question answering). |
| Approach: | They construct PP prompts for Large Language Models (LLMs) that estimate the performance of specific deep neural network architectures on downstream tasks. |
| Outcome: | The proposed model achieves a SoTA mean absolute error and a slight degradation in rank correlation coefficient compared to baseline predictors in machine translation tasks. |