Papers by Trishul Chilimbi
DynaMaR: Dynamic Prompt with Mask Token Representation (2022.emnlp-industry)
Copied to clipboard
Xiaodi Sun, Sunny Rajagopalan, Priyanka Nigam, Weiyi Lu, Yi Xu, Iman Keivanloo, Belinda Zeng, Trishul Chilimbi
| Challenge: | Recent research shows that large language models pretrained using unsupervised approaches can achieve significant performance improvement on many downstream tasks. |
| Approach: | They propose an unsupervised approach to fine-tuning large language models using unsupervised approaches to many downstream tasks. |
| Outcome: | The proposed approach improves on four e-commerce applications and can achieve an average improvement of 10% in few-shot settings and 3.7% in data-rich settings over the standard approach. |
AutoMixAlign: Adaptive Data Mixing for Multi-Task Preference Optimization in LLMs (2025.acl-long)
Copied to clipboard
Nicholas E. Corrado, Julian Katz-Samuels, Adithya M Devraj, Hyokun Yun, Chao Zhang, Yi Xu, Yi Pan, Bing Yin, Trishul Chilimbi
| Challenge: | Existing approaches to align large language models rely on large ablation studies, heuristics, or human intuition to produce models with strong performance across tasks. |
| Approach: | They propose an algorithm that mixes datasets during LLM training to balance performance across multiple tasks. |
| Outcome: | The proposed algorithm outperforms existing methods on multitask alignment setups and achieves convergence rate of O(1/T) in the convex case. |
ALERT: An LLM-powered Benchmark for Automatic Evaluation of Recommendation Explanations (2025.naacl-long)
Copied to clipboard
Yichuan Li, Xinyang Zhang, Chenwei Zhang, Mao Li, Tianyi Liu, Pei Chen, Yifan Gao, Kyumin Lee, Kaize Ding, Zhengyang Wang, Zhihan Zhang, Jingbo Shang, Xian Li, Trishul Chilimbi
| Challenge: | Existing benchmarks for recommendation explanation evaluation lack item diversity and user preferences data. |
| Approach: | They propose a model-agnostic recommendation explanation evaluation benchmark based on Amazon e-commerce categories with implicit preferences . they propose two novel automatic evaluators that enable scalable and human-preference aligned evaluation of explanations . |
| Outcome: | The proposed model-agnostic evaluation benchmark outperforms existing methods in a variety of domains. |
Evolutionary Contrastive Distillation for Language Model Alignment (2024.findings-emnlp)
Copied to clipboard
Julian Katz-Samuels, Zheng Li, Hyokun Yun, Priyanka Nigam, Yi Xu, Vaclav Petricek, Bing Yin, Trishul Chilimbi
| Challenge: | Existing studies indicate that large language models struggle with challenging instructions. |
| Approach: | They propose a method for generating high-quality synthetic preference data to enhance the complex instruction-following capability of language models. |
| Outcome: | The proposed method exceeds the performance of current SOTA 7B models and is competitive even with open-source 70B models. |
MICO: Selective Search with Mutual Information Co-training (2022.coling-1)
Copied to clipboard
| Challenge: | Selective search is designed to reduce the latency and computation in modern large-scale search systems. |
| Approach: | They propose a mutual information CO-training framework for selective search with minimal supervision using the search logs. |
| Outcome: | The proposed framework outperforms existing competitive benchmarks on multiple metrics and significantly outperformed existing baselines. |
InfoPO: On Mutual Information Maximization for Large Language Model Alignment (2025.naacl-long)
Copied to clipboard
Teng Xiao, Zhen Ge, Sujay Sanghavi, Tian Wang, Julian Katz-Samuels, Marc Versage, Qingjun Cui, Trishul Chilimbi
| Challenge: | Recent studies have shown that direct preference optimization and its variants can be useful for fine-tuning large language models with human preferences data. |
| Approach: | They propose a preference fine-tuning algorithm that effectively and efficiently aligns large language models using preference data. |
| Outcome: | Extensive experiments show that the proposed algorithm outperforms established baselines on reasoning tasks. |
OssCSE: Overcoming Surface Structure Bias in Contrastive Learning for Unsupervised Sentence Embedding (2023.emnlp-main)
Copied to clipboard
Zhan Shi, Guoyin Wang, Ke Bai, Jiwei Li, Xiang Li, Qingjun Cui, Belinda Zeng, Trishul Chilimbi, Xiaodan Zhu
| Challenge: | Recent studies show that contrastive learning is effective in sentence representation learning . but, the surface structure bias is a problem in the current model . |
| Approach: | They propose to combine a sentence with a sub-semantic sentence to investigate the surface structure bias. |
| Outcome: | The proposed model achieves state-of-the-art on standard semantic textual similarity tasks using different pre-trained backbones. |
Asynchronous Convergence in Multi-Task Learning via Knowledge Distillation from Converged Tasks (2022.naacl-industry)
Copied to clipboard
Weiyi Lu, Sunny Rajagopalan, Priyanka Nigam, Jaspreet Singh, Xiaodi Sun, Yi Xu, Belinda Zeng, Trishul Chilimbi
| Challenge: | Multi-task learning (MTL) aims to solve multiple tasks by sharing a base representation among them. |
| Approach: | They propose an approach that allows for "asynchronous" convergence among the tasks where each task can converge on its own schedule. |
| Outcome: | The proposed method outperforms existing methods in two 5-task MTL setups. |
ReAugKD: Retrieval-Augmented Knowledge Distillation For Pre-trained Language Models (2023.acl-short)
Copied to clipboard
Jianyi Zhang, Aashiq Muhamed, Aditya Anantharaman, Guoyin Wang, Changyou Chen, Kai Zhong, Qingjun Cui, Yi Xu, Belinda Zeng, Trishul Chilimbi, Yiran Chen
| Challenge: | Knowledge distillation (KD) is an effective compression technique to derive a smaller student model from a larger teacher model by transferring the knowledge embedded in the teacher's network. |
| Approach: | They propose a framework and loss function that preserves the semantic similarities of teacher and student training examples to enable the student to retrieve from the knowledge base effectively. |
| Outcome: | The proposed framework preserves the semantic similarities of teacher and student training examples to achieve state-of-the-art performance on the GLUE benchmark. |