Text-like Encoding of Collaborative Information in Large Language Models for Recommendation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods to adapt Large Language Models for Recommendation (LLMRec) do not represent collaborative information in a text-like format, which may not align optimally with LLMs. |
| Approach: | They propose a novel LLMRec method that integrates collaborative information through text-like encoding. |
| Outcome: | Extensive experiments show that BinLLM integrates collaborative information better with LLMs. |
Similar Papers
Aligning Large Language Models with Recommendation Knowledge (2024.findings-naacl)
Copied to clipboard
Yuwei Cao, Nikhil Mehta, Xinyang Yi, Raghunandan Hulikal Keshavan, Lukasz Heldt, Lichan Hong, Ed Chi, Maheswaran Sathiamoorthy
| Challenge: | Large language models (LLMs) excel at natural language reasoning, but cannot model complex user-item interactions inherent in recommendation tasks. |
| Approach: | They propose to equip large language models with recommendation-specific knowledge to address this gap by combining Masked Item Modeling and Bayesian Personalized Ranking (BPR) auxiliary task data samples are generated that encode item correlations and user preferences. |
| Outcome: | Experiments on Amazon Toys & Games, Beauty, and Sports & Outdoors show that the proposed method outperforms conventional and LLM-based baselines by significant margins in retrieval. |
XRec: Large Language Models for Explainable Recommendation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Collaborative filtering (CF) is a widely adopted approach, but lacks the ability to provide explanations for the recommended items. |
| Approach: | They propose a model-agnostic framework that enables large language models to provide comprehensive explanations for user behaviors in recommender systems. |
| Outcome: | The proposed framework outperforms baseline approaches in explainable recommender systems. |
Enhancing High-order Interaction Awareness in LLM-based Recommender Model (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to model user-item interactions do not account for high-order interactions. |
| Approach: | They propose to enhance whole-word embeddings to enhance LLMs’ interpretation of graph-constructed interactions for recommendations without requiring graph pre-training. |
| Outcome: | The proposed model outperforms state-of-the-art methods in direct recommendations. |
Data and Model Centric Approaches for Expansion of Large Language Models to New languages (2025.emnlp-tutorials)
Copied to clipboard
| Challenge: | Existing LLMs mainly support English alongside a handful of high resource languages . this leaves a major gap for most low-resource languages despite increasing pace of research . |
| Approach: | This tutorial examines approaches to expand the language coverage of LLMs . they look at tokenizer training, pre-training, instruction tuning, alignment, evaluation, etc. |
| Outcome: | This tutorial examines approaches to expand the language coverage of LLMs . it provides an efficient and viable path to bring LLM technologies to low-resource languages . |
Large Language Models for Generative Recommendation: A Survey and Visionary Discussions (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have revolutionized the field of natural language processing but are not fully able to leverage the generative power of LLM. |
| Approach: | They examine the progress, methods, and future directions of large language models . they examine what generative recommendation is, why RS should advance to generative recommendations . |
| Outcome: | The proposed approach can be simplified to generate recommendations from the entire pool of items. |
Co-Evolving LLMs and Embedding Models via Density-Guided Preference Optimization for Text Clustering (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text clustering use static pseudo-oracles, i.e., unidirectionally querying them for similarity assessment or data augmentation. |
| Approach: | They propose a training framework that enables bidirectional refinement between LLMs and embedding models by using task-aware prompts to guide the LLM in generating interpretations for the input texts. |
| Outcome: | Experiments on 14 benchmark datasets across 5 tasks demonstrate the effectiveness of the proposed training framework. |
Bi-Tuning with Collaborative Information for Controllable LLM-based Sequential Recommendation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to optimize sequential recommendation systems rely on item ID sequences, but they lack collaborative knowledge and limited controllability. |
| Approach: | They propose a simple bi-tuning framework with collaborative information for controllable Large Language Model-based Sequential Recommendation (Laser) they incorporate learnable virtual tokens at prefix and suffix of input text to adapt LLMs with collaborative knowledge . |
| Outcome: | The proposed framework outperforms state-of-the-art recommendations on real-world datasets. |
Scaling Down, Serving Fast: Compressing and Deploying Efficient LLMs for Recommendation Systems (2025.emnlp-industry)
Copied to clipboard
Kayhan Behdin, Ata Fatahibaarzi, Qingquan Song, Yun Dai, Aman Gupta, Zhipeng Wang, Hejian Sang, Shao Tang, Gregory Dexter, Sirou Zhu, Siyu Zhu, Tejas Dharamsi, Vignesh Kothapalli, Zhoutong Fu, Yihan Cao, Pin-Lun Hsu, Fedor Borisyuk, Natesh S. Pillai, Luke Simon, Rahul Mazumder
| Challenge: | Large language models (LLMs) have demonstrated remarkable performance across a wide range of industrial applications. |
| Approach: | They propose two techniques for training and deploying small language models that deliver high performance for a variety of industry use cases. |
| Outcome: | The proposed techniques retain much of the quality of larger models while reducing training/serving costs and latency. |
ClusterLLM: Large Language Models as a Guide for Text Clustering (2023.emnlp-main)
Copied to clipboard
| Challenge: | Extensive experiments on 14 datasets show that ClusterLLM consistently improves clustering quality, at an average cost of $0.6 per dataset. |
| Approach: | They propose a text clustering framework that leverages feedback from an instruction-tuned large language model, such as ChatGPT. |
| Outcome: | Extensive experiments on 14 datasets show that ClusterLLM consistently improves clustering quality, at an average cost of $0.6 per dataset. |
EasyRec: Simple yet Effective Language Models for Recommendation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for learning from user-item interaction data rely on unique user and item IDs, which limits their performance in zero-shot learning scenarios. |
| Approach: | They propose an approach that integrates text-based semantic understanding with collaborative signals. |
| Outcome: | The proposed approach outperforms state-of-the-art models in zero-shot recommendation scenarios. |