| Challenge: | Existing relevance-based generative retrieval methods lack personalization, leading to a mismatch between diverse user expectations and the retrieved results. |
| Approach: | They propose a representation learning model that learns discriminative user representations to encode user-specific sticker preferences. |
| Outcome: | The proposed framework outperforms state-of-the-art methods in generating relevant stickers for queries. |
Similar Papers
Auto Search Indexer for End-to-End Document Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Generative retrieval heavily relies on the “preprocessed” document identifiers, thus limiting its retrieval performance and ability to retrieve new documents. |
| Approach: | They propose a fully end-to-end retrieval paradigm that can learn the best docids for existing and new documents automatically via a semantic indexing module. |
| Outcome: | The proposed model outperforms baselines on public and industrial datasets and can handle new documents. |
Towards Exploiting Sticker for Multimodal Sentiment Analysis in Social Media: A New Dataset and Baseline (2022.coling-1)
Copied to clipboard
| Challenge: | Sentiment analysis in social media is challenging because of the lack of context. |
| Approach: | They propose to use stickers to perform a multimodal sentiment analysis task using Chinese stickers. |
| Outcome: | The proposed model performs best compared with other models. |
On Synthetic Data Strategies for Domain-Specific Generative Retrieval (2025.acl-long)
Copied to clipboard
| Challenge: | Generative retrieval models can be used to generate ranked lists of potentially relevant document identifiers for a user query. |
| Approach: | They propose a synthetic data generation strategy for a two-stage training framework that focuses on learning to decode document identifiers from queries and a strategy for mining hard negatives based on initial model's predictions. |
| Outcome: | The proposed model can generate ranked lists of potentially relevant document identifiers for a user query and then refine ranking through preference learning. |
UserIdentifier: Implicit User Representations for Simple and Effective Personalized Sentiment Analysis (2022.naacl-main)
Copied to clipboard
Fatemehsadat Mireshghallah, Vaishnavi Shrivastava, Milad Shokouhi, Taylor Berg-Kirkpatrick, Robert Sim, Dimitrios Dimitriadis
| Challenge: | Currently, global models are not able to produce personalized responses for individual users, based on their data. |
| Approach: | They propose a scheme for training a single shared model for all users by prepending a fixed, user-specific non-trainable string to each user’s input text. |
| Outcome: | The proposed method outperforms the state-of-the-art model on a suite of sentiment analysis datasets by up to 13 points. |
Integrating Semantics and Neighborhood Information with Graph-Driven Generative Models for Document Retrieval (2021.acl-long)
Copied to clipboard
Zijing Ou, Qinliang Su, Jianxing Yu, Bang Liu, Jingwen Wang, Ruihui Zhao, Changyou Chen, Yefeng Zheng
| Challenge: | Existing methods for document hashing combine only one of semantics and neighborhood information, lacking a theoretical principle to guide the integration process. |
| Approach: | They propose to encode neighborhood information with a graph-induced Gaussian distribution and integrate it with generative models. |
| Outcome: | The proposed model can be trained as efficiently as state-of-the-art methods on benchmark datasets. |
Enhancing Generative Retrieval with Reinforcement Learning from Relevance Feedback (2023.emnlp-main)
Copied to clipboard
| Challenge: | End-to-end generative retrieval models produce document identifiers in response to a query . however, this approach has two challenges: an overemphasis on top-1 results at the expense of overall ranking quality. |
| Approach: | They propose a generative retrieval model with reinforcement learning from relevance feedback to align token-level docid generation with document-level relevance estimation. |
| Outcome: | The proposed model aligns token-level docid generation with document-level relevance estimation. |
CODER: An efficient framework for improving retrieval through COntextual Document Embedding Reranking (2022.emnlp-main)
Copied to clipboard
| Challenge: | Contextual document embedding reranking is an efficient and efficient retrieval framework. |
| Approach: | They propose a highly efficient retrieval framework that uses contextual document embedding reranking to incorporate ranking context into training. |
| Outcome: | The proposed framework reduces the computational overhead of a first-stage method and can be used as stand-alone retrieval models. |
Denoising Attention for Query-aware User Modeling (2024.findings-naacl)
Copied to clipboard
| Challenge: | Recent work has proposed to build user models at query time by leveraging the Attention mechanism, which allows weighing the contribution of the user-related information w.r.t. the current query. |
| Approach: | They propose to use the Attention mechanism to build user models at query time by weighing the contribution of the user-related information w.r.t. the Attention variant adopts a robust normalization scheme and introduces . filtering mechanism to better discern among the user related data those helpful for personalization. |
| Outcome: | The proposed approach improves MAP, MRR, and NDCG above 15% w.r.t. other Attention variants at the state-of-the-art. |
Document Hashing with Mixture-Prior Generative Models (D19-1)
Copied to clipboard
| Challenge: | Existing generative hashing methods only consider the use of simple priors, which limits them to further improve their performance. |
| Approach: | They propose to use Gaussian and Bernoulli priors to generate hashing codes . they propose to cast a Gausssian latent representation into binary code . |
| Outcome: | The proposed models outperform existing methods on a benchmark dataset using Gaussian and Bernoulli priors. |
Sentence Representation Learning with Generative Objective rather than Contrastive Objective (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing sentences-level training objectives focus on acquiring sentence-level representations, but they lack effective self-supervised objectives. |
| Approach: | They propose a generative self-supervised learning objective based on phrase reconstruction to improve sentence representation. |
| Outcome: | Empirical results show that the proposed objective outperforms current methods on STS benchmarks and retrieval and reranking tasks. |