Challenge: Experimental results show that PREMISE achieves promising performance with less computational cost.
Approach: They propose a new architecture for matching-based learning in multimodal fields for the MRHP task.
Outcome: The proposed architecture significantly boosts performance on multimodal tasks with less computational cost compared to the state-of-the-art fusion-based methods.

Similar Papers

Semantically Driven Sentence Fusion: Modeling and Evaluation (2020.findings-emnlp)

Copied to clipboard

Challenge: Sentence fusion is the task of joining related sentences into coherent text.
Approach: They propose a method where ground-truth solutions are automatically expanded into multiple references via curated equivalence classes of connective phrases.
Outcome: The proposed approach improves on state-of-the-art models by expanding ground-truth solutions into multiple references.
ThinkLinker: From Low-Rank Interaction to Knowledge-Aware Verification for Multimodal Entity Linking (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for multimodal entity linking rely on textual context for disambiguation . textual contextual information alone fails to resolve ambiguity, leading to unreliable disambiguations in weak contexts.
Approach: They propose a two-stage multimodal entity linking framework called ThinkLinker . they propose fusion mechanism to model joint dependencies among features .
Outcome: The proposed framework outperforms state-of-the-art models on public benchmark datasets.
VIP5: Towards Multimodal Foundation Models for Recommendation (2023.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in foundation models have impeded the ability for these fields to benefit from each other’s advancements.
Approach: They propose to use a multimodal foundation model to unify various modalities and recommendation tasks under the P5 recommendation paradigm to implement personalized prompts.
Outcome: The proposed model will unify visual, textual, and personalization modalities under the P5 recommendation paradigm and will improve recommendation performance and efficiency.
RecGPT: Generative Pre-training for Text-based Recommendation (2024.acl-short)

Copied to clipboard

Challenge: Existing models for text-based recommendation lack data sparsity and flexibility to capture fluctuations in user preferences over time.
Approach: They present the first domain-adapted and fully-trained large language model for text-based recommendation.
Outcome: The proposed model outperforms baseline models on rating prediction and sequential recommendation tasks.
Gradient-Boosted Decision Tree for Listwise Context Model in Multimodal Review Helpfulness Prediction (2023.findings-acl)

Copied to clipboard

Challenge: Existing studies have shown that FCNNs perform inefficient splitting for review features, making it difficult to clearly differentiate helpful from unhelpful reviews.
Approach: They propose a listwise attention network that captures the MRHP ranking context and a pairwise optimization objective that enhances model generalization.
Outcome: The proposed framework achieves state-of-the-art results and polished generalization performance on two large-scale MRHP benchmark datasets.
SANCL: Multimodal Review Helpfulness Prediction with Selective Attention and Natural Contrastive Learning (2022.coling-1)

Copied to clipboard

Challenge: e-commerce has become a research hotspot for review helpfulness prediction . a new approach to help predict helpfulness of multimodal product reviews is proposed .
Approach: They propose a machine learning task to identify helpfulness of multimodal product reviews . they use a probe-based strategy to enforce high attention weights on regions of greater significance .
Outcome: The proposed model achieves state-of-the-art performance with lower memory consumption on two benchmark datasets with three categories.
Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusion (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing work on dependency prior structure integration into pre-trained models is still unclear.
Approach: They propose a dependency-based fusion attention paradigm which explicitly introduces dependency prior structure into pre-trained models and adaptively fuses it with semantic information.
Outcome: The proposed model achieves state-of-the-art or competitive performance on 10 public datasets, demonstrating the benefits of adaptively fusing dependency structure in semantic matching task.
Feature Structure Matching for Multi-source Sentiment Analysis with Efficient Adaptive Tuning (2024.lrec-main)

Copied to clipboard

Challenge: Existing domain matching methods tend to pull all feature instances close, but they are expensive and expensive to update.
Approach: They propose to extract multi-layer features from a large pre-trained model and propose a dynamic parameter fusion module to exploit them for efficient and adaptive tuning.
Outcome: The proposed framework is more robust and generalizable in the multi-source scenario.
Grafting Pre-trained Models for Multimodal Headline Generation (2022.emnlp-industry)

Copied to clipboard

Challenge: Existing approaches to generate video headlines with pre-trained language models are labor intensive and impractical.
Approach: They propose to graft the encoder from the pre-trained video-language model on the generative pre-trainer model and propose a consensus fusion mechanism for the integration of different components.
Outcome: The proposed model achieves strong results on a brand-new dataset collected from real-world applications.
Advances in Pre-Training Distributed Word Representations (L18-1)

Copied to clipboard

Challenge: Pre-trained word representations are a building block of many Natural Language Processing and Machine Learning applications.
Approach: They propose to combine known tricks and a set of publicly available pre-trained word vector representations to train high-quality representations.
Outcome: The proposed models outperform the current state of the art on a number of tasks while maintaining a high training speed to scale to massive amount of data.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations