Open-World Attribute Mining for E-Commerce Products with Multimodal Self-Correction Instruction Tuning (2025.acl-long)
Copied to clipboard
| Challenge: | Current AM methods focus on extracting attributes from unimodal text, underutilizing multimodal data. |
| Approach: | They propose a framework for multimodal self-correction instruction tuning to extract new attributes from images and text with Multimodal Large Language Models. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on two datasets. |
Similar Papers
Large Scale Generative Multimodal Attribute Extraction for E-commerce Attributes (2023.acl-industry)
Copied to clipboard
| Challenge: | E-commerce websites often don’t label or mislabel attributes of products . |
| Approach: | They propose a multi-modal product attribute generation system that extracts product attributes from the product pages of eCommerce stores by using both text and images. |
| Outcome: | The proposed model improves the recall@90P accuracy by 10.16% and 6.9 from the state-of-the-art models. |
Towards Open-World Product Attribute Mining: A Lightly-Supervised Approach (2023.acl-long)
Copied to clipboard
| Challenge: | Existing task setting for attribute mining on e-commerce products is closed-world, but recent work has moved towards open-world aspect. |
| Approach: | They propose a task setting for attribute mining on e-commerce products that uses a high-quality seed attribute set bootstrapped from existing resources. |
| Outcome: | The proposed approach surpasses baselines on existing attributes by 12 F1 and discovers values from 39% new attributes. |
AFMRL: Attribute-Enhanced Fine-Grained Multi-Modal Representation Learning in E-commerce (2026.findings-acl)
Copied to clipboard
| Challenge: | Multimodal representation is crucial for E-commerce tasks such as identical product retrieval. |
| Approach: | They propose an approach which leverages the generative power of Multimodal Large Language Models to extract key attributes from product images and text and enhances representation learning through a two-stage training framework. |
| Outcome: | The proposed model achieves state-of-the-art on multiple downstream retrieval tasks, validating the effectiveness of harnessing generative models to advance fine-grained representation learning. |
A Multimodal In-Context Tuning Approach for E-Commerce Product Description Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for generating product descriptions from images are inaccurate and generic . e-commerce product descriptions are important for content marketing and increasing engagement . |
| Approach: | They propose a new setting for generating product descriptions from images, augmented by marketing keywords. |
| Outcome: | The proposed approach improves the accuracy and diversity of product descriptions by up to 3.3% on Rouge-L and 9.4% on D-5. |
I-AM-G: Interest Augmented Multimodal Generator for Item Personalization (2024.emnlp-main)
Copied to clipboard
| Challenge: | e-commerce and recommender systems lack a framework for personalized generation . a new framework extracts tags from multimodal information of items that the user has interacted with . |
| Approach: | They propose a framework that extracts tags from multimodal information and rewrites item description . they then use a decoupled text-to-text and image-to image retriever to search for similar item text . |
| Outcome: | The proposed framework can generate results aligned with user preferences . it can be used in e-commerce and recommender systems to win over diverse user base . |
AutoPKG: An Automated Framework for Dynamic E-commerce Product-Attribute Knowledge Graph Construction (2026.findings-acl)
Copied to clipboard
Pollawat Hongwimol, Haoning Shang, Chutong Wang, Zhichao Wan, Yi Gao, Yuanming Li, Lin Gui, Wenhao Sun, Cheng Yu
| Challenge: | Product attribute extraction in e-commerce is bottlenecked by ontologies that are inconsistent, incomplete, and costly to maintain. |
| Approach: | They propose a multi-agent Large Language Model framework that constructs a Product-attribute Knowledge Graph from multimodal product content. |
| Outcome: | The proposed framework achieves 0.953 WKE for product types, 0.724 WKEs for attribute keys, and 0.531 edge-level accuracy for value assertions after canonicalization on a large real-world marketplace catalog dataset from Lazada (Alibaba). |
Multimodal Joint Attribute Prediction and Value Extraction for E-commerce Product (2020.emnlp-main)
Copied to clipboard
| Challenge: | In the real world, product attribute values are incomplete and vary over time, which hinders practical applications. |
| Approach: | They propose a multimodal method to jointly predict product attributes and extract values from product images using multimodal product information. |
| Outcome: | The proposed method can predict product attributes and extract values from product images with the help of product images. |
Leveraging Product Catalog Patterns for Multilingual E-commerce Product Attribute Prediction (2025.emnlp-industry)
Copied to clipboard
| Challenge: | E-commerce stores increasingly use Large Language Models to improve catalog data quality . a critical challenge is accurately predicting missing structured attribute values . |
| Approach: | They propose a retrieval-augmented system that leverages existing product catalog entries to guide LLM predictions for missing attributes. |
| Outcome: | The proposed system improves catalog data quality by 34% and accuracy by 0.8% . the proposed model can predict missing attributes in multilingual product catalogs . |
VIT-Pro: Visual Instruction Tuning for Product Images (2025.naacl-industry)
Copied to clipboard
Vishnu Prabhakaran, Purav Aggarwal, Vishruit Kulshreshtha, Arunita Das, Sahini Venkata Sitaram Sruti, Anoop Saladi
| Challenge: | general-purpose vision-language models struggle to understand and converse about real-world e-commerce product images. |
| Approach: | a new approach is proposed to use large-scale image-text pairs to train a generative VLM for e-commerce product images. |
| Outcome: | The proposed model outperforms general-purpose VLMs on multiple vision tasks in the e-commerce domain. |
Generative Models for Product Attribute Extraction (2023.emnlp-industry)
Copied to clipboard
| Challenge: | generative models are used for product attribute extraction, a new field in information extraction and e-commerce. |
| Approach: | They analyze generative models for product attribute extraction and demonstrate their utility . they perform experiments on Amazon and MAVE product attribute datasets . |
| Outcome: | The proposed model can generate implicit attribute values, which state-of-the-art models are unable to extract. |