Event Representation Learning with Multi-Grained Contrastive Learning and Triple-Mixture of Experts (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for learning event representations fail to capture hidden feature information between events. |
| Approach: | They propose a method that extends the random masked language model by incorporating a specialized MLM to capture different grammatical structures within events. |
| Outcome: | The proposed method outperforms baselines in hard similarity and transitive sentence similarity tasks, highlighting the superiority of the proposed method. |
Similar Papers
Improving Event Representation via Simultaneous Weakly Supervised Contrastive Learning and Clustering (2022.acl-long)
Copied to clipboard
| Challenge: | Existing work exploits easily accessible co-occurrence information of events to learn event representations. |
| Approach: | They propose a weakly supervised contrastive learning method and a prototype-based clustering method for event representation learning. |
| Outcome: | The proposed framework outperforms baselines on Hard Similarity and Transitive Sentence Similarity tasks. |
Multi-Relational Probabilistic Event Representation Learning via Projected Gaussian Embedding (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for event representation learning ignore relations and uncertainty of events . Experimental results show that the proposed approach outperforms other state-of-the-art baselines on both existing and newly constructed datasets. |
| Approach: | They propose a novel approach to learning multi-relational probabilistic event embeddings based on contrastive learning. |
| Outcome: | The proposed method outperforms existing benchmarks on existing and newly constructed datasets. |
LATTE: Learning Aligned Transactions and Textual Embeddings for Bank Clients (2025.emnlp-industry)
Copied to clipboard
Egor Fadeev, Dzhambulat Mollaev, Aleksei Shestov, Dima Korolev, Omar Zoloev, Ivan A Kireev, Andrey Savchenko, Maksim Makarenko
| Challenge: | Large language models (LLMs) are computationally expensive and impractical for real-world pipelines. |
| Approach: | They propose a contrastive learning framework that aligns raw event embeddings with description-based semantic embedds from frozen LLMs. |
| Outcome: | The proposed framework outperforms state-of-the-art techniques for learning event sequence representations on real-world financial datasets while remaining deployable in latency-sensitive environments. |
Towards Better Representations for Multi-Label Text Classification with Multi-granularity Information (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have shown that pre-trained language models generate word frequency-oriented text representations, causing texts with different labels to be closely distributed in a narrow region, which is difficult to classify. |
| Approach: | They propose a framework to refine the text representation for multi-label text classification using contrastive learning and multi-task learning modules. |
| Outcome: | The proposed framework improves the quality of the representations and yields stable and competitive improvements. |
Reflective Agreement: Combining Self-Mixture of Agents with a Sequence Tagger for Robust Event Extraction (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for event extraction are limited in their ability to recall nuanced or rare events. |
| Approach: | They propose a hybrid approach that leverages a self-mixture of agents and a discriminative sequence tagger to resolve ambiguities and enhance overall event prediction quality. |
| Outcome: | The proposed approach outperforms existing state-of-the-art methods across three benchmark datasets. |
CEAN: Contrastive Event Aggregation Network with LLM-based Augmentation for Event Extraction (2024.eacl-long)
Copied to clipboard
| Challenge: | Event Extraction is a crucial yet arduous task in natural language processing (NLP), as its performance is hindered by laborious data annotation. |
| Approach: | They propose a Contrastive Event Aggregation Network with LLM-based Augmentation to promote low-resource learning and reduce data noise for event extraction. |
| Outcome: | The proposed approach achieves new state-of-the-art results on the ACE2005 and ERE-EN datasets. |
Event Representation Learning Enhanced with External Commonsense Knowledge (D19-1)
Copied to clipboard
| Challenge: | Existing methods to learn event representations from text lack commonsense knowledge about the intents and emotions of event participants. |
| Approach: | They propose to leverage external commonsense knowledge about the intent and sentiment of the event to learn distributed representations for structured events from text. |
| Outcome: | The proposed model improves on hard similarity tasks and yields more precise inferences on subsequent events under given contexts. |
Lifelong Knowledge-Enriched Social Event Representation Learning (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing approaches to represent social events and situations fail to consider pragmatic aspects . a conceptual framework for lifelong language learning integrates commonsense knowledge with lifelong learning. |
| Approach: | They propose a representation learning framework that integrates pragmatic aspects with lifelong language learning. |
| Outcome: | The proposed model integrates commonsense knowledge with lifelong language learning to produce richer representations of social events. |
A Triple-View Framework for Fine-Grained Emotion Classification with Clustering-Guided Contrastive Learning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on dealing with only one of the two difficulties of coarse-grained emotion classification. |
| Approach: | They propose a triple-view framework that treats FEC as an instance-label joint embedding learning problem to tackle both difficulties concurrently by considering three complementary views. |
| Outcome: | The proposed framework achieves significant and consistent improvements on two widely-used benchmark datasets. |
Unveiling Multimodal Processing: Exploring Activation Patterns in Multimodal LLMs for Interpretability and Efficiency (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in multimodal large language models have remained opaque. |
| Approach: | They propose a method to convert dense MLLMs into fine-grained Mixture-of-Experts architectures. |
| Outcome: | The proposed method outperforms random expert pruning and sparse activation and model pruning. |