Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization (P19-1)
Copied to clipboard
Paul Pu Liang, Zhun Liu, Yao-Hung Hubert Tsai, Qibin Zhao, Ruslan Salakhutdinov, Louis-Philippe Morency
| Challenge: | Existing methods to regularize multimodal data are imperfect due to imperfect modalities, missing entries or noise corruption. |
| Approach: | They propose a method to regularize multimodal data by tensor rank minimization . they use correlations between time and modalities to generate low-rank tenses . |
| Outcome: | The proposed model achieves good results across various levels of imperfection. |
Similar Papers
Efficient Low-rank Multimodal Fusion With Modality-Specific Factors (P18-1)
Copied to clipboard
Zhun Liu, Ying Shen, Varun Bharadhwaj Lakshminarasimhan, Paul Pu Liang, AmirAli Bagher Zadeh, Louis-Philippe Morency
| Challenge: | Multimodal research is a growing field of artificial intelligence, and fusion is one of the main research problems. |
| Approach: | They propose a low-rank multimodal fusion method which integrates multiple unimodal representations into one compact multimodal representation. |
| Outcome: | The proposed method achieves competitive results on multimodal sentiment analysis, speaker trait analysis, and emotion recognition tasks while reducing computational complexity. |
DALR: Dual-level Alignment Learning for Multimodal Sentence Representation Learning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing multimodal sentence representation learning methods focus on aligning images and text at a coarse level, resulting in cross-modal misalignment bias and intra-modal semantic divergence. |
| Approach: | They propose a dual-level alignment learning framework for multimodal sentence representation learning that promotes cross-modal and intra-modal alignment. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on semantic textual similarity and transfer tasks on semantic similarity, ranking distillation and global intra-modal alignment learning. |
Multilingual Normalization of Temporal Expressions with Masked Language Models (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for normalizing temporal expressions are rule-based, which severely limits the applicability in multilingual settings. |
| Approach: | They propose a neural method for normalizing temporal expressions based on masked language modeling and a slot-based prediction scheme for context-independent representations. |
| Outcome: | The proposed method outperforms existing rule-based methods in many languages and in particular, for low-resource languages with performance improvements of up to 33 F1 on average compared to the state of the art. |
Learning from Noisy Labels for Entity-Centric Information Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent information extraction approaches can easily overfit noisy labels and suffer from performance degradation. |
| Approach: | They propose a co-regularization framework for entity-centric information extraction that optimizes neural models with task-specific losses and regularizes them to generate similar predictions based on agreement loss. |
| Outcome: | The proposed framework is optimized with task-specific losses and generates similar predictions based on agreement loss. |
Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Recent studies report improvements when equipping models with multimodal information, but it remains unclear whether such improvements actually come from the multimodal part. |
| Approach: | They propose to extend conventional text-only translation models with multimodal information by extending them with visual input. |
| Outcome: | The proposed models replicate similar gains as recently developed multimodal-integrated systems achieved, but learn to ignore multimodal information. |
Strong and Simple Baselines for Multimodal Utterance Embeddings (N19-1)
Copied to clipboard
| Challenge: | Human language is a rich multimodal signal consisting of spoken words, facial expressions, body gestures, and vocal intonations. |
| Approach: | They propose two simple but strong baselines to learn embeddings of multimodal utterances by factorizing the utterant into unimodal factors. |
| Outcome: | The proposed models show that they can be derived in closed form while maintaining simplicity and efficiency during learning and inference. |
Time-LlaMA: Adapting Large Language Models for Time Series Modeling via Dynamic Low-rank Adaptation (2025.acl-srw)
Copied to clipboard
| Challenge: | Recent studies have demonstrated that large language models possess robust pattern recognition and semantic understanding capabilities over time series data. |
| Approach: | They propose a time series model that converts time series input into token embeddings and aligns time sequence embeddables with text prompts. |
| Outcome: | The proposed framework achieves the state-of-the-art (SOTA) performance and has potentials for wide industrial usages. |
Dual Low-Rank Multimodal Fusion (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing tensor-based fusion methods make poor use of fine-grained temporal dynamics of multimodal sequential features. |
| Approach: | They propose a novel multimodal fusion method called Fine-Grained Temporal Low-Rank Multimodal Fusion that uses low-rank tensor approximation along dual dimensions of input features. |
| Outcome: | The proposed method outperforms the state-of-the-art tensor-based methods with a similar computational complexity. |
Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis (2023.emnlp-main)
Copied to clipboard
| Challenge: | Multimodal Sentiment Analysis (MSA) is effective when using rich information from multiple sources, but the potential sentiment-irrelevant information across modalities may hinder the performance from being further improved. |
| Approach: | They propose an Adaptive Language-guided Multimodal Transformer (ALMT) that learns an irrelevance/conflict-suppressing representation from visual and audio features under guidance of language features at different scales. |
| Outcome: | The proposed model achieves state-of-the-art on several popular datasets and an abundance of ablation shows the effectiveness of the proposed model. |
Out-of-Distribution Generalization in Natural Language Processing: Past, Present, and Future (2023.emnlp-main)
Copied to clipboard
Linyi Yang, Yaoxian Song, Xuan Ren, Chenyang Lyu, Yidong Wang, Jingming Zhuo, Lingqiao Liu, Jindong Wang, Jennifer Foster, Yue Zhang
| Challenge: | Existing literature on the generalization of machine learning models to out-of-distribution data is lacking. |
| Approach: | They propose to present the first comprehensive review of recent progress, methods, and evaluations on the generalization challenge from an OOD perspective in natural language understanding. |
| Outcome: | The proposed survey provides the first comprehensive review of recent progress, methods, and evaluations on the generalization challenge from an OOD perspective in natural language understanding. |