Examining and Adapting Time for Multilingual Classification via Mixture of Temporal Experts (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing classification models only consider the temporal variations of existing data . current models focus on English corpora, leaving time as domains unexplored . |
| Approach: | They propose a framework to generalize classifiers over time on four languages, English, Danish, French, and German. |
| Outcome: | The proposed framework can generalize classifiers over time on four languages, English, Danish, French, and German. |
Similar Papers
Neural Temporality Adaptation for Document Classification: Diachronic Word Embeddings and Domain Adaptation Models (P19-1)
Copied to clipboard
| Challenge: | Recent studies show that document classifiers can become more stable over time when trained in ways that account for temporal variations. |
| Approach: | They propose a method for embedding diachronic word embedds into document classification models . they propose 'time-driven neural classification model' that accounts for temporal variations . |
| Outcome: | The proposed model can be trained on six corpora and make it more robust over time. |
Examining Temporality in Document Classification (P18-2)
Copied to clipboard
| Challenge: | a recent study examines how document classification models trained during one time period perform on documents trained during other time periods. |
| Approach: | They propose to use a domain adaptation approach to adjust for changes in time to improve document classification. |
| Outcome: | The proposed model improves on documents trained on time intervals even on future time interval intervals. |
Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Language use differs between domains and even within a domain, language use changes over time. |
| Approach: | They propose to use social media comments to study temporal adaptations in pre-trained language models. |
| Outcome: | The proposed model performs better on past than on future test sets, whereas adapting to domain does not improve performance on the downstream task. |
Improved Multi-label Classification under Temporal Concept Drift: Rethinking Group-Robust Algorithms in a Label-Wise Setting (2022.findings-acl)
Copied to clipboard
| Challenge: | Large-scale multi-label document classification presents interesting challenges due to the large label space and two-tiered skewed label distributions. |
| Approach: | They evaluate several group-robust optimization algorithms proposed to mitigate temporal concept drift and class imbalance in document classification. |
| Outcome: | The proposed algorithms outperform sampling-based approaches to class imbalance and concept drift and lead to much better performance on minority classes. |
How about Time? Probing a Multilingual Language Model for Temporal Relations (2022.coling-1)
Copied to clipboard
| Challenge: | XLM-R is a multilingual language model for temporal relation classification between events in four languages. |
| Approach: | They propose to use a multilingual language model for temporal relation classification between events in four languages to obtain contextualized embeddings. |
| Outcome: | The proposed model outperforms state-of-the-art models in obtaining competitive results against state- of-the art systems, but lacks suitable encoded information to address this task. |
Temporal Effects on Pre-trained Models for Language Processing Tasks (2022.tacl-1)
Copied to clipboard
| Challenge: | a recent study shows that language models can be improved as time passes . a number of approaches to solving language tasks have evolved rapidly without a model . |
| Approach: | They examine temporal effects on model performance on downstream language tasks . they also examine the efficacy of two approaches for temporal domain adaptation without human annotations . |
| Outcome: | The proposed methods improve self-labeling and named entity recognition on new data. |
Temporal Generalization for Spoken Language Understanding (2022.naacl-industry)
Copied to clipboard
| Challenge: | Spoken Language Understanding models are usually trained offline on historical data, but must perform well on incoming user requests after deployment. |
| Approach: | They propose different strategies for achieving good temporal generalization . they focus on temporal drift, where the distribution of utterances may change . |
| Outcome: | The proposed model can perform well on unseen domains, e.g., upcoming data. |
Temporally-Informed Analysis of Named Entity Recognition (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to evaluate text data are rarely reported by taking the timestamp of the document into account. |
| Approach: | They propose methods that make better use of temporally-diverse training data with a focus on named entity recognition. |
| Outcome: | The proposed models make better use of temporally-diverse training data, with a focus on named entity recognition. |
Is Your LLM Outdated? A Deep Look at Temporal Generalization (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to evaluate large language models are limited due to their inherent dynamic nature and the inherent dynamicity of language and information. |
| Approach: | They introduce a new evaluation framework that employs fresh text and event prediction for assessing LLMs’ temporal adaptability. |
| Outcome: | The proposed framework shows significant temporal biases and a decline in performance over time. |
Scaling Up Temporal Domain Generalization via Temporal Experts Averaging (2025.emnlp-main)
Copied to clipboard
Aoming Liu, Kevin Miller, Venkatesh Saligrama, Kate Saenko, Boqing Gong, Ser-Nam Lim, Bryan A. Plummer
| Challenge: | Temporal Domain Generalization (TDG) aims to generalize across temporal distribution shifts, e.g., lexical change over time. |
| Approach: | They propose a framework that updates the entire model using weight averaging to maximize generalization potential while minimizing computational costs. |
| Outcome: | The proposed framework outperforms previous methods by up to 69% while being up to 60x more efficient. |