Revisiting LLMs as Zero-Shot Time Series Forecasters: Small Noise Can Break Large Models (2025.acl-short)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable performance across diverse tasks without domain-specific training, fueling interest in their potential for time series forecasting. |
| Approach: | They evaluate the effectiveness of LLMs as zero-shot forecasters compared to state-of-the-art domain-specific models by encoding sequences directly within prompts. |
| Outcome: | The proposed models perform well across multiple domains while reducing the need for domain-specific training. |
Similar Papers
Enhancing Zero-Shot Time Series Forecasting in Off-the-Shelf LLMs via Noise Injection Prompting (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing work relies on fine-tuning specialized modules to bridge this gap, but a novel approach is proposed to leverage off-the-shelf LLMs without any fine- tuning whatsoever. |
| Approach: | They propose a method to inject noise into the raw time series before tokenization to induce the model to extrapolate based on robust underlying temporal patterns rather than superficial numerical artifacts. |
| Outcome: | The proposed approach overcomes the brittleness of fully frozen models by injecting noise into the raw TS before tokenization. |
Predicting Language Models’ Success at Zero-Shot Probabilistic Prediction (2025.findings-emnlp)
Copied to clipboard
Kevin Ren, Santiago Cortes-Gomez, Carlos Miguel Patiño, Ananya Joshi, Ruiqi Lyu, Jingjing Tang, Alistair Turcan, Khurram Yamin, Steven Wu, Bryan Wilder
| Challenge: | Recent work has investigated the capabilities of large language models (LLMs) as zero-shot models for generating individual-level characteristics. |
| Approach: | They conduct a large-scale empirical study of large language models’ zero-shot predictive capabilities across a wide range of tabular prediction tasks. |
| Outcome: | The results show that LLMs perform well on the base prediction task, and when they perform well, they are more likely to provide high-quality predictions. |
LLMs Are Zero-Shot Context-Aware Simultaneous Translators (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing SiMT systems operate on a sentence level, disregarding the context established by previous sentences or the broader context implied by previous words. |
| Approach: | They show that open-source LLMs perform on par with or better than some state-of-the-art baselines in simultaneous machine translation tasks, zero-shot. |
| Outcome: | The proposed models perform on par with or better than state-of-the-art baselines in simultaneous machine translation tasks, zero-shot. |
LSTPrompt: Large Language Models as Zero-Shot Time Series Forecasters by Long-Short-Term Prompting (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing prompting methods oversimplify time-series forecasting (TSF) time-Series data are ubiquitous across various domains, including public health, finance and energy. |
| Approach: | They propose a method for prompting off-the-shelf Large Language Models (LLMs) they decompose TSF into short-term and long-term forecasting sub-tasks, tailoring prompts to each . |
| Outcome: | The proposed approach decomposes TSF into short-term and long-term forecasting sub-tasks, tailoring prompts to each. |
Are LLMs Good Zero-Shot Fallacy Classifiers? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing fallacy classifiers lack sufficient labeled data for training, limiting their out-of-distribution (OOD) generalization abilities. |
| Approach: | They propose to use Large Language Models (LLMs) for zero-shot fallacy classification. |
| Outcome: | The proposed schemes outperform existing classifiers in OOD inference scenarios and opendomain tasks. |
LLMs for Low Resource Languages in Multilingual, Multimodal and Dialectal Settings (2024.eacl-tutorials)
Copied to clipboard
| Challenge: | Recent advances in AI can be attributed to the remarkable performance of Large Language Models (LLMs) success of LLMs depends on specific training techniques, such as instruction tuning and prompting . |
| Approach: | They explore the capabilities of Large Language Models (LLMs) in various tasks and languages . they also examine their performance, fine-tuning, instructions tuning, and close vs. open models . |
| Outcome: | The proposed model can be used for speech and multimodal tasks across modalities, languages, and dialects. |
Evaluating the Factuality of Zero-shot Summarizers Across Varied Domains (2024.eacl-short)
Copied to clipboard
| Challenge: | Recent work has shown that large language models can generate zero-shot summaries without explicit supervision that are often comparable or even preferred to manually composed reference summary. |
| Approach: | They evaluate large language models (LLMs) that generate zero-shot summaries without explicit supervision that are often comparable to manual reference summary . they acquire annotations from domain experts to identify inconsistencies in summaires and categorize errors. |
| Outcome: | The proposed model outperforms fine-tuned models in biomedical articles and legal bills across specialized domains. |
Self-Improving for Zero-Shot Named Entity Recognition with Large Language Models (2024.naacl-short)
Copied to clipboard
| Challenge: | Existing studies exploring the performance of large language models on named entity recognition tasks have focused on training task-specific LLMs for NER. |
| Approach: | They propose a training-free self-improving framework that utilizes an unlabeled corpus to stimulate the self-learning ability of LLMs. |
| Outcome: | The proposed framework improves performance on the named entity recognition task by using an unlabeled corpus. |
LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Models (2024.eacl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models have enabled impressive zero-shot capabilities across various natural language tasks. |
| Approach: | They propose two ways to exploit the emergent abilities of large language models for NLG assessment. |
| Outcome: | The proposed methods improve performance and positional biases in comparisons between candidates. |
Do LLMs Overcome Shortcut Learning? An Evaluation of Shortcut Challenges in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable capabilities in various tasks, but may rely on dataset biases as shortcuts for prediction. |
| Approach: | They propose to use a test suite to evaluate the impact of shortcuts on LLMs' performance. |
| Outcome: | The proposed test suite incorporates six shortcut types, five evaluation metrics, and four prompting strategies. |