| Challenge: | a diversity advanced actor-critical reinforcement learning framework is used to improve NLP generalization and accuracy. |
| Approach: | They introduce Diversity Advanced Actor-Critic reinforcement learning framework to improve NLP generalization and accuracy. |
| Outcome: | The proposed framework outperforms domain adaptation and generalization baselines without using any target domain knowledge. |
Similar Papers
Diversity-oriented Data Augmentation with Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing data augmentation methods focus on increasing sample numbers while neglecting sample distribution diversity, which can lead to model overfitting. |
| Approach: | They propose a data augmentation framework that focuses on sample distribution diversity and trains a large language model as a diverse paraphraser. |
| Outcome: | The proposed framework achieves an average performance gain of 10.52% surpassing the runner-up baseline with more than three percentage points. |
Enhancing LLM Knowledge Learning through Generalization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Continued pre-training on paraphrased data has shown empirical promise for enhancing knowledge acquisition, but this approach is costly and unreliable as it relies on external models or manual effort for rewriting. |
| Approach: | They propose formatting-based data augmentation which diversifies documents conveying the same knowledge by altering document formats rather than their content. |
| Outcome: | The proposed methods improve generalization to diverse paraphrased contexts and enhance pre-training and instruction tuning. |
Informed Sampling for Diversity in Concept-to-Text NLG (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to encourage lexical diversity for language generation tasks produce repetitive outputs, but this often comes at a cost to the perceived fluency and adequacy of the output. |
| Approach: | They propose to augment the decoding process with a meta-classifier trained to distinguish which words at any given timestep will lead to high-quality output. |
| Outcome: | The proposed method achieves a high level of diversity with minimal effect on the output’s fluency and adequacy. |
Learning to Generalize for Cross-domain QA (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for QA are hampered by increased training costs . current methods suffer significant performance degradation when applied to out-of-domain examples. |
| Approach: | They propose a method that combines prompting methods and linear probing with fine-tuning strategy, which does not entail additional cost. |
| Outcome: | The proposed method outperforms state-of-the-art baselines with an average increase in F1 score of 4.5%-7.9%. |
SED-SFT: Selectively Encouraging Diversity in Supervised Fine-Tuning (2026.acl-short)
Copied to clipboard
| Challenge: | Existing studies have proposed a new approach to optimize for SFT followed by RL . existing studies have suggested a method to optimize SFT for large language models . |
| Approach: | They propose a framework that encourages diversity based on token exploration space. |
| Outcome: | Experiments show that SED-SFT significantly improves generation diversity with a negligible computational overhead increase over CE loss. |
Diversification Catalyzes Language Models’ Instruction Generalization To Unseen Semantics (2025.findings-acl)
Copied to clipboard
| Challenge: | Instruction-tuned language models excel in knowledge, reasoning, and instruction-following . however, the factors enabling generalization to unseen instructions remain underexplored . |
| Approach: | They propose to model instruction-following as a computational process and design controlled experiments inspired by the Turing-complete Markov algorithm to disentangle its dynamics. |
| Outcome: | The proposed model outperforms scaling up data volumes in generalist models by combining in-domain and diverse out-of-domain tasks. |
Structurally Diverse Sampling for Sample-Efficient Training and Comprehensive Evaluation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to generalize compositionally are inadequate, but there is no evidence for this. |
| Approach: | They propose a model-agnostic algorithm for subsampling instances with diverse structures from a labeled instance pool with structured outputs. |
| Outcome: | The proposed algorithm leads to comparable or better generalization than prior algorithms in 9 out of 10 dataset-split type pairs. |
DRAMA: Diverse Augmentation from Large Language Models to Smaller Dense Retrievers (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown strong effectiveness and robustness when fine-tuned as dense retrievers. |
| Approach: | They propose a training framework that leverages pruned LLMs to train smaller generalizable dense retrievers. |
| Outcome: | The proposed training framework offers better multilingual and long-context capabilities than traditional encoder-based retrievers and achieves strong performance across multiple tasks and languages. |
Increasing Diversity While Maintaining Accuracy: Text Data Generation with Large Language Models and Human Interventions (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) can be used to generate text data for training and evaluating other models. |
| Approach: | They propose to use logit suppression and temperature sampling to diversify text generation but at the cost of data accuracy. |
| Outcome: | The proposed approach can increase diversity but at the cost of data accuracy. |
Out-of-Distribution Generalization in Natural Language Processing: Past, Present, and Future (2023.emnlp-main)
Copied to clipboard
Linyi Yang, Yaoxian Song, Xuan Ren, Chenyang Lyu, Yidong Wang, Jingming Zhuo, Lingqiao Liu, Jindong Wang, Jennifer Foster, Yue Zhang
| Challenge: | Existing literature on the generalization of machine learning models to out-of-distribution data is lacking. |
| Approach: | They propose to present the first comprehensive review of recent progress, methods, and evaluations on the generalization challenge from an OOD perspective in natural language understanding. |
| Outcome: | The proposed survey provides the first comprehensive review of recent progress, methods, and evaluations on the generalization challenge from an OOD perspective in natural language understanding. |