Papers with OASIS
OASIS: Online Sample Selection for Continual Instruction Tuning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for continual instruction tuning (CIT) use pre-trained reference models, which are impractical in CIT setups since future data are unknown. |
| Approach: | They propose an adaptive online sample selection approach that estimates each sample’s informativeness relative to all previously seen data and minimizes informative redundancy through iterative selection score updates. |
| Outcome: | Experiments on various large foundation models show that using only 25% of the data achieves comparable performance to full-data training and outperforms the state-of-the-art sampling methods. |
OASIS: Order-Augmented Strategy for Improved Code Search (2025.acl-long)
Copied to clipboard
Gao Zuchen, Zizheng Zhan, Xianming Li, Erxin Yu, Haotian Zhang, Chenbin Chenbin, Yuqun Zhang, Jing Li
| Challenge: | Code embeddings capture the semantic representations of code and are crucial for various code-related large language model (LLM) applications. |
| Approach: | They propose an order-augmented strategy for improved code search that leverages order-based similarity labels to capture subtle differences in similarity among negative pairs. |
| Outcome: | The proposed model outperforms state-of-the-art models focusing on major positive-negative differences. |
OASIS: Mitigating Harmful Fine-tuning Attacks on LLMs via Orthogonal and Adaptive Safety Alignment Strategy (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods to decouple safety enforcement from harmful feature acquisition rely on perturbation directions that conflict with harmful gradients . harmful fine-tuning attacks pose a significant challenge for service providers aiming to uphold rigorous safety standards. |
| Approach: | They propose an orthogonal and ad hoc safety alignment strategy to decouple safety enforcement from harmful feature acquisition. |
| Outcome: | Experiments on four large language models show that OASIS reduces the Harmful Score by 60% compared to baselines while maintaining stable task utility. |