Papers with pre-alignment
Safety-Utility Conflicts Are Not Global: Surgical Alignment via Head-Level Diagnosis (2026.acl-long)
Copied to clipboard
| Challenge: | Existing mitigation strategies rely on global gradient geometry to resolve alignment conflicts . however, they overlook Modular Heterogeneity within Transformers, resulting in suboptimal trade-offs . Conflict-Aware Sparse Tuning (CAST) combines head-level diagnosis with sparse fine-tuning . |
| Approach: | They propose a framework that integrates head-level diagnosis with sparse fine-tuning to address this limitation. |
| Outcome: | The proposed framework integrates head-level diagnosis with sparse fine-tuning to reduce alignment conflicts in LLMs. |
Align then Summarize: Automatic Alignment Methods for Summarization Corpus Creation (2020.lrec-1)
Copied to clipboard
| Challenge: | Summarizing text is not a straightforward task. |
| Approach: | They propose to use automated transcriptions to generate reports from automatic transcriptions as a dataset for neural summarization. |
| Outcome: | The proposed model improves on publicmeetings corpus on a dataset of aligned public meetings. |