CONTRANS: Weak-to-Strong Alignment Engineering via Concept Transplantation (2025.coling-main)
Copied to clipboard
| Challenge: | Large language models behave consistently with human goals, values and intentions, but are computationally expensive. |
| Approach: | They propose a framework that enables weak-to-strong alignment transfer via concept transplantation. |
| Outcome: | The proposed framework surpasses instruction-tuned models in terms of truthfulness. |
Similar Papers
Cross-model Transferability among Large Language Models on the Platonic Representations of Concepts (2025.acl-long)
Copied to clipboard
| Challenge: | Prior work has shown that a single LLM’s concept representations can be captured as steering vectors (SVs) prior work has demonstrated that SVs extracted from smaller LLMs can effectively control the behavior of larger LLM. |
| Approach: | They propose a linear transformation method to bridge LLM concept representations using simple linear transformations to enable efficient cross-model transfer and behavioral control via SVs. |
| Outcome: | The proposed method bridges concept representations across different LLMs and enables efficient cross-model transfer and behavioral control via SVs. |
Towards Better Value Principles for Large Language Model Alignment: A Systematic Evaluation and Enhancement (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) show remarkable performance across tasks . alignment with human values is critical for their responsible development. |
| Approach: | They propose a framework that evaluates value principles along three desirable properties . they propose supervised fine-tuning, reinforcement learning-based approaches . |
| Outcome: | The proposed framework improves value principles along the three desirable properties of LLMs. |
Aligners: Decoupling LLMs and Alignment (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) need to be aligned with human expectations to ensure their safety and utility in most applications. |
| Approach: | They propose to decouple LLMs and alignment by training *aligner* models that can be used to align any LLM on an as-needed basis. |
| Outcome: | The proposed model can be used to align any LLM for a given criteria on an as-needed basis. |
Inverse Reinforcement Learning Meets Large Language Model Alignment (2025.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial will provide a comprehensive review of recent advances in LLM alignment . it will highlight the necessity of constructing neural reward models from human data . |
| Approach: | This tutorial will provide a comprehensive review of recent advances in LLM alignment through the lens of inverse reinforcement learning. |
| Outcome: | This tutorial will provide a comprehensive review of recent advances in LLM alignment through the lens of inverse reinforcement learning (IRL). |
Aligning Large Language Models for Controllable Recommendations (2024.acl-long)
Copied to clipboard
| Challenge: | Existing literature focuses on integrating domain-specific knowledge into LLMs to enhance accuracy using a fixed task template. |
| Approach: | They propose a collection of supervised learning tasks augmented with labels derived from a conventional recommender model to improve LLMs’ proficiency in adhering to recommendation-specific instructions. |
| Outcome: | The proposed approach significantly improves the capability of LLMs to respond to instructions within recommender systems, reducing formatting errors while maintaining a high level of accuracy. |
Well Begun is Half Done: Low-resource Preference Alignment by Weak-to-Strong Decoding (2025.findings-acl)
Copied to clipboard
| Challenge: | Low-resource methods for LLM alignment have been popular, but still face challenges in obtaining high-quality and aligned content. |
| Approach: | They propose a framework to enhance alignment ability of base models by the guidance of a small aligned model. |
| Outcome: | The proposed framework outperforms baseline methods while avoiding degradation on downstream tasks. |
Constructing Your Model’s Value Distinction: Towards LLM Alignment with Anchor Words Tuning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a study of large language models (LLMs) shows that they can generate outputs that are honest, positive, harmless, etc. |
| Approach: | They propose a method that amplifies logits difference between positive and negative tokens . they propose to use the logits gap to generate positive and positive tokens after alignment . |
| Outcome: | The proposed method achieves effective alignment, but requires fewer computational resources compared to training-time alignment methods. |
Concept Space Alignment in Multilingual LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Multilingual large language models generalize somewhat across languages, but it is unclear whether this is a result of improved, implicit alignment, or of something else, e.g., linguistic overlap or semi-parallel subsets of training data. |
| Approach: | They hypothesize that implicit alignment is the reason for generalization in multilingual large language models. |
| Outcome: | The proposed model generalizes well across languages, but lacks linearity. |
Constraining word alignments with posterior regularization for label transfer (2022.naacl-industry)
Copied to clipboard
| Challenge: | Unsupervised word alignments are not always possible in industrial NLP pipelines, where multilingual annotation guidelines are complex and deviate from semantic consistency due to various factors. |
| Approach: | They propose to constrain word alignment models to remain consistent with both source and target annotation guidelines by leveraging posterior regularization and labeled examples. |
| Outcome: | The proposed model improves on the multiATIS++ dataset over AWESoME, and even a small amount of target language annotations can help. |
Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Effective cross-lingual transfer is hindered by performance gaps and the scarcity of fine-tuning data in many languages. |
| Approach: | They propose a middle-layer alignment objective integrated into task-specific training to improve cross-lingual transfer across languages. |
| Outcome: | The proposed method improves cross-lingual transfer to lower-resource languages and can be merged with existing modules without full re-training. |