Papers by Congliang Chen
Unlocking Black-Box Prompt Tuning Efficiency via Zeroth-Order Optimization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Prompt optimization is an important technique for adapting Large Language Models (LLMs) to specific tasks. |
| Approach: | They propose a zeroth-order approach which enables efficient prompt tuning solely via inference APIs. |
| Outcome: | The proposed approach outperforms existing black-box prompt tuning methods in terms of performance and convergence speed. |
Rethinking Data Mixture for Large Language Models: A Comprehensive Survey and New Perspectives (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for data mixture improve the generalization capability of large language models (LLMs) on downstream tasks. |
| Approach: | They propose a fine-grained categorization of existing methods and propose three subtypes of offline and online methods. |
| Outcome: | The proposed methods extend beyond offline and online classifications and highlight key challenges in the field of data mixture. |