Papers by Ananth Muppidi
Leveraging Self-Attention for Input-Dependent Soft Prompting in LLMs (2025.acl-short)
Copied to clipboard
| Challenge: | Large language models require fine-tuning, which is computationally expensive and challenging. |
| Approach: | They propose a method that generates soft prompts based on input tokens and attends different tokens with varying importance. |
| Outcome: | The proposed method is simple and efficient, keeping the number of trainable parameters small. |