Papers by Haokun Chen
LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steering (2025.acl-long)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) enhance visual tasks by integrating visual representations into large language models. |
| Approach: | They propose a method to re-balance modalities by steering visual representations . they propose LLaVA Steering, a platform that enables rapid customization of MLLMs a component-based architecture . |
| Outcome: | The proposed model re-balances the modalities of visual representations in large language models . the model requires 500 times fewer trainable parameters than LoRA while maintaining comparable performance . |
SwarmAgentic: Towards Fully Automated Agentic System Generation via Swarm Intelligence (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing agentic system generation frameworks lack autonomy, autonomy, and functionality . current frameworks are too rigid, limiting adaptability and scalability. |
| Approach: | They propose a framework that fully automates agentic system generation, optimization, and collaboration . they construct agents from scratch and jointly refine functionality and coordination . |
| Outcome: | The proposed framework outperforms ADAS on six real-world, open-ended, and exploratory tasks on the TravelPlanner benchmark. |
Soft Token Attacks Cannot Reliably Audit Unlearning in Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work shows that soft token attacks can extract unlearned information from large language models. |
| Approach: | They show that soft token attacks can extract unlearned information from LLMs . |
| Outcome: | The proposed attacks can extract unlearned information from large language models . |