Papers by Haisheng Zheng
Divergent Thoughts toward One Goal: LLM-based Multi-Agent Collaboration System for Electronic Design Automation (2025.naacl-long)
Copied to clipboard
| Challenge: | Electronic design automation (EDA) is indispensable for the design of integrated circuits. |
| Approach: | They propose a multi-agent collaboration system where multiple agents harbor divergent thoughts converge towards a common goal. |
| Outcome: | The proposed system shows superior performance compared to single-agent systems. |
Efficient OpAmp Adaptation for Zoom Attention to Golden Contexts (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models have shown significant promise in question-answering tasks . noisy reference documents hinder performance of LLMs, causing disproportionate attention to irrelevant content . |
| Approach: | They propose an adaptive large language model that allocates disproportionate attention to irrelevant documents . they use transformers to train the model and integrate it into pre-trained Transformer blocks . |
| Outcome: | The proposed model outperforms state-of-the-art models on noisy-context benchmarks. |
Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated considerable proficiency in general natural language processing tasks. |
| Approach: | They propose a parameter-efficient sparsity crafting method which crafts dense models into sparse models using the mixture-of-experts architecture. |
| Outcome: | The proposed method significantly reduces computational costs and GPU memory requirements, while maintaining the quality of approximation in function space. |