Papers by Shuyang Shi
EvoR: Evolving Retrieval for Code Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing pipelines for retrieval-augmented code generation (RACG) use static knowledge bases with a single source, limiting adaptation capabilities of Large Language Models (LLMs) Extensive experiments demonstrate that EVOR achieves two to four times of execution accuracy compared to other methods such as Reflexion. |
| Approach: | They propose a retrieval-augmented code generation pipeline that employs the synchronous evolution of queries and diverse knowledge bases. |
| Outcome: | The proposed pipeline achieves two to four times of execution accuracy compared to other methods. |
Navigating Noisy Feedback: Enhancing Reinforcement Learning with Error-Prone Language Models (2024.findings-emnlp)
Copied to clipboard
Muhan Lin, Shuyang Shi, Yue Guo, Behdad Chalaki, Vaishnav Tadiparthi, Ehsan Moradi Pari, Simon Stepputtis, Joseph Campbell, Katia Sycara
| Challenge: | Reward hacking is a problem in reinforcement learning where the ability to specify the desired behavior of a reward function is difficult. |
| Approach: | They propose to use feedback as a potential-based shaping function to solicit and apply feedback from large language models to improve convergence speed and policy returns. |
| Outcome: | The proposed method improves convergence speed and policy returns over baselines even with significant ranking errors and eliminates the need for complex post-processing of reward functions. |