Papers by Desong Meng
Unleashing Large Language Models’ Proficiency in Zero-shot Essay Scoring (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in automated essay scoring (AES) have relied on labeled essays, requiring tremendous cost and expertise for their acquisition. |
| Approach: | They propose a zero-shot prompting framework that automatically decomposes writing proficiency into distinct traits and generates scoring criteria for each trait. |
| Outcome: | The proposed framework outperforms straightforward prompting (Vanilla) on TOEFL11 and ASAP, while the small-sized Llama2-13b-chat significantly outperformed ChatGPT. |