Papers by Chanjin Zheng
PsyScore: A Psychometrically-Aware Framework for Trait-Adaptive Essay Scoring and ZPD-Scaffolded Feedback (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to Automated Essay Scoring (AES) treat scoring and feedback as separate components, resulting in fragmentation. |
| Approach: | They propose a psychometrically-aware framework that integrates diagnostic assessment with instructional scaffolding through a shared latent ability representation. |
| Outcome: | The proposed framework integrates diagnostic assessment with instructional scaffolding through a shared latent ability representation. |
KidsArtBench: Multi-Dimensional Children’s Art Evaluation with Attribute-Aware MLLMs (2026.eacl-long)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) show impressive capabilities across visual–language tasks, but their capacity to evaluate artistic expression remains limited. |
| Approach: | They propose an attribute-specific multi-LoRA approach where each attribute corresponds to a distinct evaluation dimension in the scoring rubric. |
| Outcome: | The proposed approach increases correlation from 0.468 to 0.653 on Qwen2.5-VL-7B, with the largest gains on perceptual dimensions and narrowed gaps on higher-order attributes. |
Decoding LLM Personality Measurement: Forced-Choice vs. Likert (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent research has focused on investigating the psychological characteristics of Large Language Models (LLMs), emphasizing the importance of comprehending their behavioral traits. |
| Approach: | They evaluated six Large Language Models: Llama-3.1-8B, GLM-4-9B, Claude-3.5-sonnet, and Deepseek-V3 and used the forced-choice test to assess their personality traits. |
| Outcome: | The forced-choice test is more reliable and more accurate than the likert scale and forced-CHOICE test results for LLMs' Big Five personality scores. |