Papers with JCQ
Building Japanese Creativity Benchmarks and Applying them to Enhance LLM Creativity (2025.acl-srw)
Copied to clipboard
| Challenge: | a recent study evaluated the creativity of large language models (LLMs) in Japanese based on a Torrance test of creative thinking . previous research on LLM creativity focused on English, but differences exist in how it manifests and is evaluated across languages and cultures. |
| Approach: | They construct three benchmarks to evaluate LLM creativity in Japanese . they use Japanese Creativity Questions (JCQ), Divergent Association Task (DAT) and Story Alteration Task (SAT) |
| Outcome: | The benchmarks evaluate the creativity of large language models (LLMs) in Japanese . the benchmarks are Japanese Creativity Questions (JCQ), Divergent Association Task (DAT), and Story Alteration Task (SAT). |