Papers by Justin Matejka
mrCAD: Multimodal Communication to Refine Computer-aided Designs (2025.findings-emnlp)
Copied to clipboard
William P McCarthy, Saujas Vaduguru, Karl D.d. Willis, Justin Matejka, Judith E Fan, Daniel Fried, Yewen Pu
| Challenge: | generative AI excels at creating artifacts in a single turn but can struggle to make precise refinements that match our design intent. |
| Approach: | They propose to use multi-turn interactions to iterate and refine computer-aided designs (CADs) they use text and drawing to communicate with each other over multiple rounds of interaction . |
| Outcome: | mrCAD consists of 6,082 communication games, 15,163 instruction-execution rounds, played between 1,092 pairs of humans. |