Papers by Mark Gaynor
ASPERA: A Simulated Environment to Evaluate Planning for Complex Action Execution (2025.acl-long)
Copied to clipboard
Alexandru Coca, Mark Gaynor, Zhenxing Zhang, Jianpeng Cheng, Bo-Hsiang Tseng, Peter Boothroyd, Hector Martinez Alonso, Diarmuid O Seaghdha, Anders Johannsen
| Challenge: | ASPERA framework allows developers to guide LLM generation of high-quality tasks based on user queries, simulation state and corresponding validation programs. |
| Approach: | They develop a framework comprising an assistant library simulation and a human-assisted LLM data generation engine to guide LLM generation of high-quality tasks . they use a dataset to evaluate 250 tasks generated using ASPERA . |
| Outcome: | The proposed framework can guide LLM generation of high-quality tasks tackling data availability and evaluation robustness challenges. |
LUCID: LLM-Generated Utterances for Complex and Interesting Dialogues (2024.naacl-srw)
Copied to clipboard
Joe Stacey, Jianpeng Cheng, John Torr, Tristan Guigue, Joris Driesen, Alexandru Coca, Mark Gaynor, Anders Johannsen
| Challenge: | Existing datasets with limited domain coverage and few challenging conversational phenomena are often unlabelled . Existing data is limited in quality and lacks a robust evaluation process . |
| Approach: | They propose a high quality data generation system that generates high quality dialogues using 4,277 conversations across 100 intents. |
| Outcome: | The proposed system produces high quality dialogue data with high quality labels. |