Papers with QGen
Quiz Design Task: Helping Teachers Create Quizzes with Automated Question Generation (2022.findings-naacl)
Copied to clipboard
| Challenge: | Question generation models are often evaluated with standardized NLG metrics that are based on n-gram overlap. |
| Approach: | They propose to use QGen to help teachers automate the generation of reading comprehension quizzes by comparing n-gram overlap with BLEU to compare system-generated questions with heldout human-written references. |
| Outcome: | The best model had only 68.4% of its questions accepted by the ten teachers who participated in the study. |
It’s All Relative! – A Synthetic Query Generation Approach for Improving Zero-Shot Relevance Prediction (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large language models generate synthetic query-document pairs by prompting with as few as 8 demonstrations. |
| Approach: | They propose to generate queries simultaneously for different labels by prompting with 8 demonstrations. |
| Outcome: | Extensive experimentation shows that synthetic queries generated in such a fashion improve performance. |