Papers by Thuy Nguyen
Quantifying Train-Evaluation Overlap with Nearest Neighbors (2023.findings-acl)
Copied to clipboard
| Challenge: | Using a novel metric, we quantify train-evaluation overlap in benchmark datasets to evaluate model generalization. |
| Approach: | They quantify train-evaluation overlap as a measure of an individual dataset’s adequacy to evaluate model generalization over a wide range of datasets. |
| Outcome: | The proposed metric quantifies train-evaluation overlap, providing insights for constructing datasets to study generalization. |
CypherSmith: Transforming Text-to-Cypher Generation for LLMs with Synthetic Data (2026.acl-long)
Copied to clipboard
| Challenge: | Existing datasets are small, domain-limited, and lack diversity, constraining LLM progress. |
| Approach: | They propose a knowledge Graph retrieval tool that can translate natural language questions into structured queries. |
| Outcome: | Extensive experiments show that CypherSmith achieves state-of-the-art performance. |