Papers by Rajan Vivek
Anchor Points: Benchmarking Models with Much Fewer Examples (2024.eacl-long)
Copied to clipboard
| Challenge: | Modern language models exhibit powerful but brittle behavior, leading to larger and more diverse benchmarks. |
| Approach: | They propose to use anchor points to select small subsets of a language model-prompt dataset to capture model behavior across the entire dataset. |
| Outcome: | The proposed technique outperforms standard benchmarks in language models with 1-30 anchor points . the proposed technique can be used to compare models on different regions of the dataset . |