Papers by Arvind Satyanaryan
LMdiff: A Visual Diff Tool to Compare Language Models (2021.emnlp-demo)
Copied to clipboard
| Challenge: | LMdiff visually compares probability distributions of two different language models . notably absent from the range of available tools are those that aim to compare distributions produced by different models. |
| Approach: | They propose a tool that visually compares probability distributions of two different language models that differ through finetuning, distillation, or simply training with different parameter sizes. |
| Outcome: | The proposed tool allows the generation of hypotheses about model behavior by investigating text instances token by token and further assists in choosing interesting text instances from large corpora. |