Papers by Xuemin Yu
Latent Concept-based Explanation of NLP Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing attempts to explain deep learning models rely on input features, such as the words . however, such explanations are often less informative due to the discrete nature of words and lack of contextual verbosity. |
| Approach: | They propose a method that generates explanations for predictions based on latent concepts . they map the representations of salient input words into the training latent space . |
| Outcome: | The proposed method generates explanations for predictions based on latent concepts . it maps representations of salient input words into training latent space . |
Long-form evaluation of model editing (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing evaluations of model editing only use the ‘next few tokens’ completions after a prompt. |
| Approach: | They propose a new evaluation protocol that measures the efficacy and impact of model editing in long-form generative settings by using a machine-rated survey and a classifier which correlates well with human ratings. |
| Outcome: | The proposed evaluation protocol has little relationship with short-form metrics despite being designed to extend efficacy, generalization, locality, and portability into a long-form setting. |