Papers by Viacheslav Surkov
Self-Recognition in Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for language modeling are very capable, but depend on commercial providers to build them. |
| Approach: | They propose a model-generated security question to assess self-recognition in LMs . they find no evidence of general or consistent self-reason in any examined LM . |
| Outcome: | The proposed approach can be externally administered to keep track of frontier models as it does not require access to internal model parameters or output probabilities. |