Papers by Kazuma Kokuta
Can LMs Store and Retrieve 1-to-N Relational Knowledge? (2023.acl-srw)
Copied to clipboard
| Challenge: | Pretraining language models on large amounts of text has made it difficult to store and retrieve world knowledge. |
| Approach: | They propose to view pretrained language models as knowledge bases by examining their ability to store and retrieve world knowledge. |
| Outcome: | The proposed model can store and retrieve world knowledge with high accuracy, but it is not clear how accurately it can handle 1-to-N relational knowledge. |