Papers by Shun Tsugita
On Degrees of Freedom in Defining and Testing Natural Language Understanding (2023.findings-acl)
Copied to clipboard
| Challenge: | Large-scale pretrained language models are performing increasingly well at various tasks and offering real-world applications. |
| Approach: | They propose to define NLU as an inductive evidence that the test subject understands the language sufficiently well to meet stakeholder objectives. |
| Outcome: | The proposed framework can be used to design credible tests and facilitate scientific communication. |