Papers by Akira Ishii
Token-based Decision Criteria Are Suboptimal in In-context Learning (2025.naacl-long)
Copied to clipboard
| Challenge: | In-Context Learning (ICL) typically utilizes output probabilities of manually selected label tokens, but such calibrations lead to suboptimal decision boundaries. |
| Approach: | They propose a method which renounces token probabilities and uses the nearest centroid classifier on the Language Model’s last hidden states to predict the label of the nearest ctroid. |
| Outcome: | The proposed method outperforms current token-based baselines by about 20%50% and provides a strong state-of-the-art in ICL. |