Papers by Jihoon Jun

Copied to clipboard

Challenge:	Using semiparametric token-sequence co-supervision, language models are trained using a finite parametric vocabulary space.
Approach:	They propose a semiparametric token-sequence co-supervision training method that leverages supervision from two different supervisions.
Outcome:	The proposed method outperforms models trained via each supervision independently and shows that it encourages a broader generalization capability across the model.