Papers by Hsin-Yu Chou
CxLM: A Construction and Context-aware Language Model (2022.lrec-1)
Copied to clipboard
| Challenge: | Constructions are direct form-meaning pairs with possible schematic slots . however, these slots are constrained by the embedded construction and the context . we propose that a conditional probability distribution could be described but language models cannot capture this distribution. |
| Approach: | They propose that a conditional probability distribution could describe constructions’ schematic slots. |
| Outcome: | The proposed model predicts masked slots more accurately than baselines and generates structurally and semantically plausible word samples. |