Papers by Maksym Tarnavskyi
Ensembling and Knowledge Distilling of Large Sequence Taggers for Grammatical Error Correction (2022.acl-long)
Copied to clipboard
| Challenge: | Currently, machine translation (MT) is the mainstream approach for GEC. |
| Approach: | They propose to ensemble Transformer-based encoders by majority votes on span-level edits . their best ensemble achieves a new SOTA result even without pre-training on synthetic datasets - "Troy-Blogs" and "Try-1BW". |
| Outcome: | The proposed model achieves a new SOTA result even without pre-training on synthetic datasets. |