Papers by Lucas Maystre
From Characters to Tokens: Dynamic Grouping with Hierarchical BPE (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Subword tokenization methods suffer from inefficiencies in representing rare words and require large embedding matrices. |
| Approach: | They propose a dynamic character grouping method that leverages existing BPE tokenization without adding additional models. |
| Outcome: | The proposed method matches or exceeds existing entropy- and whitespace-based patching strategies while maintaining a compact vocabulary. |