Tokenization Is More Than Compression (2024.emnlp-main)

Copied to clipboard

Challenge: Existing tokenization approaches like Byte-Pair Encoding (BPE) have been suggested that their effectiveness stems from their ability to condense text into a relatively small number of tokens.
Approach: They propose a tokenizer that segments a document’s text into the minimum number of tokens for a given vocabulary and propose fewer tokens to improve downstream performance.
Outcome: The proposed tokenizers can initialize vocabulary construction and pre-tokenization, and the results show that fewer tokens lead to better performance.

Similar Papers

Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance (2024.findings-acl)

Copied to clipboard

Challenge: Despite being the cornerstone of BPE, the importance of compression in the tokenization process is still unclear.
Approach: They argue for the theoretical importance of compression in the tokenization process . they also demonstrate the empirical importance of compressing tokenizers for downstream success of pre-trained language models.
Outcome: The proposed method can be viewed as 0-gram language modeling where equal probability is assigned to all tokens.
Investigating the Effectiveness of BPE: The Power of Shorter Sequences (D19-1)

Copied to clipboard

Challenge: Byte-Pair Encoding (BPE) is an unsupervised sub-word tokenization technique, but its reasons for its effectiveness are not well understood.
Approach: They link BPE to the broader family of dictionary-based compression algorithms and compare it with other members of this family.
Outcome: The proposed method is compared with dictionary-based compression algorithms and improves on a fixed vocabulary size budget.
Stop Taking Tokenizers for Granted: They Are Core Design Decisions in Large Language Models (2026.eacl-long)

Copied to clipboard

Challenge: Subword tokenization approaches misalign with linguistic structure and waste capacity across languages and domains.
Approach: They argue for a context-aware framework that integrates tokenizer and model co-design . they argue that tokenization should be treated as a core design problem, not an afterthought .
Outcome: The proposed framework integrates tokenizer and model co-design, guided by linguistic, domain, and deployment considerations.
An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks (2020.aacl-main)

Copied to clipboard

Challenge: Traditionally, tokenization is the very first step in most text processing works.
Approach: They propose to use morphological segmentation followed by BPE for Korean NLP tasks . they empirically examine what is the best tokenization strategy for Korean to/from English .
Outcome: The proposed approach is best for Korean to/from English machine translation and natural language understanding tasks.
BPE Gets Picky: Efficient Vocabulary Refinement During Tokenizer Training (2024.emnlp-main)

Copied to clipboard

Challenge: Tokenization is a relatively understudied area, but it can greatly impact model performance and efficiency.
Approach: They propose a modified BPE tokenizer that removes merges that leave intermediate "junk" tokens from the vocabulary.
Outcome: The proposed method improves vocabulary efficiency, eliminates under-trained tokens, and does not compromise text compression.
How Important Is Tokenization in French Medical Masked Language Models? (2024.lrec-main)

Copied to clipboard

Challenge: Word tokenization into subword units has become the prevailing standard in the field of natural language processing (NLP) over recent years . the precise factors contributing to its success remain unclear .
Approach: They propose a tokenization strategy that integrates morpheme-enriched word segmentation into existing tokenization methods.
Outcome: The proposed tokenization strategy outperforms character and word tokenization but the precise factors contributing to its success remain unclear.
Parity-Aware Byte-Pair Encoding: Improving Cross-lingual Fairness in Tokenization (2026.acl-long)

Copied to clipboard

Challenge: Tokenization is the first step of most NLP pipelines.
Approach: They propose a parity-aware byte pair encoder that maximizes the compression gain of the currently worst-compressed language for cross-lingual parity.
Outcome: a new algorithm reduces tokenization inequality by 89% compared to classical BPE . the proposed algorithm is based on a fair-max rule that maximizes the compression gain of the currently worst-compressed language .
Byte Pair Encoding is Suboptimal for Language Model Pretraining (2020.findings-emnlp)

Copied to clipboard

Challenge: Subword tokenization is a popular language model that can be used to segment text.
Approach: They analyze differences between byte-pair encoding (BPE) and unigram LM tokenization methods to find subword units that align more closely with morphology.
Outcome: The proposed method recovers subword units that align more closely with morphology and avoids problems stemming from BPE’s greedy construction procedure.
AdaptBPE: From General Purpose to Specialized Tokenizers (2026.eacl-long)

Copied to clipboard

Challenge: Subword tokenization methods impact performance and efficiency of large language models . generic tokens can incur inefficiencies when applying the model to specific domains or languages .
Approach: They propose a subword tokenization technique that selectively replaces low-utility tokens with more relevant ones based on their frequency in an adaptation corpus.
Outcome: The proposed method compresses test corpora more effectively than baselines using the same vocabulary size.
From Where Words Come: Efficient Regularization of Code Tokenizers Through Source Attribution (2026.acl-long)

Copied to clipboard

Challenge: Currently, subword tokenization is the most common approach for vocabulary building in large models.
Approach: They propose to regularize training and minimize overfitting by using source-attributed BPE . they find that undertrained tokens are prone to producing unused, unusable tokens .
Outcome: The proposed techniques reduce the number of under-trained tokens while maintaining the same inference procedure as with regular BPE.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations