Lattice Path Edit Distance: A Romanization-aware Edit Distance for Extracting Misspelling-Correction Pairs from Japanese Search Query Logs (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods to extract misspelling-correction pairs from Japanese query logs are not effective due to the unique input methods. |
| Approach: | They propose a romanization-aware edit distance that utilizes romanization lattices to efficiently consider all possible romanized forms of input strings. |
| Outcome: | Empirical results show lattice path edit distance outperforms standard edit distance in Japanese . latticae path editing distance outpersforms existing methods even with romanization . |
Similar Papers
QSpell 250K: A Large-Scale, Practical Dataset for Chinese Search Query Spell Correction (2025.naacl-industry)
Copied to clipboard
| Challenge: | Chinese Search Query Spell Correction is a task designed to identify and correct typographical errors within queries. |
| Approach: | They propose a large-scale benchmark specifically developed for Chinese Query Spell Correction. |
| Outcome: | The proposed benchmark covers a broad range of topics, including formal entities, everyday colloquialisms and idiomatic expressions. |
Sequence-to-Lattice Models for Fast Translation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing non-autoregressive machine translation models have decoders that are difficult to port to NAT models. |
| Approach: | They propose a sequence-to-lattice model that replaces the decoder with a search lattice. |
| Outcome: | The proposed model is faster than past non-autoregressive generation approaches and more accurate than reducing the number of decoder layers. |
ESCAPE: a Large-scale Synthetic Corpus for Automatic Post-Editing (L18-1)
Copied to clipboard
| Challenge: | eSCAPE is the largest freely-available Synthetic Corpus for Automatic Post-Editing released so far. |
| Approach: | a team of researchers develops a Synthetic Corpus for Automatic Post-Editing . eSCAPE is the largest freely-available Synthetic corpus for automatic post-editing released so far . the results prove that the models always improve MT quality with statistically significant gains . |
| Outcome: | eSCAPE is the largest freely-available Synthetic Corpus for Automatic Post-Editing released so far. |
CKnowEdit: A New Chinese Knowledge Editing Dataset for Linguistics, Facts, and Logic Error Correction in LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | CKnowEdit is the first-ever knowledge editing dataset designed to correct linguistic, factual, and logical errors in Large Language Models. |
| Approach: | They propose a Chinese knowledge editing dataset to correct linguistic, factual, and logical errors in Large Language Models. |
| Outcome: | The proposed dataset highlights the challenges that LLMs face in mastering Chinese . CKnowEdit can correct linguistic, factual, and logical errors in Chinese, the authors show . |
Search Query Spell Correction with Weak Supervision in E-commerce (2023.acl-industry)
Copied to clipboard
| Challenge: | Misspelled search queries can lead to empty or irrelevant products . only 29% of the population in india is proficient in english . |
| Approach: | They propose to group spell errors into error classes and then leverage a Transformer model for contextual spell correction. |
| Outcome: | The proposed model improves on tough spell mistakes without human intervention without human input. |
Graph Matching and Graph Rewriting: GREW tools for corpus exploration, maintenance and conversion (2021.eacl-demos)
Copied to clipboard
| Challenge: | Graph Rewriting is a mathematical formalism that can be used to describe rule-based transformations on linguistic structures. |
| Approach: | They propose to use graph rewriting to describe rule-based transformations on linguistic structures. |
| Outcome: | The proposed tools can be used to compute rule-based transformations on linguistic structures. |
Building a Japanese Typo Dataset from Wikipedia’s Revision History (2020.acl-srw)
Copied to clipboard
| Challenge: | Typographical errors (typos) also occur in user generated content (UGC). |
| Approach: | They extract over half a million Japanese typo–correction pairs from Wikipedia’s revision history and combine character-based extraction rules, morphological analyzers to guess readings, and various filtering methods to address these challenges. |
| Outcome: | The proposed dataset extracts over half a million typo–correction pairs from Wikipedia’s revision history. |
NeuSpell: A Neural Spelling Correction Toolkit (2020.emnlp-demos)
Copied to clipboard
| Challenge: | a new spelling correction toolkit is available for free. |
| Approach: | They propose an open-source toolkit for spelling correction in English . they train neural models using spelling errors in context and using richer contextual representations. |
| Outcome: | The proposed spell-checker improves accuracy on synthetic examples and richer representations of the context. |
GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors (2020.lrec-1)
Copied to clipboard
| Challenge: | Lack of large-scale datasets has been a major hindrance to the development of NLP tasks such as spelling correction and grammatical error correction. |
| Approach: | They propose to make GitHub Typo Corpus a multilingual dataset of misspellings and grammatical errors available for use in NLP. |
| Outcome: | The proposed dataset contains more than 350k edits and 65M characters in more than 15 languages. |
LeSpell - A Multi-Lingual Benchmark Corpus of Spelling Errors to Develop Spellchecking Methods for Learner Language (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing spellcheckers do not work well with learner data. |
| Approach: | They propose a multi-lingual evaluation data set of spelling mistakes in context that is highly customizable for the DKPro architecture. |
| Outcome: | The proposed spellchecker improves performance in many settings and can be customized to meet learners' needs. |