Papers by Logan Born
Compositionality of Complex Graphemes in the Undeciphered Proto-Elamite Script using Image and Text Embedding Models (2021.findings-acl)
Copied to clipboard
| Challenge: | a language model over sign images produces more interpretable results than a model over text . a new language model is developed to abstract from human annotators . |
| Approach: | They propose a language modeling architecture which operates over sequences of images or over multimodal sequences with associated labels. |
| Outcome: | The proposed language model can interpret signs in the undeciphered proto-Elamite script . it also provides a novel way to abstract away from biases introduced by human annotators. |
Prefix Lexicalization of Synchronous CFGs using Synchronous TAG (P18-1)
Copied to clipboard
| Challenge: | epsilon-free, chain-free synchronous context-free grammars can be converted into weakly equivalent synchronous tree-adjoining grammars (STAGs) this transformation doubles the grammar’s rank and cubes its size, but in practice the size increase is only quadratic. |
| Approach: | They extend Greibach normal form from CFGs to SCFGs and prove new formal properties about SCFG, a formalism with many applications in natural language processing. |
| Outcome: | The proposed grammars achieve asymptotic and empirical speed improvements on a machine translation task. |
CipherDAug: Ciphertext based Data Augmentation for Neural Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | a novel data-augmentation technique for neural machine translation is based on a letter substitution cipher . a bijective ciphered text is in effect invisible to modern NLP techniques because of its invariant distributional features . |
| Approach: | They propose a data-augmentation technique for neural machine translation based on ROT-k ciphertexts. |
| Outcome: | The proposed method outperforms existing methods on several datasets by a significant margin. |
Sequence Models for Document Structure Identification in an Undeciphered Script (2022.emnlp-main)
Copied to clipboard
| Challenge: | a systematic analysis of “header” signs in proto-Elamite provides new evidence for their existence . experts have hypothesized that headers are a sign which qualifies transactions . |
| Approach: | They provide unsupervised neural and statistical sequence modeling techniques to identify “header” signs in proto-Elamite, an undeciphered script from 3100-2900 BCE. |
| Outcome: | The authors provide new evidence for the existence of "header" signs in proto-Elamite . they examine which features predict their presence and identify correlations between features and other document properties . |
Decipherment as Regression: Solving Historical Substitution Ciphers by Learning Symbol Recurrence Relations (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for solving substitution ciphers use character-level language models to find key . a Transformer-based causal language model can be used to learn recurrences between characters in a ciphered text . |
| Approach: | They propose a Transformer-based causal language model for decipherment that learns recurrences between characters in a ciphertext. |
| Outcome: | The proposed method achieves strong results on synthetic 1:1 and homophonic ciphers . it learns recurrence relations between cipheries and recovers keys in its self-attention . |