Papers by Diego Maupomé
Language Modeling with a General Second-Order RNN (2020.lrec-1)
Copied to clipboard
| Challenge: | a number of RNNs update their state as the input sequence is processed . second-order RNN architectures show promising performance in language modeling . |
| Approach: | They propose a second-order RNN architecture that generalizes existing ones . they use a Penn Treebank dataset to analyze how their different components affect performance . |
| Outcome: | The proposed architecture generalizes existing RNNs on a Penn Treebank dataset . it shows that removing the first-order terms does not hinder performance . |