Papers by Thanapon Noraset
Estimating Marginal Probabilities of n-grams for Recurrent Neural Language Models (D18-1)
Copied to clipboard
| Challenge: | Recurrent neural network language models (RNNs) only estimate probabilities for complete sequences of text, whereas some applications require context-independent phrase probabilities instead. |
| Approach: | They propose a method to alter the RNNLM training to make it more accurate at marginal estimation. |
| Outcome: | The proposed method is effective compared to baselines including the traditional RNNLM probability and importance sampling approach. |