Papers by Reuben Cohn-Gordon
Pragmatic Issue-Sensitive Image Captioning (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Issue-Sensitive Image Captioning (ISIC) is a new approach to image captioning . high-quality captions are shaped by the communicative goal of identifying the target image . |
| Approach: | They propose to use image partitions to control image caption generation to produce descriptive captions. |
| Outcome: | The proposed model can be extended to include image partitions and image partitioning. |
Lost in Machine Translation: A Method to Reduce Meaning Loss (N19-1)
Copied to clipboard
| Challenge: | state-of-the-art translation systems often fail in preserving meaning . ambiguity between source and target languages can cause translation problems . |
| Approach: | They propose to use a pre-trained neural sequence-to-sequence model to define a less ambiguous translation system. |
| Outcome: | The proposed system preserves meaning in two languages without compromising translation quality. |
Pragmatically Informative Image Captioning with Character-Level Inference (N18-2)
Copied to clipboard
| Challenge: | a neural image captioner and a Rational Speech Acts (RSA) model are pragmatically informative . previous attempts to combine RSA with neural image-captioning require an inference which normalizes over the entire set of possible utterances. |
| Approach: | They propose a neural image captioner with a Rational Speech Acts model to make it pragmatically informative. |
| Outcome: | The proposed system outperforms a non-pragmatic baseline and word-level RSA captioner on a word-based model. |