Papers by Weike Jin
Video Dialog via Progressive Inference and Cross-Transformer (D19-1)
Copied to clipboard
| Challenge: | Existing visual dialog methods use RNN to encode the dialog history as a vector representation . a new method for video dialog is proposed, which progressively updates query information based on dialog history and video content until the agent think the information is sufficient and unambiguous. |
| Approach: | They propose a method which progressively updates query information based on dialog history and video content until the agent thinks it is sufficient and unambiguous. |
| Outcome: | The proposed method can be used to infer video dialog answers on large-scale datasets. |