Papers with MMC
Multilingual Coreference Resolution in Multiparty Dialogue (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing datasets for entity coreference resolution are limited to English and other languages are rare. |
| Approach: | They propose to use TV transcripts to create multilingual multiparty coreference datasets that leverage existing subtitles in Chinese and Farsi. |
| Outcome: | The proposed dataset re-annotates for coreference on TV transcripts and then leverages existing subtitle translations to create a multilingual corpus. |
MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuning (2024.naacl-long)
Copied to clipboard
Fuxiao Liu, Xiaoyang Wang, Wenlin Yao, Jianshu Chen, Kaiqiang Song, Sangwoo Cho, Yaser Yacoob, Dong Yu
| Challenge: | Existing large language models have limited ability to perform tasks effectively. |
| Approach: | They propose a large-scale multimodal chart instruction dataset with 600k instances supporting diverse tasks and chart types. |
| Outcome: | The proposed LMM achieves state-of-the-art performance on existing chart QA benchmarks. |
Video-aided Unsupervised Grammar Induction (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods of multi-modal grammar induction focus on grammar inducing from text-image pairs, but videos provide even richer information, such as static objects and actions. |
| Approach: | They propose a video-aided grammar induction model which learns a constituency parser from unlabeled text and its corresponding video. |
| Outcome: | The proposed model outperforms existing systems on three benchmarks. |