| Challenge: | a new study examines the multichannel discourse analysis of human communication . we examine the individual variation in multichannel behavior . |
| Approach: | They propose to use a multichannel resource to study multichannel discourses . they propose to analyze verbal structure, prosody, gesticulation, facial expression, eye gaze . |
| Outcome: | The proposed method is crucially important for fine-grained annotation procedures and statistical analyses of multichannel data. |
Similar Papers
Multimodality for NLP-Centered Applications: Resources, Advances and Frontiers (2022.lrec-1)
Copied to clipboard
| Challenge: | resurgence of multimodal datasets has attracted significant research interest, but there is no comprehensive survey for this task. |
| Approach: | They present a survey of a multimodal dataset with different modalities according to the applications. |
| Outcome: | The proposed datasets are available online and discuss the new frontier and motivate future researches. |
CITE: A Corpus of Image-Text Discourse Relations (N19-1)
Copied to clipboard
| Challenge: | a crowd-sourced resource characterizes inferences in image-text contexts in the domain of cooking recipes . a recent study has found that image-image presentations are more effective at integrating text and image . |
| Approach: | They propose a crowd-sourced resource for multimodal discourse characterizing inferences in image-text contexts in the domain of cooking recipes in the form of coherence relations. |
| Outcome: | The proposed corpus enables a better understanding of communication and common-sense reasoning . it is particularly important for automating the understanding and generation of text-image presentations . |
Proceedings of the Fourth Workshop on Discourse in Machine Translation (DiscoMT 2019) (D19-65)
Copied to clipboard
| Challenge: | . - (EN) |
| Approach: | . - (EN) |
| Outcome: | . - (EN) |
Multimodal Grounding for Language Processing (C18-1)
Copied to clipboard
| Challenge: | Recent developments in multimodal processing facilitate conceptual grounding of language. |
| Approach: | They analyze multimodal processing to examine the benefits and challenges of multimodal grounding . they focus on multimodal linguistic grounding of verbs which play a crucial role in compositional power of language. |
| Outcome: | The proposed methods improve the cognitive models of human information processing and address the challenges that arise. |
Towards Unified Multimodal Large Language Models: A survey (2026.findings-acl)
Copied to clipboard
| Challenge: | unified multimodal large language models (MLLMs) are emerging but lack a systematic framework to connect them and situate current trends within a broader landscape. |
| Approach: | They present a systematic review of unified Multimodal Large Language Models . they outline the foundational concepts and prerequisites for understanding them . |
| Outcome: | The present review provides a systematic and systematic overview of unified MLLMs . it discusses persistent challenges and identify promising directions for future research . |
Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 4: Student Research Workshop) (2024.naacl-srw)
Copied to clipboard
| Challenge: | NAACL 2024 Student Research Workshop offers archival and non-archival tracks for research papers and thesis proposals. |
| Approach: | NAACL 2024 Student Research Workshop offers archival and non-archival tracks for research papers and thesis proposals. |
| Outcome: | the NAACL 2024 Student Research Workshop offers archival and non-archival tracks . the track is designed for research papers and thesis proposals . this year, 67 submissions were accepted, with 60% acceptance rate . |
Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 5: Tutorial Abstracts) (2024.naacl-tutorials)
Copied to clipboard
| Challenge: | NAACL 2024 tutorial sessions are a cornerstone event of the conference . a total of 27 tutorial submissions were received, and 6 were selected for presentation . |
| Approach: | NAACL 2024 will host a tutorial session featuring top-notch researchers . the tutorials aim to equip attendees with the latest tools and methodologies . a total of 27 tutorial submissions were received, and 6 were selected for presentation . |
| Outcome: | the tutorial sessions are a cornerstone event of the conference . the call, submission, reviewing, and selection of tutorials were coordinated . a total of 27 tutorial submissions were received, and 6 were selected for presentation . |
Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 3: System Demonstrations) (2024.naacl-demo)
Copied to clipboard
| Challenge: | The System Demonstration Track at NAACL 2024 is a platform for presenting papers that describe system demonstrations. |
| Approach: | the system demonstration track at NAACL 2024 is taking place from June 16 to June 21. |
| Outcome: | the system demonstration track at NAACL 2024 received 48 submissions this year . the acceptance rate was 43 . |
Multimodal Routing: Improving Local and Global Interpretability of Multimodal Language Analysis (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent multimodal learning models with strong performances on human-centric tasks are often black-box with very limited interpretability. |
| Approach: | They propose a multimodal routing algorithm which dynamically adjusts weights between input and output modalities for each input sample. |
| Outcome: | The proposed model can interpret modality-prediction relationships globally and locally for each input sample while keeping competitive performance compared to state-of-the-art methods. |
Proceedings of the 2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 5: Tutorial Abstracts) (2025.naacl-tutorial)
Copied to clipboard
| Challenge: | NAACL 2025 tutorial sessions are a cornerstone event of the conference . tutorials are designed to equip you with the latest insights, tools, and methodologies . |
| Approach: | NAACL 2025 will host a tutorial session on computational linguistics and natural language processing . the tutorials are a cornerstone event of the conference . |
| Outcome: | the tutorial sessions at NAACL 2025 are a cornerstone event of the conference . each submission received a thorough evaluation by a panel of two to three reviewers . |