From Long Videos to Engaging Clips: A Human-Inspired Video Editing Framework with Multimodal Narrative Understanding (2025.emnlp-industry)
Copied to clipboard
Xiangfeng Wang, Xiao Li, Yadong Wei, null Songxueyu, Yang Song, null Xiaxiaoqiang, Fangrui Zeng, Zaiyi Chen, null Liuliu, Gu Xu, Tong Xu
| Challenge: | Existing methods for video editing rely on textual cues from ASR transcripts and segment selection, often neglecting rich visual context. |
| Approach: | They propose a human-inspired automatic video editing framework that leverages multimodal narrative understanding to address these limitations. |
| Outcome: | The proposed framework outperforms existing baselines across general and advertisement-oriented editing tasks. |
Similar Papers
VideoStir: Understanding Long Videos via Spatio-Temporally Structured and Intent-Aware RAG (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for retrieval-augmented generation (RAG) to long videos are limited by limited context windows and flatten videos into independent segments. |
| Approach: | They propose a structured and intent-aware long-video RAG framework that structures a video as a spatio-temporal graph and then performs multi-hop retrieval to aggregate evidence across distant yet contextually related events. |
| Outcome: | The proposed framework is competitive with state-of-the-art baselines without auxiliary information. |
Hierarchical3D Adapters for Long Video-to-text Summarization (2023.findings-eacl)
Copied to clipboard
| Challenge: | a recent study shows that multimodal summarization is not efficient for long inputs and outputs. |
| Approach: | They extend a TV episode transcript summarization dataset and create a multimodal variant by collecting full-length videos. |
| Outcome: | The proposed model can be tuned to perform multimodal summarization tasks efficiently using adapter modules augmented with a hierarchical structure while tuning only 3.8% of model parameters. |
MAViS: A Multi-Agent Framework for Long-Sequence Video Storytelling (2026.eacl-long)
Copied to clipboard
| Challenge: | Experimental results show that MAViS achieves state-of-the-art performance in assistive capability, visual quality, and video expressiveness. |
| Approach: | They propose an end-to-end multi-agent collaborative framework for long-sequence video storytelling that orchestrates specialized agents across multiple stages. |
| Outcome: | The proposed framework achieves state-of-the-art performance in assistive capability, visual quality, and video expressiveness. |
Synchronized Video Storytelling: Generating Video Narrations with Structured Storyline (2024.acl-long)
Copied to clipboard
| Challenge: | Existing studies on dense video captioning and video story generation have made some progress, but in practical applications, we typically require synchronized narrations for ongoing visual scenes. |
| Approach: | They propose a task of Synchronized Video Storytelling to generate synchronized narrations for videos using a benchmark dataset with rich annotations. |
| Outcome: | The proposed framework can generate narrations with the guidance of the generated or predefined storyline and human evaluations validate the effectiveness. |
ProLongVid: A Simple but Strong Baseline for Long-context Video Instruction Tuning (2025.emnlp-main)
Copied to clipboard
Rui Wang, Bohao Li, Xiyang Dai, Jianwei Yang, Yi-Ling Chen, Zhen Xing, Yifan Yang, Dongdong Chen, Xipeng Qiu, Zuxuan Wu, Yu-Gang Jiang
| Challenge: | Existing approaches to adapt image-focused models for video understanding have not been successful in analyzing long video sequences. |
| Approach: | They propose a video instruction dataset that outperforms existing video instruction data for fine-tuning MLLMs by incrementally increasing input context length. |
| Outcome: | The proposed model outperforms existing models on video benchmarks and outperformed proprietary models on VideoMME even with a compact 7B model. |
RACCooN: Versatile Instructional Video Editing with Auto-Generated Narratives (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent video generative models rely on detailed, labor-intensive text prompts for tasks, limiting adaptability for personal/raw videos. |
| Approach: | They propose a video-to-paragraph-to video editing method that supports diverse video editing capabilities, such as removal, addition, and modification, through a unified pipeline. |
| Outcome: | The proposed method supports diverse video editing capabilities, such as removal, addition, and modification, through a unified pipeline. |
A Video Is Worth 4096 Tokens: Verbalize Videos To Understand Them In Zero Shot (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing annotated training datasets hinder development of supervised learning models for multimedia content . lack of annotating benchmarks hinders development of models with satisfactory performance . a recent study shows that large language models have zero-shot performance in multimedia understanding . |
| Approach: | They propose to verbalize long videos to generate their descriptions in natural language . they then perform video-understanding tasks on the generated story as opposed to the original video . |
| Outcome: | The proposed method achieves better results than baselines for video understanding. |
VMSMO: Learning to Generate Multimodal Summary for Video-based News Articles (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies show that multimodal news can significantly improve users' sense of satisfaction for informativeness. |
| Approach: | They propose a task of Video-based Multimodal Summarization with Multimodal Output to solve this problem. |
| Outcome: | The proposed method can generate multimodal summaries with a single input . it can model the temporal dependency of video with semantic meaning of article . |
A Structured Clustering Approach for Inducing Media Narratives (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to modeling media narratives miss subtle narrative patterns through coarse-grained analysis or require domain-specific taxonomies that limit scalability. |
| Approach: | They propose a framework for inducing rich narrative schemas by jointly modeling events and characters via structured clustering. |
| Outcome: | The proposed framework produces explainable narrative schemas that align with established framing theory while scaling to large corpora without exhaustive manual annotation. |
A Challenging Multimodal Video Summary: Simultaneously Extracting and Generating Keyframe-Caption Pairs from Video (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to summarize video content have only considered video and image data, and the trend towards multimodal video summarization is changing. |
| Approach: | They propose a multimodal video summarization task setting and a dataset to train and evaluate the task. |
| Outcome: | The proposed task is useful as a practical application and presents a highly challenging problem worthy of study. |