Papers by Guangluan Xu
Multistage Fusion with Forget Gate for Multimodal Summarization in Open-Domain Videos (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for multimodal summarization for open-domain videos lack fine-grained interactions between multisource inputs. |
| Approach: | They propose a multistage fusion network with a forget gate module to integrate multimodal information into a fluent textual summary. |
| Outcome: | The proposed model achieves state-of-the-art on multiple encoder-decoder architectures and low noise transcripts. |
Assist Non-native Viewers: Multimodal Cross-Lingual Summarization for How2 Videos (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing multimodal summarization methods are limited to monolingual videos . a proposed task aims to generate cross-lingual summaries from multimodal inputs . |
| Approach: | They propose a task to generate cross-lingual summaries from multimodal inputs of videos . they propose fusion network that integrates multimodal and cross-linguistic information . |
| Outcome: | The proposed task outperforms existing methods on a reorganized How2 dataset on the reorganized How2 data set. |
GOME: Grounding-based Metaphor Binding With Conceptual Elaboration For Figurative Language Illustration (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing Large Language Models (LLMs) and multimodal models are unable to illustrate figurative language based on literal objects, ignoring the underlying groundings and associations across disparate metaphorical domains. |
| Approach: | They propose a grounding-based method for metaphor illustration that integrates metaphorical knowledge into systematic instructions for existing large language models. |
| Outcome: | The proposed method is superior to existing LLMs, diffusion models, or their direct collaboration. |
Narrative Order Aware Story Generation via Bidirectional Pretraining Model with Optimal Transport Reward (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing storytelling systems suffer from insufficient understanding of event correlations and inadequate awareness of event temporal order. |
| Approach: | They propose a narrative order aware framework to generate coherent stories with flashbacks . they propose 'bidirectional pretraining model with Optimal Transport Reward' to improve quality . |
| Outcome: | The proposed framework generates coherent stories with flashbacks with a novel optimal transport reward. |
Rethinking the Reversal Curse of LLMs: a Prescription from Human Knowledge Reversal (2024.emnlp-main)
Copied to clipboard
Zhicong Lu, Li Jin, Peiguang Li, Yu Tian, Linhao Zhang, Sirui Wang, Guangluan Xu, Changyuan Tian, Xunliang Cai
| Challenge: | Existing methods for large language models (LLMs) are limited by their aggressive sample permutation and lack a detailed understanding of the underlying reasons for the reversal curse. |
| Approach: | They propose a method which enhances bidirectional entity correlation modeling and pairwise relationship reasoning to overcome the reversal curse. |
| Outcome: | The proposed method overcomes the reversal curse by augmenting the samples with entity order-reversals and semantically preserved question-answer pairs. |
PIPER: Benchmarking and Prompting Event Reasoning Boundary of LLMs via Debiasing-Distillation Enhanced Tuning (2025.acl-long)
Copied to clipboard
Zhicong Lu, Changyuan Tian, PeiguangLi PeiguangLi, Li Jin, Sirui Wang, Wei Jia, Ying Shen, Guangluan Xu
| Challenge: | Existing studies on Large Language Models (LLMs) have failed to evaluate their performance in event reasoning with a single event relational type or reasoning format. |
| Approach: | They propose a benchmark to evaluate LLMs' event reasoning capability using a single event relational type or reasoning format. |
| Outcome: | The proposed model improves on 10K diverse instruction-tuning demonstrations to alleviate event reasoning-oriented data scarcity. |