Papers by Kehui Song
Unsupervised Sentence Representation Learning with Syntactically Aligned Negative Samples (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to sentence representation learning often encounter semantic inconsistencies and feature suppression. |
| Approach: | They propose a method for generating syntactically aligned negative (SAN) samples using a semantic importance-aware Masked Language Model (MLM) approach. |
| Outcome: | The proposed method produces negative samples with substantial textual overlap with the original sentences while conveying different meanings. |
DPDLLM: A Black-box Framework for Detecting Pre-training Data from Large Language Models (2024.findings-acl)
Copied to clipboard
Baohang Zhou, Zezhong Wang, Lingzhi Wang, Hongru Wang, Ying Zhang, Kehui Song, Xuhui Sui, Kam-Fai Wong
| Challenge: | Existing methods to detect pretraining data from large language models are unrealistic to them. |
| Approach: | They propose to detect pre-training data from LLM in a black-box way by using GPT-2 as reference model and feed it with sequence probabilities to detect whether it was used to train it. |
| Outcome: | The proposed framework outperforms existing methods on the benchmark datasets and shows that it is effective on different popular LLMs. |
MCIL: Multimodal Counterfactual Instance Learning for Low-resource Entity-based Multimodal Information Extraction (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to perform multimodal information extraction only investigated entity-based tasks under supervised learning with adequate labeled data. |
| Approach: | They propose to investigate the entity-based MIE tasks under the low-resource settings by decomposing the features into image, entity, and context factors. |
| Outcome: | The proposed method is able to perform on two public MIE benchmark datasets and the experimental results confirm it. |
PM2F2N: Patient Multi-view Multi-modal Feature Fusion Networks for Clinical Outcome Prediction (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods focused on time series data but ignored clinical notes . fusion of multi-modal features of patients from different views is not feasible due to the time series and clinical notes data being stored as time series. |
| Approach: | They propose to combine time series and clinical notes to fuse multi-modal features of patients from different perspectives using graph neural networks. |
| Outcome: | The proposed method is superior to existing models on MIMIC-III benchmark. |
Selecting Key Views for Zero-Shot Entity Linking (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Entity linking is a task of assigning ambiguous mentions in textual input to entities in knowledge bases. |
| Approach: | They propose a framework to align mentions in text to entities in knowledge bases . they use unsupervised clustering to select key views from descriptions . |
| Outcome: | The proposed framework achieves state-of-the-art on the zero-shot entity linking dataset. |
Bring Invariant to Variant: A Contrastive Prompt-based Framework for Temporal Knowledge Graph Forecasting (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for temporal knowledge graph forecasting are insufficient structural contexts to learn effective representations. |
| Approach: | They propose a Contrastive Prompt-based framework with Entity background information for TKG forecasting that brings time-invariant entity background information to time-variant structural information. |
| Outcome: | The proposed framework is effective and stays competitive in inference with limited structural information. |
TimeR4 : Time-aware Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering (2024.emnlp-main)
Copied to clipboard
| Challenge: | Temporal Knowledge Graph Question Answering (TKGQA) aims to answer temporal questions using knowledge in Temporal knowledge graphs (TKTs). |
| Approach: | They propose a Time-aware retrieve-rewrite-retrieve-rerank framework to integrate temporal knowledge from TKGs into Large Language Models (LLMs) to reduce temporal hallucination, they propose rewrite module to rew questions using background knowledge stored in TKG's, then implement a retrieve-rank module to retrieve semantically and temporally relevant facts from Tkgs and rerank them according to temporal constraints. |
| Outcome: | The proposed approach achieves relative gains of 47.8% and 22.5% on two datasets, underscoring its effectiveness in boosting the temporal reasoning abilities of LLMs. |
MELOV: Multimodal Entity Linking with Optimized Visual Features in Latent Space (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to multimodal entity linking focus on textual contexts but lack in social media vision modality. |
| Approach: | They propose a latent space vision feature optimization framework MELOV to address these challenges . they exploit variational autoencoder to mine shared information and generate text-based visual features . |
| Outcome: | The proposed framework is superior to existing methods on three benchmark datasets. |
BioFEG: Generate Latent Features for Biomedical Entity Linking (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to biomedical entity linking suffer from multiple types of errors due to the rarity of many biomedically relevant entities in real-world scenarios. |
| Approach: | They propose a latent feature generation framework to generate latent semantic features for unseen entities to capture fine-grained coherence information of unseened entities. |
| Outcome: | The proposed framework is superior to existing models on two benchmark datasets. |
Incorporating Object-Level Visual Context for Multimodal Fine-Grained Entity Typing (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that fine-grained entity typing is superior to text-based methods. |
| Approach: | They propose a task called fine-grained entity typing to classify entities . they propose combining textual and visual contexts to capture fine-granular semantic information . |
| Outcome: | The proposed approach achieves superior classification performance compared to previous text-based approaches. |
Improving Zero-Shot Entity Linking Candidate Generation with Ultra-Fine Entity Type Information (2022.coling-1)
Copied to clipboard
| Challenge: | Entity linking is a task of assigning entity mentions to referent entities in a knowledge base. |
| Approach: | They propose to use ultra-fine-grained type information to improve the generalization ability of EL models by utilizing a low-level task to extract ultra-finish entity type information. |
| Outcome: | The proposed model achieves state-of-the-art in the zero-shot entity linking task . |
A Span-based Multimodal Variational Autoencoder for Semi-supervised Multimodal Named Entity Recognition (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for named entity recognition on social media are not efficient for semi-supervised MNER because of the mismatch between the posted text and image. |
| Approach: | They propose a novel method to fuse the text and image features for multimodal named entity recognition under semi-supervised setting by exploiting modal-specific VAEs. |
| Outcome: | The proposed method outperforms baselines under supervised setting and improves performance with less labeled data than existing semi-supervised methods. |