Papers by Luoyi Fu
Enhancing Uncertainty-Based Hallucination Detection with Stronger Focus (2023.emnlp-main)
Copied to clipboard
Tianhang Zhang, Lin Qiu, Qipeng Guo, Cheng Deng, Yue Zhang, Zheng Zhang, Chenghu Zhou, Xinbing Wang, Luoyi Fu
| Challenge: | Existing methods for detecting hallucinations in LLMs rely on external knowledge for reference retrieval or require sampling multiple responses for consistency verification. |
| Approach: | They propose a reference-free, uncertainty-based method for detecting hallucinations in Large Language Models that imitates human focus in factuality checking from three aspects: focus on the most informative keywords; focus on unreliable tokens in historical context; focus of token properties such as token type and token frequency. |
| Outcome: | The proposed method achieves state-of-the-art performance across all evaluation metrics and eliminates the need for additional information. |
Is Reference Necessary in the Evaluation of NLG Systems? When and Where? (2024.naacl-long)
Copied to clipboard
| Challenge: | Despite recent advances in reference-free metrics, it has not been well understood when and where they can be used as an alternative to reference-based metrics. |
| Approach: | They propose to use reference-free metrics to evaluate NLG systems . they find they have a higher correlation with human judgment and greater sensitivity to deficiencies in language quality . |
| Outcome: | The proposed metrics exhibit higher correlation with human judgment and greater sensitivity to deficiencies in language quality. |
VisPCO: Visual Token Pruning Configuration Optimization via Budget-Aware Pareto-Frontier Learning for Vision-Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for visual token pruning rely on predefined configurations without determining whether they achieve optimal performance. |
| Approach: | They propose a framework that formulates visual token pruning as a Pareto configuration optimization problem to automatically identify optimal configurations. |
| Outcome: | The proposed framework approximates the empirical Pareto frontier obtained through grid search and generalizes well across pruning methods and VLM architectures. |
RepEval: Effective Text Evaluation with LLM Representation (2024.emnlp-main)
Copied to clipboard
Shuqian Sheng, Yi Xu, Tianhang Zhang, Zanwei Shen, Luoyi Fu, Jiaxin Ding, Lei Zhou, Xiaoying Gan, Xinbing Wang, Chenghu Zhou
| Challenge: | Traditional metrics for automatic text evaluation are tailored to specific tasks, while LLM-based evaluation metrics are costly. |
| Approach: | They propose a metric that leverages projections of LLM representations for evaluation. |
| Outcome: | The proposed metric exhibits higher correlation with human judgments than previous methods on 14 datasets. |
GR1: Reinforcement-Enhanced LLM for Geoscience Reasoning (2026.findings-acl)
Copied to clipboard
Yule Xie, Jiaxin Ding, Cheng Deng, Shiqing Gao, Junran Zhang, Sibo Zhang, Zeyuan Wang, Ke Wu, Xin Ding, Luoyi Fu, Meng Jin, Xinbing Wang
| Challenge: | Recent advances in large language models have demonstrated RL's substantial capacity to enhance multi-step reasoning beyond what supervised instruction tuning achieves. |
| Approach: | They propose a framework that converts multimodal questions into descriptive text . they propose RL-enhanced geoscience reasoning that can be fine-tuned to a text-only level . |
| Outcome: | The proposed framework improves accuracy and accuracy on multimodal questions while preserving answerability and difficulty. |
Unsupervised Graph-Text Mutual Conversion with a Unified Pretrained Language Model (2023.acl-long)
Copied to clipboard
| Challenge: | Existing unsupervised approaches for learning knowledge graphs require multiple modules and require entity information or relation type for training. |
| Approach: | They propose a method that uses a unified pretrained language model to achieve fully unsupervised graph-text mutual conversion for the first time. |
| Outcome: | The proposed method outperforms state-of-the-art methods for G2T and T2G tasks by fine-tuning only one pretrained model. |
RFBFN: A Relation-First Blank Filling Network for Joint Relational Triple Extraction (2022.acl-srw)
Copied to clipboard
| Challenge: | Existing methods for relational triple extraction ignore semantic information of relations or predict subjects and objects sequentially. |
| Approach: | They propose a relation-first blank filling network to capture semantic information of relations . they transform relations into relation templates with blanks which contain the fine-grained semantic representation of relations. |
| Outcome: | The proposed model outperforms current state-of-the-art methods on public benchmark datasets. |
Exploring and Verbalizing Academic Ideas by Concept Co-occurrence (2023.acl-long)
Copied to clipboard
| Challenge: | a new framework for academic idea inspiration is being developed for academic research assistants . number of academic publications is increasing exponentially, making it difficult for an independent researcher to understand these papers thoroughly. |
| Approach: | They propose a framework based on concept co-occurrence for academic idea inspiration . they construct evolving concept graphs according to the co-existence relationship of concepts from 20 disciplines or topics . |
| Outcome: | The proposed system can be used to explore connections between academic concepts and verbalize the new ideas. |