Papers by Yilin Xiao

11 papers
Each graph is a new language: Graph Learning with LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Natural language is used to describe graphs, but graph descriptions become verbose and only relying on attribute embeddings limits LLM’s ability to capture adequate graph structural information.
Approach: They propose a graph-defined language for large language model that translates the graph into a corpus instead of graph descriptions and pre-trains LLMs on this corpus to adequately understand the graph.
Outcome: Experiments on five datasets show that the proposed framework outperforms description-based and embedding-based baselines by efficiently modeling different orders of neighbors.
FinMaster: A Holistic Benchmark for Full-Pipeline Financial Management with Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks lack domain-specific data, realistic workflow-level task design, and standardized workflow- level evaluation.
Approach: a new benchmark evaluates large language models on financial management workflows . the global financial services market is projected to grow to $37 trillion by 2027 .
Outcome: a new benchmark for large language models on financial management workflows reveals critical capability gaps . accuracy drops from 90% on basic tasks to 40% on complex scenarios requiring multi-step reasoning . the global financial services market reached $25.8 trillion in 2022 and is projected to grow to $37 trillion by 2027 .
Efficient Many-Shot In-Context Learning with Dynamic Block-Sparse Attention (2025.acl-long)

Copied to clipboard

Challenge: Many-shot in-context learning shifts computational burden from training-time to inference-time, making deployment of many-shot ICL challenging to justify in-practice.
Approach: They propose a method for retrieval-based many-shot in-context learning that uses blocks-sparse attention and retrieval of cached demonstrations to achieve comparable per-example latency to finetuning.
Outcome: The proposed method achieves comparable per-example latency to finetuning while maintaining on average >95% of the best method’s accuracy across strong ICL and finetuned baselines.
Language-Specific Layer Matters: Efficient Multilingual Enhancement for Large Vision-Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Large vision-language models exhibit an imbalance in multilingual capabilities .
Approach: They propose a training recipe that achieves efficient multilingual enhancement for LVLMs by Precise Language Specific layers fine-tuning.
Outcome: The proposed training recipe achieves efficient multilingual enhancement for LVLMs by fine-tuning language specific layers.
UCFE: A User-Centric Financial Expertise Benchmark for Large Language Models (2025.findings-naacl)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have expanded their potential applications in finance.
Approach: They propose a framework to evaluate the ability of large language models to handle financial tasks using human expert evaluations and task-specific interactions.
Outcome: The proposed framework evaluates the ability of large language models to handle complex financial tasks and combines human expert evaluations with dynamic, task-specific interactions to simulate the complexities of evolving financial scenarios.
Collision to Cognition: Hash-Driven Graph Construction for Efficient RAG (2026.acl-long)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) has been used for enhancing large language models with external knowledge.
Approach: They propose a framework for mining efficient graph structures via hashing to enhance RAG . they adopt an inductive paradigm where global graph structure emerges from local hash collisions .
Outcome: The proposed framework outperforms existing baselines while requiring no GPU resources or token budget.
Dynamic Low-rank Estimation for Transformer-based Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: RankDyna is a matrix decomposition method that can be used to compress Transformer-based language models.
Approach: They propose a matrix decomposition method that enables dynamic rank resource allocation . they say it can outperform current SOTA methods under various parameter budget levels .
Outcome: The proposed method outperforms current SOTA methods under various budget levels . the proposed method is more efficient with higher compression rates .
LogicPoison: Logical Attacks on Graph Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Graph-based Retrieval-Augmented Generation (GraphRAG) enhances the reasoning capabilities of Large Language Models (LLMs) however, traditional RAG attacks are difficult to pose an effective threat to GraphRAg systems.
Approach: They propose a novel attack framework that targets logical reasoning rather than injecting false contents into GraphRAG systems by grounding their responses in structured knowledge graphs.
Outcome: The proposed framework outperforms state-of-the-art attacks on GraphRAG systems in both effectiveness and stealth.
Query-Aware Knowledge Retrieval via Hyperbolic Structuring (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches focus primarily on retrieving isolated factual knowledge entities while neglecting the critical reasoning relationships.
Approach: They propose a query-centric retrieval framework that explicitly integrates structured knowledge graphs to support complex reasoning tasks.
Outcome: Extensive experiments on three benchmark datasets show that HyperRAG outperforms baselines.
FaithfulRAG: Fact-Level Conflict Modeling for Context-Faithful Retrieval-Augmented Generation (2025.acl-long)

Copied to clipboard

Challenge: Existing faithful RAG approaches enforce strict context adherence, but they forcibly suppress the model’s parametric knowledge, which undermines the model's internal knowledge structure and increases the risk of misinterpreting the context.
Approach: They propose a framework that resolves knowledge conflicts by explicitly modeling discrepancies between the model’s parametric knowledge and retrieved context.
Outcome: The proposed framework outperforms state-of-the-art methods in knowledge conflict cases and identifies conflicting knowledge at the fact level and designs a self-thinking process.
LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for enhancing multi-step reasoning have not fully translated to multilingual contexts.
Approach: They propose a framework that leverages language-conditioned hints to guide exploration in non-English reasoning tasks.
Outcome: Empirical results show that the proposed framework improves reasoning performance without compromising language consistency.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations