Papers by Xiaoyu Song

3 papers
Circuit Complexity Bounds for RoPE-based Transformer Architecture (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies provide the circuit complexity bounds to Transformer-like architectures. position embedding has emerged as a crucial technique in modern large language models.
Approach: They propose to use position embedding to improve Transformer-like architectures by analyzing their circuits and analyzing the results.
Outcome: The proposed model is able to solve canonical tasks without embedding positional information.
PLAWBENCH: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for large language models (LLMs) are coarse, single-dimensional metrics and do not explicitly assess fine-grained legal reasoning.
Approach: They propose a Practical Law Benchmark to evaluate large language models in real-world legal practice scenarios.
Outcome: The proposed model is based on 850 questions and 13 scenarios with expert-designed evaluation rubrics.
Scene Graph and Dependency Grammar Enhanced Remote Sensing Change Caption Network (SGD-RSCCN) (2025.coling-main)

Copied to clipboard

Challenge: Remote sensing images are used for disaster assessment, urban planning and disaster response.
Approach: They propose a Scene Graph and Dependency Grammar Enhanced Remote Sensing Change Caption Network to improve the accuracy and naturalness of extracting and describing change information from remote sensing images.
Outcome: The proposed method improves the naturalness and accuracy of extracting and describing change information from remote sensing images.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations