Papers by Junhao Huang

10 papers
Lil: Less is Less When Applying Post-Training Sparse-Attention Algorithms in Long-Decode Stage (2026.findings-acl)

Copied to clipboard

Challenge: Prior work typically decomposes inference into prefill and decode stages, with the decode stage dominating total latency.
Approach: They propose an algorithm that detects threshold where information loss exceeds information gain during sparse decoding to reduce token consumption by up to 90% and a marginal accuracy degradation of less than 2%.
Outcome: The proposed algorithm reduces token consumption by 90% with a marginal accuracy degradation of less than 2% across reasoning-intensive benchmarks.
Skeleton-Guided-Translation: A Benchmarking Framework for Code Repository Translation with Fine-Grained Quality Evaluation (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing code translation benchmarks focus on individual functions, overlooking repository-level challenges like intermodule coherence and dependency management.
Approach: They propose a framework for benchmarking Java-to-C# translation at the repository level . it uses a translation framework guided by skeletons and fine-grained quality evaluation .
Outcome: The proposed framework improves Java-to-C# translation quality at the repository level.
DI-BENCH: Benchmarking Large Language Models on Dependency Inference with Testable Repositories at Scale (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies highlight that dependency-related issues cause over 40% of observed runtime errors on the generated repository.
Approach: They propose a large-scale benchmark and evaluation framework specifically designed to assess LLMs’ capability on dependency inference.
Outcome: The proposed model achieves only a 48% execution pass rate on Python, indicating room for improvement.
SongComposer: A Large Language Model for Lyric and Melody Generation in Song Composition (2025.acl-long)

Copied to clipboard

Challenge: Creating lyrics and melodies in symbolic format requires expert knowledge of melody and an advanced understanding of lyrics.
Approach: They introduce SongComposer, a music-specialized large language model that can create symbolic lyrics and melodies following instructions.
Outcome: The proposed model outperforms existing models in symbolic song composition tasks.
How to Set the Learning Rate for Large-Scale Pre-training? (2026.findings-acl)

Copied to clipboard

Challenge: Optimal configuration of the learning rate (LR) is a fundamental yet formidable challenge in large-scale pre-training.
Approach: They propose a Fitting Paradigm and a Transfer Paradigme to investigate fit and transfer . they propose scalability and elucidate the reasons why module-wise parameter tuning underperforms .
Outcome: The proposed model reduces the search complexity by reducing the search cost by lowering the search factor.
TestAgent: An Adaptive and Intelligent Expert for Human Assessment (2025.findings-acl)

Copied to clipboard

Challenge: Existing adaptive testing methods face several challenges due to mechanized nature of most algorithms and noisy response data.
Approach: They propose to use large language models to enhance adaptive testing through interactive engagement to capture test-takers’ responses and anomalies.
Outcome: The proposed agent achieves more accurate results with 20% fewer questions than state-of-the-art baselines and testers preferred it in speed, smoothness, and other dimensions.
RaaS: Reasoning-Aware Attention Sparsity for Efficient LLM Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated strong capabilities across various domains, but their large-scale deployment faces a major obstacle: the high computational cost of long-sequence inference.
Approach: They propose an algorithm that retains key-value vectors until they are no longer needed to solve reasoning tasks.
Outcome: The proposed algorithm achieves high accuracy with O(L) time but O(N) memory complexities.
SLAM: Towards Efficient Multilingual Reasoning via Selective Language Alignment (2025.coling-main)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated significant improvements in reasoning abilities, but these improvements are primarily focused on English, leading to inferior performance in non-English scenarios.
Approach: They propose a multilingual reasoning alignment approach that fine-tunes the layers responsible for multilingual comprehension in one stage.
Outcome: The proposed method fine-tunes 6 of the 9 layers responsible for multilingual comprehension, while reducing training time by 4.1-11.9 compared to the two-stage method.
One-Shot Learning as Instruction Data Prospector for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Contemporary practices in instruction tuning often hinge on enlarging data scaling without a clear strategy for ensuring data quality.
Approach: They propose a method that leverages one-shot learning to discern and select high-quality instruction data from extensive datasets.
Outcome: Nuggets outperforms existing methods on MT-Bench and Alpaca-Eval benchmarks.
OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) and Large Multimodal Models have exceeded general human capabilities in various tasks.
Approach: They present an Olympiad-level bilingual multimodal scientific benchmark featuring 8,476 problems from Olympiad level mathematics and physics competitions.
Outcome: The best performing model, GPT-4V, attains an average score of 17.97% on OlympiadBench, with a mere 10.74% in physics, highlighting the benchmark rigor and the intricacy of physical reasoning.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations