Papers by Weiye Si

2 papers
SciPedia: Unlocking the Value of Scientific Data for Pre-training (2026.acl-long)

Copied to clipboard

Challenge: High-quality scientific data is critical for advancing LLMs, yet academic literature remains underutilized.
Approach: They construct a large-scale raw scientific corpus but identify a critical Learnability Gap . they develop a multi-stage pipeline featuring content cleaning and pedagogical augmentation .
Outcome: The proposed approach boosts average performance by +2.12 (3B) and +2.95 (7B) on in-domain tasks.
AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus on single agentic capability, failing to capture long-horizon real-world scenarios.
Approach: They propose a benchmark that evaluates 6 agentic capabilities across 32 real-world scenarios.
Outcome: Experiments show that closed-source models outperform open-source model (48.4% vs 32.1%) integrating models with advanced scaffolds to form autonomous agents is a paradigm shift.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations