Papers by Yujie Sun

7 papers
LightThinker: Thinking Step-by-Step Compression (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models have demonstrated their remarkable capabilities in complex reasoning tasks, but their efficiency is hindered by the substantial memory and computational costs associated with generating lengthy tokens.
Approach: They propose a method that dynamically compresses verbose thought steps into compact representations and discards original reasoning chains.
Outcome: The proposed method reduces peak memory usage and inference time while maintaining competitive accuracy.
FOLIO: Natural Language Reasoning with First-Order Logic (2024.emnlp-main)

Copied to clipboard

Challenge: Existing benchmarks for logical reasoning in large language models lack language naturalness or limited complexity.
Approach: They propose to use first-order logic annotations to evaluate logical reasoning capabilities of large language models.
Outcome: The proposed dataset evaluates the FOL reasoning ability of supervised fine-tuning on medium-sized language models.
ChildMandarin: A Comprehensive Mandarin Speech Dataset for Young Children Aged 3-5 (2025.acl-long)

Copied to clipboard

Challenge: Automatic speech recognition systems have advanced significantly with models like Whisper, Conformer, and self-supervised frameworks such as Wav2vec 2.0.
Approach: They propose to use Mandarin speech datasets to analyze pronunciation and tone of children aged 3 to 5 and evaluate their models on speaker verification (SV) They find that the datasets are more robust than those used by adult speech recognition systems and are open-source and available for all academic purposes.
Outcome: The proposed dataset includes 41.25 hours of speech with carefully crafted manual transcriptions, collected from 397 speakers across various provinces in China, with balanced gender representation.
ChildTalk: A Multi-Dialect Chinese Child Speech Corpus with Full-Length Child–Caregiver Conversations for Speech Recognition (2026.findings-acl)

Copied to clipboard

Challenge: Automatic speech recognition (ASR) for children remains challenging due to developmental variability and the scarcity of high-quality corpora.
Approach: They propose a large-scale Chinese child speech corpus that contains 112.5 hours of speech from 498 children and 500 caregivers.
Outcome: The proposed model improves in-domain and cross-domain performance on children's speech.
OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) and Large Multimodal Models have exceeded general human capabilities in various tasks.
Approach: They present an Olympiad-level bilingual multimodal scientific benchmark featuring 8,476 problems from Olympiad level mathematics and physics competitions.
Outcome: The best performing model, GPT-4V, attains an average score of 17.97% on OlympiadBench, with a mere 10.74% in physics, highlighting the benchmark rigor and the intricacy of physical reasoning.
Transfer Learning for Text Classification via Model Risk Analysis (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to text classification are limited by distribution drift and misprediction risk.
Approach: They propose a model risk analysis approach to adapt a pre-trained DNN model to a new dataset given only a small set of representative data.
Outcome: The proposed model performs considerably better than existing approaches on real datasets.
AEGIS: A Holistic Benchmark for Evaluating Forensic Analysis of AI-Generated Academic Images (2026.acl-long)

Copied to clipboard

Challenge: AEGIS examines whether current models can effectively audit AI-generated images in academic papers.
Approach: They propose a holistic benchmark for forensic analysis of AI-Generated academic ImageS that reveals limitations in academic image forensics.
Outcome: AEGIS compared with existing benchmarks on seven academic categories and features key advances in forensic analysis.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations