Papers by Yiming Yao

6 papers
Gradient-based Intra-attention Pruning on Pre-trained Language Models (2023.acl-long)

Copied to clipboard

Challenge: Pre-trained language models are computationally expensive and slow in inference due to their large sizes.
Approach: They propose a structured pruning method which combines pruning with knowledge distillation to yield highly effective models.
Outcome: The proposed method outperforms other pruning methods in sparsity regimes while maintaining 93% 99% performance.
DeFine: Decision-Making with Analogical Reasoning over Factor Profiles (2025.findings-acl)

Copied to clipboard

Challenge: Large language models are ideal for decision-making, but they can be difficult to process when they are verbose and include repetition, hedging, and vagueness.
Approach: They propose a framework that constructs probabilistic factor profiles from complex scenarios and integrates them with analogical reasoning to guide LLMs in making decisions in new situations.
Outcome: The proposed framework separates the tasks of quantifying uncertainty and incorporating it into LLM decision-making.
EdgeFormer: Latency-Aware Collaborative Multi-Head Attention of Transformer Inference in Edge Networks (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for inference in centralized cloud pose privacy risks due to sensitive data.
Approach: They propose a latency-aware framework for distributed Transformer inference in resource-constrained edge networks.
Outcome: The proposed framework achieves 2.01 times inference acceleration over state-of-the-art baselines with leq1.06% accuracy loss, maintaining robustness under varying edge conditions.
Chart2Code53: A Large-Scale Diverse and Complex Dataset for Enhancing Chart-to-Code Generation (2025.emnlp-main)

Copied to clipboard

Challenge: Existing Chart2code-related training datasets suffer from limited scale, limited type coverage, and inadequate complexity.
Approach: They propose to synthesize chart2code-related training datasets using web plotting code and chart images to address these challenges.
Outcome: The proposed dataset exhibits the greatest diversity and higher complexity compared to other open-source Chart2code related datasets.
SynthAgent: Adapting Web Agents with Synthetic Supervision (2026.acl-long)

Copied to clipboard

Challenge: Existing studies have focused on synthetic supervision but have encountered data quality issues.
Approach: They propose a fully synthetic supervision framework that aims at improving data quality via dual refinement of both tasks and trajectories.
Outcome: The proposed framework outperforms existing methods on standardized benchmarks and shows promising results on a standardized test.
Autonomous Workflow for Multimodal Fine-Grained Training Assistants Towards Mixed Reality (2024.findings-acl)

Copied to clipboard

Challenge: a fine-grained, comprehensive understanding of multimodal environments remains under-explored.
Approach: They propose an automated workflow for integrating AI agents into extended reality (XR) they propose a cerebral language agent that integrates LLM with memory, planning, and interaction with XR tools and a vision-language agent .
Outcome: The proposed workflow integrates AI agents seamlessly into extended reality (XR) applications for fine-grained training.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations