Papers by Yuanhao Shen
SMARTCAL: An Approach to Self-Aware Tool-Use Evaluation and Calibration (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have a profound impact on a wide range of applications. |
| Approach: | They propose a framework to mitigate the tool-abuse behavior of Large Language Models and propose SMARTCAL to mitigate this issue. |
| Outcome: | The proposed framework improves the performance of LLMs on three datasets with two mainstream tool-use frameworks and shows an 8.6% increase in QA performance and 21.6 percent lower expected calibration error (ECE) than existing methods. |
Reasoning Fails Where Step Flow Breaks (2026.acl-long)
Copied to clipboard
| Challenge: | Existing analysis tools struggle with long chain of thought traces. |
| Approach: | They propose a saliency-inspired test-time intervention that adjusts shallow saliencies to improve accuracy on math, science, and coding tasks. |
| Outcome: | The proposed model improves accuracy on math, science, and coding tasks without retraining. |