Papers by John Pohovey
Characterizing the Robustness of Black-Box LLM Planners Under Perturbed Observations with Adaptive Stress Testing (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models have been used in reasoning-heavy planning tasks but their tendency to hallucinate unsafe outputs poses risks. |
| Approach: | They propose a method for searching the space of prompt perturbations using adaptive stress testing with Monte-Carlo tree search. |
| Outcome: | The proposed method can detect scenarios, sensor configurations, and prompt phrasing that cause models to act with high uncertainty or crash. |