Papers by Jaekyeom Kim
Auto-Intent: Automated Intent Discovery and Self-Exploration for Large Language Model Web Agents (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing work to improve LLMs' planning and reasoning capabilities has shown that they have strong priors to reason about intermediate subgoals, but their accuracy is limited especially in complex environments such as web navigation. |
| Approach: | They propose a method to adapt a pre-trained large language model (LLM) as an agent for a target domain without direct fine-tuning by extracting intents from target domain demonstrations in a highly compact form. |
| Outcome: | The proposed method significantly improves the performance of GPT-3.5, 4 and Llama-3.1-70B, 405B agents on large-scale real-website navigation benchmarks from Mind2Web and online navigation tasks with its cross-benchmark generalization from Mind2. |
Beyond Blind Following: Evaluating Robustness of LLM Agents under Imperfect Guidance (2026.eacl-long)
Copied to clipboard
Yao Fu, Ran Qiu, Xinhe Wang, Jacob Sansom, Sathvika Ayyappa Prabhu, Huijie Tang, Jaekyeom Kim, Sungryull Sohn, Honglak Lee
| Challenge: | Large language models (LLMs) have shown strong capabilities as task-solving agents across interactive domains, but in complex environments, auxiliary guidance may be imperfect. |
| Approach: | They propose a benchmark to measure the robustness of large language models under imperfect guidance. |
| Outcome: | The proposed benchmark compared LLM agents in navigation, cooking, and gaming in a variety of environments with auxiliary guidance and noisy or underspecified instructions extracted from demonstrations. |
Interactive and Expressive Code-Augmented Planning with Large Language Models (2025.acl-long)
Copied to clipboard
Anthony Zhe Liu, Xinhe Wang, Jacob Sansom, Yao Fu, Jongwook Choi, Sungryull Sohn, Jaekyeom Kim, Honglak Lee
| Challenge: | Large Language Models (LLMs) have strong abilities in common-sense reasoning and interactive decision-making, but struggle with complex, long-horizon planning tasks. |
| Approach: | They propose a code-based LLM planning approach that is code-expressive while also dynamically adapting from errors. |
| Outcome: | The proposed approach can be error-prone and insufficient for handling ambiguous or unstructured data. |
Small Language Models Need Strong Verifiers to Self-Correct Reasoning (2024.findings-acl)
Copied to clipboard
Yunxiang Zhang, Muhammad Khalifa, Lajanugen Logeswaran, Jaekyeom Kim, Moontae Lee, Honglak Lee, Lu Wang
| Challenge: | Existing studies show that large language models can self-correct their outputs by generating a critique and revising it based on the critique. |
| Approach: | They propose a pipeline that prompts small language models to collect self-correction data that supports the training of self-refinement abilities. |
| Outcome: | The proposed pipeline improves the self-correction abilities of two models on five datasets spanning math and commonsense reasoning. |