Prototypical Human-AI Collaboration Behaviors from LLM-Assisted Writing in the Wild (2025.emnlp-main)
Copied to clipboard
| Challenge: | Rather than passively accepting output, users actively refine, explore, and co-construct text. |
| Approach: | They conduct a large scale analysis of user-LLM collaboration behavior with two popular AI assistants, Bing Copilot and WildChat. |
| Outcome: | The proposed models show that a small group of prototypical human AI collaboration behaviors explain a majority of the variation seen in user-LLM interaction. |
Similar Papers
Real or Robotic? Assessing Whether LLMs Accurately Simulate Qualities of Human Responses in Human-LLM Dialogue (2026.findings-acl)
Copied to clipboard
Jonathan Ivey, Shivani Kumar, Jiayu Liu, Hua Shen, Sushrita Rakshit, Rohan Raju, Haotian Zhang, Aparna Ananthasubramaniam, Junghwan Kim, Bowen Yi, Dustin Wright, Abraham Israeli, Anders Giovanni Møller, Lechen Zhang, David Jurgens
| Challenge: | Recent work has sought to use large language models to simulate human-human and human-LLM interactions. |
| Approach: | They use a large-scale dataset to generate a paired LLM-LLM and human-LLm dialogues from the WildChat dataset and quantify how well they align with their human counterparts. |
| Outcome: | The proposed models perform similarly in simulating English, Chinese, and Russian dialogues. |
LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey (2026.findings-acl)
Copied to clipboard
Henry Peng Zou, Wei-Chieh Huang, Yaozu Wu, Jizhou Guo, Yankai Chen, Chunyu Miao, Hoang H Nguyen, Yue Zhou, Weizhi Zhang, Liancheng Fang, Hanrong Zhang, Fangxin Wang, Pengfei Zhang, Langzhou He, Yangning Li, Dongyuan Li, Renhe Jiang, Philip S. Yu
| Challenge: | Recent advances in large language models (LLMs) have sparked growing interest in building fully autonomous agents. |
| Approach: | They propose to integrate human-provided information, feedback, or control into the agent system to enhance system performance, reliability, and safety. |
| Outcome: | The proposed systems improve system performance, reliability, and safety by integrating human-provided information, feedback, or control into the agent system. |
Human-AI Interaction in the Age of LLMs (2024.naacl-tutorials)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have revolutionized the capabilities of AI systems. |
| Approach: | This tutorial will provide an overview of the interaction between humans and Large Language Models (LLMs) it will start with a review of the types of AI models we interact with and walkthrough of the core concepts in Human-AI Interaction. |
| Outcome: | This tutorial will provide an overview of the interaction between humans and LLMs, exploring the challenges, opportunities, and ethical considerations that arise in this dynamic landscape. |
Shall We Team Up: Exploring Spontaneous Cooperation of Competing LLM Agents (2024.findings-emnlp)
Copied to clipboard
Zengqing Wu, Run Peng, Shuyuan Zheng, Qianying Liu, Xu Han, Brian Kwon, Makoto Onizuka, Shaojie Tang, Chuan Xiao
| Challenge: | Large Language Models (LLMs) are increasingly used in social simulations, where they are guided by carefully crafted instructions to exhibit human-like behaviors. |
| Approach: | They propose to use Large Language Models (LLMs) as agents to simulate the gradual transition from non-cooperative to cooperative behaviors of agents. |
| Outcome: | The proposed model can simulate the gradual transition from non-cooperative to cooperative behaviors in three competitive scenarios. |
Human Alignment: How Much Do We Adapt to LLMs? (2025.acl-short)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are becoming a common part of our lives, yet few studies have examined how they influence our behavior. |
| Approach: | They propose a cooperative language game in which players aim to converge on a word and play a game in a group. |
| Outcome: | The proposed game shows that humans notice and adapt to differences regardless of whether they are aware they are interacting with an LLM. |
Catch Me If You Can? Not Yet: LLMs Still Struggle to Imitate the Implicit Writing Styles of Everyday Authors (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Personal style is often subtle and implicit, making it difficult to specify through prompts yet essential for user-aligned generation. |
| Approach: | They evaluate LLMs' ability to imitate personal writing styles via in-context learning from user-authored samples. |
| Outcome: | The proposed model can imitate personal writing styles from a small number of user-authored samples. |
The LLM Effect: Are Humans Truly Using LLMs, or Are They Being Influenced By Them Instead? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models have shown capabilities close to human performance in various analytical tasks. |
| Approach: | They investigate the efficiency and accuracy of Large Language Models in specialized tasks . they integrate LLMs with expert annotators to observe the impact of LLM suggestions . |
| Outcome: | The proposed model improves task completion speed but introduces anchoring bias . the proposed model is not suitable for open-ended analysis, but is capable of handling specialized tasks. |
How to Enable Effective Cooperation Between Humans and NLP Models: A Survey of Principles, Formalizations, and Beyond (2025.acl-long)
Copied to clipboard
| Challenge: | Using large language models, intelligent models have evolved into autonomous agents . this paradigm has yielded remarkable progress in numerous NLP tasks in recent years . |
| Approach: | They present a review of human-model cooperation, exploring its principles, formalizations, and open challenges. |
| Outcome: | The proposed model-model cooperation paradigm has been a key focus of recent research . it is a novel paradigm that can be applied to a variety of tasks . |
WildFeedback: Aligning LLMs With In-situ User Interactions And Feedback (2026.acl-long)
Copied to clipboard
Taiwei Shi, Zhuoer Wang, Longqi Yang, Ying-Chun Lin, Zexue He, Mengting Wan, Pei Zhou, Sujay Kumar Jauhar, Sihao Chen, Shan Xia, Hongfei Zhang, Jieyu Zhao, Xiaofeng Xu, Xia Song, Jennifer Neville
| Challenge: | Traditional alignment methods rely on human annotations and are subjective and misalignment with real-world user preferences. |
| Approach: | They propose a framework that leverages in-situ user feedback during conversations with LLMs to create preference datasets automatically. |
| Outcome: | The proposed framework identifies and classifies user feedback to LLM responses between conversation turns and creates examples of preferred and dispreferred responses according to user preferences. |
Navigating Rifts in Human-LLM Grounding: Study and Benchmark (2025.acl-long)
Copied to clipboard
| Challenge: | Language models excel at following instructions but struggle with collaborative aspects of conversation that humans naturally employ. |
| Approach: | They analyze logs from WildChat, MultiWOZ, and Bing Chat to examine grounding challenges . they propose a benchmark to determine when LLMs fail to initiate grounding . |
| Outcome: | The proposed model predicts interactions that fail to ground with users . the proposed model is based on human-human interactions with humans . |