Papers by Mengting Wan
Fine-Grained Spoiler Detection from Large-Scale Review Corpora (P19-1)
Copied to clipboard
| Challenge: | 'Spoilers' on review websites can be a concern for consumers who want to fully experience the excitement of media consumption. |
| Approach: | They propose to use a large-scale book review dataset to generate fine-grained spoiler annotations . they then use supervised neural networks to detect spoiler sentences in review corpora . |
| Outcome: | The proposed method outperforms baselines in a large-scale book review dataset . it can detect spoiler sentences in review corpora, but only a few users use it . |
Interpretable User Satisfaction Estimation for Conversational Systems with Large Language Models (2024.acl-long)
Copied to clipboard
Ying-Chun Lin, Jennifer Neville, Jack Stokes, Longqi Yang, Tara Safavi, Mengting Wan, Scott Counts, Siddharth Suri, Reid Andersen, Xiaofeng Xu, Deepak Gupta, Sujay Kumar Jauhar, Xia Song, Georg Buscher, Saurabh Tiwary, Brent Hecht, Jaime Teevan
| Challenge: | Existing approaches to user satisfaction estimation are hard to interpret and lack generalizable patterns. |
| Approach: | They propose to use supervised prompting to extract interpretable user satisfaction signals from natural language utterances to tailor an LLM to USE using labeled examples. |
| Outcome: | The proposed method extracts interpretable signals of user satisfaction from natural language utterances more effectively than embedding-based approaches. |
Group Preference Alignment: Customizing LLM Responses from In-Situ Conversations Only When Needed (2025.emnlp-industry)
Copied to clipboard
Ishani Mondal, Jack W. Stokes, Sujay Kumar Jauhar, Longqi Yang, Mengting Wan, Xiaofeng Xu, Xia Song, Jordan Lee Boyd-Graber, Jennifer Neville
| Challenge: | Existing methods for group-aware adaptation capture divergent preferences from real-world conversation logs into interpretable rubrics. |
| Approach: | They propose a group-aware personalization framework that captures context-specific preferences and steers LLMs accordingly. |
| Outcome: | The proposed framework improves group alignment without compromising perfomance on benchmarks. |
WildFeedback: Aligning LLMs With In-situ User Interactions And Feedback (2026.acl-long)
Copied to clipboard
Taiwei Shi, Zhuoer Wang, Longqi Yang, Ying-Chun Lin, Zexue He, Mengting Wan, Pei Zhou, Sujay Kumar Jauhar, Sihao Chen, Shan Xia, Hongfei Zhang, Jieyu Zhao, Xiaofeng Xu, Xia Song, Jennifer Neville
| Challenge: | Traditional alignment methods rely on human annotations and are subjective and misalignment with real-world user preferences. |
| Approach: | They propose a framework that leverages in-situ user feedback during conversations with LLMs to create preference datasets automatically. |
| Outcome: | The proposed framework identifies and classifies user feedback to LLM responses between conversation turns and creates examples of preferred and dispreferred responses according to user preferences. |
GenTool: Enhancing Tool Generalization in Language Models through Zero-to-One and Weak-to-Strong Simulation (2025.findings-acl)
Copied to clipboard
Jie He, Jennifer Neville, Mengting Wan, Longqi Yang, Hui Liu, Xiaofeng Xu, Xia Song, Jeff Z. Pan, Pei Zhou
| Challenge: | Large Language Models (LLMs) can expand their capabilities by integrating external tools. |
| Approach: | They propose a training framework that prepares LLMs for diverse generalization challenges in tool utilization. |
| Outcome: | The proposed framework improves the tool-usage capabilities of LLMs by up to 8B parameters, surpassing GPT-4o. |
Teaching Language Models To Gather Information Proactively (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models are often defaulted to passive responses or narrow clarifications when faced with incomplete or under-specified prompts. |
| Approach: | They propose a new task paradigm where LLMs must identify gaps in context and strategically elicit implicit user knowledge through targeted questions. |
| Outcome: | The proposed framework outperforms o3-mini on evaluation metrics and human annotators favor clarification questions and final outlines. |
S3-DST: Structured Open-Domain Dialogue Segmentation and State Tracking in the Era of LLMs (2024.findings-acl)
Copied to clipboard
Sarkar Snigdha Sarathi Das, Chirag Shah, Mengting Wan, Jennifer Neville, Longqi Yang, Reid Andersen, Georg Buscher, Tara Safavi
| Challenge: | Dialogue state tracking (DST) was based on narrow task-oriented conversations . however, large language models have ushered in more flexible open-domain chat systems . |
| Approach: | They propose a method that combines dialogue segmentation and state tracking within open-domain dialogues to improve long context tracking. |
| Outcome: | The proposed method outperforms the state-of-the-art on open-domain dialogue datasets and publicly available datasets. |