Papers by Helen Meng
Partner Personas Generation for Dialogue Response Generation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing frameworks that focus on self personas ignore the value of partner persona . experimental results show that our framework generates relevant, interesting, coherent and informative partner personages even compared to ground truth partner personagers. |
| Approach: | They propose a framework that leverages automatic partner personas generation to enhance dialogue response generation. |
| Outcome: | The proposed framework generates relevant, interesting, coherent and informative partner personas even compared to ground truth partner person . it surpasses baselines that condition on ground truth persona . |
Rethinking Machine Ethics – Can LLMs Perform Moral Reasoning through the Lens of Moral Theories? (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to making moral judgments are mostly bottom-up and lack explainability. |
| Approach: | They propose a top-down framework to steer Large Language Models to perform moral reasoning with well-established moral theories. |
| Outcome: | The proposed framework can integrate various moral theories on moral datasets. |
Unsupervised Multi-scale Expressive Speaking Style Modeling with Hierarchical Context Information for Audiobook Speech Synthesis (2022.coling-1)
Copied to clipboard
| Challenge: | a recent study has shown that expressiveness of audiobooks is limited by the averaged global-scale speaking style representation. |
| Approach: | They propose an unsupervised multi-scale context-sensitive text-to-speech model for audiobooks . they use hierarchical context encoder to predict global-scale contextual style embeddings . |
| Outcome: | The proposed model outperforms existing models on a real-world Mandarin audio dataset. |
Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-Evaluation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to addressing factual inaccuracies require high-quality human factuality annotations to mitigate these hallucinations. |
| Approach: | They propose to leverage the self-evaluation capability of an LLM to provide training signals that steer the model towards factuality. |
| Outcome: | The proposed approach significantly improves factual accuracy over LLMs across three key knowledge-intensive tasks on TruthfulQA and BioGEN. |
Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to incorporate retriever’s preference during the training of query rewriting models rely on extensive annotations such as in-domain rewrites and/or relevant passage labels, limiting their generalization and adaptation capabilities. |
| Approach: | They propose a framework for training query rewriting models with limited rewrite annotations from seed datasets and completely no passage label. |
| Outcome: | The proposed approach decontexualizes conversational queries into self-contained questions suitable for off-the-shelf retrievers. |
Search Augmented Instruction Learning (2023.findings-emnlp)
Copied to clipboard
Hongyin Luo, Tianhua Zhang, Yung-Sung Chuang, Yuan Gong, Yoon Kim, Xixin Wu, Helen Meng, James Glass
| Challenge: | Large language models (LLMs) have been significantly improved by instruction fine-tuning, but still lack transparency and the ability to utilize up-to-date knowledge and information. |
| Approach: | They propose a search-augmented instruction learning model which grounds the language generation and instruction following abilities on complex search results generated by in-house and external search engines. |
| Outcome: | The proposed model outperforms plain LLMs on zero-shot language tasks and can generate both natural and programming languages following natural language guidance and requests. |
Improving Large Language Models Function Calling and Interpretability via Guided-Structured Templates (2025.emnlp-main)
Copied to clipboard
Hy Dang, Tianyi Liu, Zhuofeng Wu, Jingfeng Yang, Haoming Jiang, Tao Yang, Pei Chen, Zhengyang Wang, Helen Wang, Huasheng Li, Bing Yin, Meng Jiang
| Challenge: | Large language models (LLMs) have strong reasoning and tool-use capabilities, yet fail in real-world tool-interactions due to incorrect parameterization, poor tool selection, or misinterpretation of user intent. |
| Approach: | They propose a curriculum-inspired framework that leverages structured reasoning templates to guide LLMs through more deliberate step-by-step instructions for generating function calls. |
| Outcome: | The proposed framework reduces tool-use errors and improves interpretability and transparency of tool-using agents. |
Natural Language Embedded Programs for Hybrid Language Symbolic Reasoning (2024.findings-naacl)
Copied to clipboard
Tianhua Zhang, Jiaxin Ge, Hongyin Luo, Yung-Sung Chuang, Mingye Gao, Yuan Gong, Yoon Kim, Xixin Wu, Helen Meng, James Glass
| Challenge: | Existing methods for surfacing symbolic reasoning capabilities are limited to narrow tasks . arithmetic computations are unnatural to perform in pure language space, and hence present difficulties for LLMs. |
| Approach: | They propose a natural language embedded program framework for solving symbolic reasoning tasks. |
| Outcome: | The proposed framework improves on strong baselines across math and symbolic reasoning, text classification, question answering, and instruction following tasks. |
On Controlling Fallback Responses for Grounded Dialogue Generation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge grounded dialogue frameworks assume that the user intention is always answerable. |
| Approach: | They propose a framework that automatically generates a control token with the generator to bias the succeeding response towards informativeness for answerable contexts and fallback for unanswerable context. |
| Outcome: | The proposed framework incorporates fallback responses to respond to unanswerable contexts in an informative manner while retaining informativeness for answerable context. |
SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Prompting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that SGP-TOD provides state-of-the-art zero-shot performance . prevailing approach for creating task bots is to fine-tune pre-trained language models . |
| Approach: | They propose a Schema-Guided Prompting for building Task-Oriented Dialog systems . they use predefined task schema and dialog policy to instruct fixed LLMs to generate appropriate responses . |
| Outcome: | The proposed system outperforms few-shot approaches on multiwoz, RADDLE, and STAR datasets. |
Towards Identifying Social Bias in Dialog Systems: Framework, Dataset, and Benchmark (2022.findings-emnlp)
Copied to clipboard
Jingyan Zhou, Jiawen Deng, Fei Mi, Yitong Li, Yasheng Wang, Minlie Huang, Xin Jiang, Qun Liu, Helen Meng
| Challenge: | a number of safety concerns hinder the deployment of open-domain dialog systems, such as offensive languages and toxic behaviors, such social bias is difficult to detect. |
| Approach: | They propose a Dial-Bias Framework for analyzing social bias in conversations . they introduce a Chinese social bias dialog dataset and conduct in-depth ablation studies . |
| Outcome: | The proposed framework is the first annotated Chinese social bias dialog dataset . the proposed framework also provides a fine-grained dialog bias measurement benchmark . |
COLD: A Benchmark for Chinese Offensive Language Detection (2022.emnlp-main)
Copied to clipboard
| Challenge: | Offensive language detection is crucial for maintaining a civilized social media platform and deploying pre-trained language models. |
| Approach: | They propose a benchmark benchmark for Chinese offensive language analysis including a Chinese Offensive Language Dataset and a baseline detector which is trained on the dataset. |
| Outcome: | The proposed benchmark contributes to Chinese offensive language detection which is challenging for existing resources. |