Papers by Christopher Clarke
One Agent To Rule Them All: Towards Multi-agent Conversational AI (2022.findings-acl)
Copied to clipboard
Christopher Clarke, Joseph Peper, Karthik Krishnamurthy, Walter Talamonti, Kevin Leach, Walter Lasecki, Yiping Kang, Lingjia Tang, Jason Mars
| Challenge: | Increasing volume of conversational agents (CAs) on the market has resulted in users being burdened with learning and adopting multiple agents to accomplish their tasks. |
| Approach: | They propose a task BBAI: Black-Box Agent Integration that integrates multiple black-box CAs at scale. |
| Outcome: | The proposed system outperforms existing benchmarks in the BBAI: Black-Box Agent Integration task. |
An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction (D19-1)
Copied to clipboard
Stefan Larson, Anish Mahendran, Joseph J. Peper, Christopher Clarke, Andrew Lee, Parker Hill, Jonathan K. Kummerfeld, Kevin Leach, Michael A. Laurenzano, Lingjia Tang, Jason Mars
| Challenge: | Task-oriented dialog systems need to know when a query falls outside their range of supported intents. |
| Approach: | They propose a dataset that includes queries that are out-of-scope and 150 intent classes over 10 domains. |
| Outcome: | The proposed dataset includes queries that are out-of-scope, i.e., queries that do not fall into any of the system’s supported intents. |
Ranking Unraveled: Recipes for LLM Rankings in Head-to-Head AI Combat (2025.acl-long)
Copied to clipboard
| Challenge: | Evaluating large language models (LLMs) is a complex task. Pairwise ranking has emerged as state-of-the-art method to evaluate human preferences. |
| Approach: | They propose to use pairwise ranking to evaluate human preferences . they propose to evaluate the robustness of ranking algorithms in LLMs . |
| Outcome: | The proposed methods are based on the principles of effective ranking and the robustness of several ranking algorithms in the context of LLMs. |
GuyLingo: The Republic of Guyana Creole Corpora (2024.naacl-short)
Copied to clipboard
| Challenge: | linguistic diversity across the globe encompasses a multitude of smaller, indigenous, and regional languages that lack the same level of computational support. |
| Approach: | They propose a corpus for advancing NLP research in the domain of Creolese in Guyana . they outline a framework for gathering and digitizing this corpus, including colloquial expressions, idioms, and regional variations in a low-resource language . |
| Outcome: | The proposed corpus includes colloquial expressions, idioms, and regional variations in a low-resource language. |
Label Agnostic Pre-training for Zero-shot Text Classification (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to text classification assume a fixed set of labels . however, in real-world applications, there exists an infinite label space for describing a given text . |
| Approach: | They propose two new methods that inject aspect-level understanding into pre-trained models at train time to improve zero-shot generalization. |
| Outcome: | The proposed methods improve zero-shot generalization on a set of challenging datasets. |
Rule By Example: Harnessing Logical Rules for Explainable Hate Speech Detection (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to content moderation are based on rule-based heuristics, but they lack the flexibility and robustness needed to moderate harmful content. |
| Approach: | They propose a novel contrastive learning approach for learning from logical rules for content moderation using only a few data examples. |
| Outcome: | The proposed approach outperforms state-of-the-art deep learning classifiers while providing more explainable predictions. |