Papers by Baolin Li
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue systems perform poorly on unseen topics due to limited topics covered in training data. |
| Approach: | They propose a language model that homogenizes different knowledge sources to a unified knowledge representation for knowledge-grounded dialogue generation tasks. |
| Outcome: | The proposed language model generalizes well across knowledge-grounded dialogue tasks. |
Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent studies show that the energy requirements of current NLP models are growing at a rapid, unsustainable pace. |
| Approach: | They investigate ways to measure energy usage and different hardware settings that can be tuned to reduce energy consumption for training and inference for language models. |
| Outcome: | The proposed techniques can reduce energy consumption for training and inference for language models. |
#HowYouTagTweets: Learning User Hashtagging Preferences via Personalized Topic Attention (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods based on latent topics cannot capture user interests and thus can't be used to predict how likely a user will post with a hashtag. |
| Approach: | They propose a personalized topic attention model that captures salient contents to personalize hashtag contexts by predicting how likely a user will post with a hashtag. |
| Outcome: | The proposed model significantly outperforms the state-of-the-art recommendation approach without exploiting latent topics. |
Sprout: Green Generative AI with Carbon-Efficient LLM Inference (2024.emnlp-main)
Copied to clipboard
| Challenge: | Sprout reduces the carbon footprint of inference in large language models by over 40% in real-world evaluations. |
| Approach: | Sprout introduces "generation directives" to guide autoregressive generation process . et al. cites Llama model and global electricity grid data as examples . |
| Outcome: | Sprout reduces the carbon footprint of generative AI models by over 40% in real-world evaluations using the Llama model and global electricity grid data. |
Few-Shot Named Entity Recognition: An Empirical Baseline Study (2021.emnlp-main)
Copied to clipboard
Jiaxin Huang, Chunyuan Li, Krishan Subudhi, Damien Jose, Shobana Balakrishnan, Weizhu Chen, Baolin Peng, Jianfeng Gao, Jiawei Han
| Challenge: | Existing methods to build named entity recognition systems with limited labeled data are lacking. |
| Approach: | They propose three orthogonal schemes to build named entity recognition systems when labeled data is limited. |
| Outcome: | The proposed NER systems outperform existing methods on few-shot and training-free settings. |
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems (2021.acl-long)
Copied to clipboard
| Challenge: | Existing task-oriented dialog systems are less than satisfactory in robustness evaluation . existing systems are weak in robustity evaluation based on pre-training and fine-tuning . |
| Approach: | They propose to use a set of training examples to evaluate model generalization ability . they propose to include tasks with limited training data to favor models with strong generalization abilities . |
| Outcome: | The proposed model generalizes well with limited training data and is robust to user input across domains. |
Deep Dyna-Q: Integrating Planning for Task-Completion Dialogue Policy Learning (P18-1)
Copied to clipboard
| Challenge: | Training a task-completion dialogue agent via reinforcement learning (RL) is costly because it requires many interactions with real users. |
| Approach: | They propose a framework that integrates planning for task-completion dialogue policy learning into a dialogue agent using a world model to mimic real user response and generate simulated experience. |
| Outcome: | The proposed framework integrates planning for task-completion dialogue policy learning with real user interaction and simulated user behavior. |
Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for language understanding and understanding can be trained to provide contextualized representations of words based on text data. |
| Approach: | They propose a large-scale language VAE model Optimus that is pre-trained on large text corpus and fine-tuned for various language generation and understanding tasks. |
| Outcome: | The proposed model achieves new state-of-the-art on VAE language modeling benchmarks. |
Conversation Learner - A Machine Teaching Tool for Building Dialog Managers for Task-Oriented Dialog Systems (2020.acl-demos)
Copied to clipboard
Swadheen Shukla, Lars Liden, Shahin Shayandeh, Eslam Kamal, Jinchao Li, Matt Mazzola, Thomas Park, Baolin Peng, Jianfeng Gao
| Challenge: | a wide variety of tasks have created a need for flexible task-oriented dialog systems . dialog flows are intuitively interpretable but lack the flexibility needed to handle complex dialogs . |
| Approach: | They propose a machine teaching tool for building dialog managers using familiar tools . they convert the dialog flow into a parametric model and use user-system dialog logs as training data . |
| Outcome: | The proposed tool combines the best of both approaches to build dialog managers . it converts the dialog flow into a parametric model and improves it over time . |
Evaluating the Instruction-Following Robustness of Large Language Models to Prompt Injection (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated exceptional proficiency in instruction-following, making them increasingly integral to various applications. |
| Approach: | They establish a benchmark to evaluate the robustness of instruction-following LLMs against prompt injection attacks, assessing their ability to discern which instructions to follow and which to disregard. |
| Outcome: | The proposed model is overly sensitive to prompt injection attacks, focusing on the latter part of the prompt without fully understanding the context. |
Few-shot Natural Language Generation for Task-Oriented Dialog (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for NLG depend on heavily annotated data, which is infeasible for new domains. |
| Approach: | They propose a system that converts a dialog act into a response in natural language . they propose 'nuclear language generation' to simulate a few-shot learning setting . |
| Outcome: | The proposed model outperforms existing methods on a large set of annotated datasets. |
Self-Checker: Plug-and-Play Modules for Fact-Checking with Large Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for fact-checking text generated by large language models are expensive and time-consuming. |
| Approach: | They propose a plug-and-play framework that harnesses large language models for efficient fact-checking in a few-shot manner. |
| Outcome: | The proposed framework is compared with state-of-the-art models and shows that it can be used to speed up fact-checking in a few-shot manner. |
DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarization (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for summarizing dialogues lack in taking into account the structure of dialogues and rely heavily on labeled data. |
| Approach: | They propose a pre-trained encoder-decoder model for summarizing dialogues in any new domain. |
| Outcome: | The proposed model outperforms existing methods on six datasets and shows ROUGE scores in zero-shot and few-shot settings. |
SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Prompting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that SGP-TOD provides state-of-the-art zero-shot performance . prevailing approach for creating task bots is to fine-tune pre-trained language models . |
| Approach: | They propose a Schema-Guided Prompting for building Task-Oriented Dialog systems . they use predefined task schema and dialog policy to instruct fixed LLMs to generate appropriate responses . |
| Outcome: | The proposed system outperforms few-shot approaches on multiwoz, RADDLE, and STAR datasets. |
ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems (2020.acl-demos)
Copied to clipboard
Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
| Challenge: | ConvLab-2 inherits Convlab's framework but integrates more powerful dialogue models and supports more datasets. |
| Approach: | They present ConvLab-2, an open-source toolkit that enables researchers to build task-oriented dialogue systems with state-of-the-art models and perform an end-to-end evaluation. |
| Outcome: | The new tool inherits ConvLab's framework and extends it by integrating many recently proposed state-of-the-art dialogue models. |
Soloist: Building Task Bots at Scale with Transfer Learning and Machine Teaching (2021.tacl-1)
Copied to clipboard
| Challenge: | Existing methods for building task-oriented dialog systems are limited to a few tasks and domains. |
| Approach: | They propose a method that uses transfer learning and machine teaching to build task bots at scale. |
| Outcome: | The proposed method outperforms existing methods on well-studied task-oriented dialog benchmarks on well studied tasks. |
Guided Dialogue Policy Learning without Adversarial Learning in the Loop (2020.findings-emnlp)
Copied to clipboard
Ziming Li, Sungjin Lee, Baolin Peng, Jinchao Li, Julia Kiseleva, Maarten de Rijke, Shahin Shayandeh, Jianfeng Gao
| Challenge: | Reinforcement learning methods suffer from sparse and unstable reward signals . alternating training of dialogue agent and reward model can get stuck in local optima . |
| Approach: | They propose to decompose adversarial training into two steps to improve dialogue policy learning. |
| Outcome: | The proposed method achieves remarkable task success rate using both on-policy and off-poly reinforcement learning methods. |
ConvLab: Multi-Domain End-to-End Dialog System Platform (P19-3)
Copied to clipboard
Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Zheng Zhang, Yaoqin Zhang, Xiang Li, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
| Challenge: | ConvLab is an open-source multi-domain end-to-end dialog system platform . it allows researchers to quickly set up experiments with reusable components and compare a large set of different approaches in common environments. |
| Approach: | They propose to use an open-source multi-domain end-to-end dialog system platform to train and evaluate dialog bots in common environments. |
| Outcome: | The proposed system enables researchers to quickly set up experiments with reusable components and compare a large set of different approaches in common environments. |
Engage the Public: Poll Question Generation for Social Media Posts (2021.acl-long)
Copied to clipboard
| Challenge: | a novel application to generate poll questions for social media posts offers an easy way to hear the public's voice . for the silent majority, they tend to read others' messages instead of voicing their opinions with words . |
| Approach: | They propose to encode user comments and discover latent topics therein as contexts to generate poll questions for social media posts. |
| Outcome: | The proposed model outperforms popular models without exploiting topics from comments . human evaluations show it can generate high-quality polls useful to draw user engagements . |