Papers by Youzheng Wu
The JDDC Corpus: A Large-Scale Multi-Turn Chinese Dialogue Dataset for E-commerce Customer Service (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing datasets for human-like dialogue tasks are deficient due to the complexity of human conversations. |
| Approach: | They construct a large-scale Chinese E-commerce conversation corpus with 1 million dialogues, 20 million utterances, and 150 million words. |
| Outcome: | The proposed dataset includes 1 million multi-turn dialogues, 20 million utterances, and 150 million words. |
SGG: Learning to Select, Guide, and Generate for Keyphrase Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing keyphrase generation approaches synchronously generate present and absent keyphrases without explicitly distinguishing these two categories. |
| Approach: | They propose to deal with present and absent keyphrases separately with different mechanisms by using a hierarchical neural network with a pointing-based selector and a selection-guided generator. |
| Outcome: | The proposed model outperforms baselines on four keyphrase generation tasks and shows extensibility in natural language generation tasks. |
Enhancing Automated Essay Scoring Performance via Fine-tuning Pre-trained Language Models with Combination of Regression and Ranking (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work on sentence prediction tasks uses shallow neural networks to learn essay representations and constrain calculated scores with regression loss or ranking loss. |
| Approach: | They propose to use a pre-trained language model to learn text representations first and then to constrain the scores with regression loss or ranking loss. |
| Outcome: | The proposed model outperforms state-of-the-art models on the Automated Student Assessment Prize dataset. |
JDDC 2.1: A Multimodal Chinese Dialogue Dataset with Joint Tasks of Query Rewriting, Response Generation, Discourse Parsing, and Summarization (2022.emnlp-main)
Copied to clipboard
| Challenge: | e-commerce users express their needs using text, images, or videos . but detailed information provided by images is limited, and customer service systems cannot understand the intent of users without the input text. |
| Approach: | They construct a large-scale multimodal multi-turn dialogue dataset from a mainstream Chinese E-commerce platform . the dataset contains about 246K dialogue sessions, 3M utterances, and 507K images . |
| Outcome: | The proposed dataset contains 246K dialogue sessions, 3M utterances, 507K images . it also includes product knowledge bases and image category annotations . |
UniRPG: Unified Discrete Reasoning over Table and Text as Program Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for question answering using knowledge resources are mixed-of-experts and semantic parsing-based. |
| Approach: | They propose a semantic-parsing-based approach to perform Unified discrete Reasoning over heterogeneous knowledge resources as Program Generation. |
| Outcome: | The proposed approach improves interpretability and scalability over table and text . it achieves promising performance on the TAT-QA dataset without annotation . |
AUGUST: an Automatic Generation Understudy for Synthesizing Conversational Recommendation Datasets (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work on conversational recommendation systems lacks high-quality data . existing datasets lack large-scale and high-level data based on human annotators . |
| Approach: | They propose an automatic dataset synthesis approach that generates large-scale recommendation dialogues using structured graphs based on user-item information from the real world. |
| Outcome: | The proposed approach can generate large-scale and high-quality recommendation dialogues . it exploits user preferences, knowledge graphs, and conversation ability from existing datasets based on real-world data . |
Mars: Modeling Context & State Representations with Contrastive Learning for End-to-End Task-Oriented Dialog (2023.findings-acl)
Copied to clipboard
| Challenge: | Empirical results show dialog context representations are more conducive to multi-turn task-oriented dialog. |
| Approach: | They propose an end-to-end task-oriented dialog system with two contrastive learning strategies to model relationship between dialog context and belief/action state representations. |
| Outcome: | Empirical results show that dialog context representations are more conducive to multi-turn task-oriented dialog. |
Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT (2022.acl-long)
Copied to clipboard
| Challenge: | Transformer-based pre-trained models achieve state-of-the-art results, but they can be prohibitively costly. |
| Approach: | They propose a fine- and coarse-granularity hybrid self-attention that shortens the computational sequence length in self- attention by progressively shortening the computational time. |
| Outcome: | The proposed model reduces computation cost by shortening the computational sequence length in self-attention. |
K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing pre-trained language models are not explicitly aware of domain-specific knowledge, which is essential for downstream tasks in many domains, such as tasks in e-commerce scenarios. |
| Approach: | They propose a knowledge-injected pre-trained language model that can be transferred to both natural language understanding and generation tasks. |
| Outcome: | The proposed model significantly outperforms baselines across the board in e-commerce scenarios. |
Learning to Decouple Relations: Few-Shot Relation Classification with Entity-Guided Attention and Confusion-Aware Training (2020.coling-main)
Copied to clipboard
| Challenge: | Existing few-shot relation classifiers struggle to distinguish them with few annotated instances due to high co-occurrence of some relations . |
| Approach: | They propose a few-shot relation classification model with two mechanisms to decouple easily-confused relations. |
| Outcome: | The proposed model achieves comparable and even better results to strong baselines in terms of accuracy. |
BORT: Back and Denoising Reconstruction for End-to-End Task-Oriented Dialog (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing task-oriented dialog systems suffer from error propagation from inaccurate dialog states and responses. |
| Approach: | They propose a back reconstruction approach for end-to-end task-oriented dialog system . they use back reconstruction to reconstruct the original input context from the generated dialog states . |
| Outcome: | Extensive experiments on MultiWOZ 2.0 and CamRest676 show the effectiveness of the proposed model. |
MuGER2: Multi-Granularity Evidence Retrieval and Reasoning for Hybrid Question Answering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Conventional HQA models retrieve coarse- or fine-grained evidence to reason the answer . however, they neglect a more general scenario requiring reasoning over heterogeneous data to answer a question. |
| Approach: | They propose a multi-granularity evidence retrieval and reasoning approach to answer questions over heterogeneous data using tables and passages linked to table cells. |
| Outcome: | The proposed approach significantly boosts the performance on the HybridQA dataset. |
Self-Attention Guided Copy Mechanism for Abstractive Summarization (2020.acl-main)
Copied to clipboard
| Challenge: | Abstractive summarization models have been widely used to extract words from source into summary, but how to ensure that important words in source are copied remains a challenge. |
| Approach: | They propose a Transformer-based model to enhance copy mechanism by identifying the importance of each source word based on the degree centrality. |
| Outcome: | The proposed model outperforms baseline methods on CNN/Daily Mail and Gigaword datasets. |
PRINCE: Prefix-Masked Decoding for Knowledge Enhanced Sequence-to-Sequence Pre-Training (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies focus on injecting noises into the input sequence, but feasibility of injecting them into the decoding sequence remains an open question. |
| Approach: | They propose a pre-training paradigm that integrates knowledge-enhanced decoding with noises in the prefix to strengthen the representation learning of entities that span over multiple input tokens. |
| Outcome: | The proposed model achieves state-of-the-art results on two knowledge-driven data-to-text generation tasks with up to 2% BLEU gains. |
MoNET: Tackle State Momentum via Noise-Enhanced Training for Dialogue State Tracking (2023.findings-acl)
Copied to clipboard
| Challenge: | Experimental results show that MoNET outperforms previous DST methods in alleviating state momentum issues and improving the anti-noise ability. |
| Approach: | They propose to use previous state of each turn in training data as input to learn to predict current state. |
| Outcome: | The proposed model outperforms existing methods on multiWOZ datasets and shows that it can update and correct slot values and improve anti-noise ability. |
On the Faithfulness for E-commerce Product Summarization (2020.coling-main)
Copied to clipboard
| Challenge: | e-commerce product summarization requires consistency between product attributes and summary . inconsistent product summaries can mislead users and decrease public credibility . |
| Approach: | They propose a model to generate e-commerce product summaries with product attributes . they encode product attribute table and constrain attribute words to be presented only through copying . |
| Outcome: | The proposed model significantly improves the faithfulness of e-commerce product summarization tasks. |
Comet: Dialog Context Fusion Mechanism for End-to-End Task-Oriented Dialog with Multi-task Learning (2025.coling-main)
Copied to clipboard
| Challenge: | Existing end-to-end task-oriented dialog systems often encounter challenges arising from implicit information, coreference, and the presence of noisy and irrelevant data within the dialog context. |
| Approach: | They propose a dialog context fusion mechanism for end-to-end task-oriented dialog augmented with three additional tasks: dialog summarization, domain prediction, and slot detection. |
| Outcome: | The proposed method achieves state-of-the-art on the MultiWOZ and CrossWOZ datasets. |
RoR: Read-over-Read for Long Document Machine Reading Comprehension (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for machine reading comprehension are limited to individual chunks due to encoding length constraint. |
| Approach: | They propose a read-over-read method that expands the reading field from chunk to document by predicting regional answers for each chunk. |
| Outcome: | Extensive experiments on QuAC and TriviaQA show that the proposed model performs well for long document reading. |
Multimodal Joint Attribute Prediction and Value Extraction for E-commerce Product (2020.emnlp-main)
Copied to clipboard
| Challenge: | In the real world, product attribute values are incomplete and vary over time, which hinders practical applications. |
| Approach: | They propose a multimodal method to jointly predict product attributes and extract values from product images using multimodal product information. |
| Outcome: | The proposed method can predict product attributes and extract values from product images with the help of product images. |
OPERA: Operation-Pivoted Discrete Reasoning over Text (2022.naacl-main)
Copied to clipboard
Yongwei Zhou, Junwei Bao, Chaoqun Duan, Haipeng Sun, Jiahui Liang, Yifan Wang, Jing Zhao, Youzheng Wu, Xiaodong He, Tiejun Zhao
| Challenge: | Existing methods to predict logical forms ignore the utilization of symbolic operations and lack reasoning ability and interpretability. |
| Approach: | They propose an operation-pivoted discrete reasoning framework that uses symbolic operations as neural modules to facilitate reasoning ability and interpretability. |
| Outcome: | Extensive experiments on DROP and RACENum datasets show the reasoning ability of OPERA. |
Learn to Copy from the Copying History: Correlational Copy Network for Abstractive Summarization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for abstractive summarization use encoder-decoder attention, but this leads to incomplete copying. |
| Approach: | They propose a copying scheme that takes advantage of prior copying distributions and explicitly encourages the model to copy the input word that is relevant to the previously copied one. |
| Outcome: | The proposed scheme achieves state-of-the-art on summarization benchmarks . it takes advantage of prior copying distributions and explicitly encourages copying . |
P3LM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing autoregressive left-to-right (L2R) models are limited to unidirectional information and constrained on strong local dependencies. |
| Approach: | They propose a probabilistically permuted prophet language model which strengthens the modeling of bidirectional information and long token dependencies for sequence generation. |
| Outcome: | Experiments on GLGE dataset show that P3LM improves on natural language generation tasks. |
LUNA: Learning Slot-Turn Alignment for Dialogue State Tracking (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing methods exploit the utterances of all dialogue turns to assign value to slots . this can lead to suboptimal results due to information introduced from irrelevant utterrances . |
| Approach: | They propose a SLot-TUrN Alignment enhanced approach to assign slot value . they explicitly align each slot with its most relevant utterance and then predict the corresponding value based on this aligned utteration. |
| Outcome: | The proposed approach achieves state-of-the-art on three multi-domain task-oriented dialogue datasets. |
RevCore: Review-Augmented Conversational Recommendation (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing conversational recommendation systems lack item information when conducted on short dialogue history and unfamiliar items. |
| Approach: | They propose a framework where reviews are seamlessly incorporated into conversational recommendation systems. |
| Outcome: | The proposed framework yields better performance on recommendation and conversation responding. |