Explicit Alignment and Many-to-many Entailment Based Reasoning for Conversational Machine Reading (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent research has explored how to improve the abilities of decision-making and question generation. |
| Approach: | They propose a pipeline framework that aligns the document and user-provided information in an explicit way, makes decisions using a lightweight many-to-many entailment reasoning module and generates follow-up questions based on the document. |
| Outcome: | The proposed framework achieves state-of-the-art in micro-accuracy and ranks the first place on the public leaderboard of the CMR benchmark dataset ShARC. |
Similar Papers
Towards End-to-End Open Conversational Machine Reading (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing approaches to the problem of open-retrieval conversational machine reading (OR-CMR) use two separate modules to approach the problem's two successive sub-tasks. |
| Approach: | They propose to model OR-CMR as a unified text-to-text task in a fully end-to end style and propose to use a text-based approach to solve the problem. |
| Outcome: | Experiments on the ShARC and OR-ShARC dataset show that the proposed framework can generalize to different backbone models. |
ET5: A Novel End-to-end Framework for Conversational Machine Reading Comprehension (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods require three steps to understand text, but span extraction and question rephrasing steps are not fully exploited. |
| Approach: | They propose a framework for conversational machine reading comprehension based on shared parameter mechanism . experimental results show the proposed framework achieves new state-of-the-art results on the ShARC leaderboard . |
| Outcome: | The proposed framework achieves state-of-the-art on the ShARC leaderboard with the BLEU-4 score of 55.2. |
Bridging The Gap: Entailment Fused-T5 for Open-retrieval Conversational Machine Reading Comprehension (2023.acl-long)
Copied to clipboard
| Challenge: | Open-retrieval conversational machine reading comprehension (OCMRC) simulates real-life conversation scenes. |
| Approach: | They propose a one-stage end-to-end framework to bridge the information gap between decision-making and question generation in a global understanding manner. |
| Outcome: | The proposed framework achieves new state-of-the-art performance on the OR-ShARC benchmark. |
Smoothing Dialogue States for Open Conversational Machine Reading (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies train independent or pipeline systems for the two subtasks but are trivial by using hard-label decisions to activate question generation. |
| Approach: | They propose a method to smooth two dialogue states in one decoder and bridge decision making and question generation to provide a richer dialogue state reference. |
| Outcome: | The proposed method achieves state-of-the-art on the OR-ShARC dataset. |
Discern: Discourse-Aware Entailment Reasoning Network for Conversational Machine Reading (2020.emnlp-main)
Copied to clipboard
Yifan Gao, Chien-Sheng Wu, Jingjing Li, Shafiq Joty, Steven C.H. Hoi, Caiming Xiong, Irwin King, Michael Lyu
| Challenge: | Document interpretation and dialog understanding are the two major challenges for conversational machine reading. |
| Approach: | They propose a discourse-aware entailment reasoning network to strengthen the connection and enhance the understanding of document and dialog. |
| Outcome: | The proposed model improves document interpretation and dialog understanding on the ShARC benchmark. |
E3: Entailment-driven Extracting and Editing for Conversational Machine Reading (P19-1)
Copied to clipboard
| Challenge: | Conversational machine reading systems help users answer high-level questions when they do not know the exact rules by which the decision is made. |
| Approach: | They propose a conversational machine reading model that extracts a set of decision rules from a procedural text which the system must read to figure out what to ask the user. |
| Outcome: | The proposed model outperforms existing systems and a BERT-based baseline on the ShARC conversational machine reading dataset and provides an explainable alternative to prior work. |
Explicit Memory Tracker with Coarse-to-Fine Reasoning for Conversational Machine Reading (2020.acl-main)
Copied to clipboard
Yifan Gao, Chien-Sheng Wu, Shafiq Joty, Caiming Xiong, Richard Socher, Irwin King, Michael Lyu, Steven C.H. Hoi
| Challenge: | Existing approaches to answer user questions are limited in their decision making due to struggles in extracting question-related rules and reasoning about them. |
| Approach: | They propose a conversational machine reading framework that uses a Explicit Memory Tracker to track whether conditions in the rule text have already been satisfied to make a decision. |
| Outcome: | The proposed framework achieves state-of-the-art on the ShARC benchmark and is more interpretable by visualizing the entailment-oriented reasoning process as the conversation flows. |
Making Information Seeking Easier: An Improved Pipeline for Conversational Search (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing tools for conversational information seeking (CIS) do not support conversational contexts. |
| Approach: | They propose a highly effective pipeline for passage retrieval in a conversational search setting using a BERT-based classifier and a multi-view reranking component. |
| Outcome: | The proposed pipeline achieves 14.8% performance improvement over the current state-of-the-art pipeline and surpasses the Oracle. |
Dialogue Graph Modeling for Conversational Machine Reading (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for conversational machine reading (CMR) are not effective for capturing multiple objects in complex interactive scenarios. |
| Approach: | They propose a dialogue graph modeling framework that captures explicit and implicit interactions hidden in the rule documents and a model that asks clarification questions to the machine. |
| Outcome: | The proposed model exceeds the milestone accuracy score of 80% on the ShARC benchmark and achieves new state-of-the-art by first exceeding the milestone precision score of 90%. |
Sequence-to-Sequence Learning for Task-oriented Dialogue with Dialogue State Representation (C18-1)
Copied to clipboard
| Challenge: | Existing pipeline models for task-oriented dialogue system require explicit modeling of dialogue states and hand-crafted action spaces to query domain-specific knowledge base. |
| Approach: | They propose a framework that leverages the advantages of classic pipeline and sequence-to-sequence models. |
| Outcome: | The proposed framework outperforms baseline models on automatic and human evaluation on a Stanford Multi-turn Multi-domain task-oriented dialogue dataset. |