| Challenge: | Currently, virtual assistants work in the paradigm of intent-slot tagging and the slot values are directly passed as-is to the execution engine. |
| Approach: | They propose to use BART to rephrase a query to make it more natural . they propose to add a copy-pointer and copy loss to it to improve performance . |
| Outcome: | The proposed model improves on existing models by adding a copy-pointer and copy loss. |
Similar Papers
Contextual Rephrase Detection for Reducing Friction in Dialogue Systems (2021.emnlp-main)
Copied to clipboard
| Challenge: | Large-scale conversational AI based dialogue systems like Alexa, Siri, and Google Assistant, are getting more and more prevalent in real-world applications to help users across the globe. |
| Approach: | They propose a contextual rephrase detection model ContReph to automatically identify rephrasings from multi-turn dialogues using contextual information and user-agent interaction signals. |
| Outcome: | The proposed model outperforms the pairwise rephrase detection models by leveraging the context and user-agent interaction signals. |
Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling (2024.acl-long)
Copied to clipboard
| Challenge: | Large language model pre-training is infeasible due to the large compute costs and duration associated with pre- training and the impending scarcity of high-quality data on the web. |
| Approach: | They propose to use an off-the-shelf instruction-tuned model prompted to paraphrase documents on the web in specific styles such as “like Wikipedia” or in “question-answer format” to jointly pre-train LLMs on real and synthetic rephrases. |
| Outcome: | The proposed model speeds up pre-training by 3x on the C4 dataset, and improves perplexity by 50% on average across different subsets of the Pile. |
Split and Rephrase: Better Evaluation and Stronger Baselines (P18-2)
Copied to clipboard
| Challenge: | a dataset mapping a complex sentence to a sequence of sentences conveying the same meaning is challenging in NLP. |
| Approach: | They propose a neural split and a copy-mechanism to break a complex sentence into several shorter sentences that convey the same meaning. |
| Outcome: | The proposed model outperforms the baseline model by 8.68 BLEU and further improves on the task. |
Rephrasing Invokes Better Generations for Large Language Models (2024.naacl-srw)
Copied to clipboard
| Challenge: | Existing methods for prompt tuning and input pre-processing are under-studied . e.g., ReLLM replaces low-frequency words with their high-frequency counterparts . |
| Approach: | They propose a method that automatically paraphrases input content for better output generation. |
| Outcome: | The proposed method is user-friendly and requires no additional training. |
CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learning (2022.emnlp-main)
Copied to clipboard
Zeqiu Wu, Yi Luan, Hannah Rashkin, David Reitter, Hannaneh Hajishirzi, Mari Ostendorf, Gaurav Singh Tomar
| Challenge: | Existing models for conversational question answering require specific retrievers to understand user questions. |
| Approach: | They develop a query rewriting model CONQRR that rewrites a conversational question into a standalone question. |
| Outcome: | The proposed model achieves state-of-the-art on an open-domain conversational question answering dataset and is effective for two different off-the shelf retrievers. |
WikiSplit++: Easy Data Refinement for Split and Rephrase (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing text simplification methods rely on encoder-decoder models to achieve this task. |
| Approach: | They propose a text-to-text generation approach that applies encoder-decoder models to a large-scale dataset to improve Split and Rephrase. |
| Outcome: | The proposed approach improves Split and Rephrase readability and performance on large datasets, but still suffers from hallucinations and under-splitting. |
Small but Mighty: New Benchmarks for Split and Rephrase (2020.emnlp-main)
Copied to clipboard
| Challenge: | Split and Rephrase is a text simplification task that requires a strong evaluation benchmark and metric . despite its relatively new nature, the benchmark dataset contains easily exploitable syntactic cues . |
| Approach: | They propose to use crowdsourced datasets to evaluate split and rephrase models . they find that the widely used benchmark dataset universally contains exploitable syntactic cues . |
| Outcome: | The proposed model performs better than the state-of-the-art model, the authors say . they show that the datasets contain significantly more diverse syntax . |
Proceedings of the 2nd Workshop on Machine Reading for Question Answering (D19-58)
Copied to clipboard
| Challenge: | a workshop focuses on machine reading for question answering . despite recent progress, there is much to be desired about these datasets and systems . |
| Approach: | This year, they present a shared task on machine reading for question answering . they adapt and unified 18 distinct question answering datasets into the same format . |
| Outcome: | The proposed system achieves an average F1 score of 72.5 on the held-out datasets. |
Handling Normalization Issues for Part-of-Speech Tagging of Online Conversational Text (L18-1)
Copied to clipboard
Géraldine Damnati, Jeremy Auguste, Alexis Nasr, Delphine Charlet, Johannes Heinecke, Frédéric Béchet
| Challenge: | a new approach to POS tagging noisy user generated text is proposed . word embeddings are trained on a noisy corpus to address both normalization and POS. |
| Approach: | They propose to use word embeddings to normalize text before tagging it, while a gated neural network based tagger handles the remaining errors. |
| Outcome: | The proposed approach normalizes some errors before tagging, while a gated neural network handles the remaining errors. |
Automatic Rephrasing of Transcripts-based Action Items (2021.findings-acl)
Copied to clipboard
| Challenge: | a growing number of online meetings are transcribed using automated speech recognition systems. |
| Approach: | They propose to use annotated transcripts to generate a human-level rephrasing of an action item . they use supervised text generation techniques and pre-trained transformer models to train models . |
| Outcome: | The proposed model generates a human-level rephrasing of an action item in annotated meeting transcripts. |