Papers by Tobias Falke
Regression-Free Model Updates for Spoken Language Understanding (2023.acl-industry)
Copied to clipboard
| Challenge: | Recent work has proposed methods for minimizing regressions caused by model updates . focus is on spoken language understanding models, which are unexplored . |
| Approach: | They propose a focal distillation technique to reduce regressions in goal-oriented dialog systems . they also evaluate its effectiveness for key language understanding tasks . |
| Outcome: | The proposed technique outperforms naive supervised training in mislabeled data and label expansion settings. |
Sharing Encoder Representations across Languages, Domains and Tasks in Large-Scale Spoken Language Understanding (2023.acl-industry)
Copied to clipboard
Jonathan Hueser, Judith Gaspers, Thomas Gueudre, Chandana Prakash, Jin Cao, Daniil Sorokin, Quynh Do, Nicolas Anastassacos, Tobias Falke, Turan Gojayev
| Challenge: | Larger encoders can improve accuracy for spoken language understanding (SLU) but are difficult to use given the inference latency constraints of online systems. |
| Approach: | They propose to use a larger 170M parameter BERT encoder that shares representations across languages, domains and tasks for SLU. |
| Outcome: | The proposed encoders achieve state-of-the-art performance on numerous NLP tasks. |
Recipes for Sequential Pre-training of Multilingual Encoder and Seq2Seq Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained encoder-only and sequence-to-sequence models are computationally expensive. |
| Approach: | They propose a recipe to initialize one model from the other to improve pre-training efficiency. |
| Outcome: | The proposed method matches the performance of a from-scratch model with a multilingual encoder while reducing the total compute cost by 27%. |
Ranking Generated Summaries by Correctness: An Interesting but Challenging Application for Natural Language Inference (P19-1)
Copied to clipboard
| Challenge: | Recent advances on abstractive summarization have led to fluent summaries, but factual errors in generated summary still severely limit their use in practice. |
| Approach: | They evaluate summaries produced by state-of-the-art models via crowdsourcing and show that factual errors occur frequently. |
| Outcome: | The proposed models can detect errors and reduce them by reranking alternative summaries. |
Data-Efficient Paraphrase Generation to Bootstrap Intent Classification and Slot Labeling for New Features in Task-Oriented Dialog Systems (2020.coling-industry)
Copied to clipboard
| Challenge: | a number of dialog systems have been developed to perform tasks with high accuracy on benchmarks, but there is a problem with annotated seed data. |
| Approach: | They propose a model that augments initial seed data by paraphrasing existing utterances automatically. |
| Outcome: | The proposed approach improves intent classification and slot labeling on a public dataset and with a real-world dialog system. |
Fast Concept Mention Grouping for Concept Map-based Multi-Document Summarization (N19-1)
Copied to clipboard
| Challenge: | Concept map-based multi-document summarization is a subtask of CM-MDS that requires a pairwise comparison to improve the summary quality. |
| Approach: | They propose to use locality sensitive hashing, approximate nearest neighbor search and a fast clustering algorithm to group concepts into a single concept map. |
| Outcome: | The proposed methods exhibit linear and log-linear runtime complexity, making them much more scalable. |
Feedback Attribution for Counterfactual Bandit Learning in Multi-Domain Spoken Language Understanding (2021.emnlp-main)
Copied to clipboard
| Challenge: | a large amount of labeled data is needed for fine-tuning. |
| Approach: | They propose attribution methods inspired by multi-agent reinforcement learning for a feedback attribution problem in spoken language understanding. |
| Outcome: | The proposed methods can train competitive models from user feedback. |
Leveraging User Paraphrasing Behavior In Dialog Systems To Automatically Collect Annotations For Long-Tail Utterances (2020.coling-industry)
Copied to clipboard
| Challenge: | In large-scale commercial dialog systems, users express the same request in a wide variety of alternative ways with a long tail of less frequent alternatives. |
| Approach: | They propose a method to leverage this feedback by creating annotated training examples from it. |
| Outcome: | The proposed method can be used in a commercial dialog system across various domains and three languages. |