Papers with placeholders
Natural Language Interface for Databases Using a Dual-Encoder Model (C18-1)
Copied to clipboard
| Challenge: | Existing approaches to train data-driven natural language interfaces for databases are limited and lack of large datasets is probably the main reason for the lack of complex machine learning approaches. |
| Approach: | They propose a sketch-based two-step neural model for generating structured queries based on a user’s request in natural language. |
| Outcome: | The proposed model improves on two recent large datasets suitable for data-driven solutions for natural language interfaces for databases. |
Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the [MASK] Token (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Large-scale pre-trained MLMs can be used to generalize well to a wide range of tasks. |
| Approach: | They propose to append [MASK]s at a later layer to reduce sequence length for earlier layers. |
| Outcome: | The proposed method outperforms RoBERTa for 6 out of 8 GLUE tasks on average by 0.4%. |
Integrating Domain Terminology into Neural Machine Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing work on terminology integration into Neural Machine Translation shows it can dynamically specialize translation to a specific domain. |
| Approach: | They extend existing work on terminology integration into Neural Machine Translation . they use placeholders complemented by morphosyntactic annotation to integrate terminology . |
| Outcome: | The proposed method surpasses the surface generalization shown by other techniques. |
Self-Attention Architectures for Answer-Agnostic Neural Question Generation (P19-1)
Copied to clipboard
| Challenge: | Neural architectures based on self-attention have attracted interest from the research community . a recent study examined the performance of Transformers on a task of Neural Question Generation . |
| Approach: | They propose to adapt Transformers to a task of Neural Question Generation without constraining the model to focus on a specific answer passage. |
| Outcome: | The proposed architectures have obtained significant improvements over the state-of-the-art in several tasks. |
Beyond Chunks and Graphs: Retrieval-Augmented Generation through Triplet-Driven Thinking (2026.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is critical for reducing hallucinations and incorporating external knowledge into Large Language Models (LLMs). |
| Approach: | They propose a framework that leverages an LLM to decompose questions into searchable triplets with placeholders. |
| Outcome: | Empirical results show that T2RAG outperforms state-of-the-art multi-round and Graph RAG methods while reducing retrieval costs by up to 45%. |