NL2Bash: A Corpus and Semantic Parser for Natural Language Interface to the Linux Operating System (L18-1)
Copied to clipboard
| Challenge: | NL2Bash is a new semantic parsing problem for mapping English sentences to Bash commands. |
| Approach: | They propose a dataset of English commands and expert-written Bash commands to map English sentences to Bash. |
| Outcome: | The proposed methods are significantly larger (from two to ten times) than most existing benchmarks. |
Similar Papers
CogCompNLP: Your Swiss Army Knife for NLP (L18-1)
Copied to clipboard
Daniel Khashabi, Mark Sammons, Ben Zhou, Tom Redman, Christos Christodoulopoulos, Vivek Srikumar, Nicholas Rizzolo, Lev Ratinov, Guanheng Luo, Quang Do, Chen-Tse Tsai, Subhro Roy, Stephen Mayhew, Zhili Feng, John Wieting, Xiaodong Yu, Yangqiu Song, Shashank Gupta, Shyam Upadhyay, Naveen Arivazhagan, Qiang Ning, Shaoshi Ling, Dan Roth
| Challenge: | a corpus-reader module supports popular corpora, feature extraction and annotation modules for semantic and syntactic tasks. |
| Approach: | They propose a library that provides modules to address different challenges . they provide a corpus-reader module that supports popular corpora in the NLP community . |
| Outcome: | The proposed library simplifies the process of design and development of NLP applications by providing modules to address different challenges. |
The DReaM Corpus: A Multilingual Annotated Corpus of Grammars for the World’s Languages (2020.lrec-1)
Copied to clipboard
| Challenge: | Until recently, language descriptions were available in paper form only, with indexes as the only search aid. |
| Approach: | They propose to digitize a multilingual corpus of language descriptions and annotate it with various meta, word, and text attributes to make searching and analysis easier and more useful. |
| Outcome: | The proposed corpus is searchable through a couple of well-established corpus infrastructures. |
An efficient method for Natural Language Querying on Structured Data (2023.acl-industry)
Copied to clipboard
| Challenge: | a new approach to NLQ on structured data is based on text-to-SQL type semantic parsing . domain classification, domain classification and domain classification are the main tasks . semantic parsed queries are less common when information is in structured form . |
| Approach: | They propose an efficient and reliable approach to natural language Querying on databases . they use domain classification, domain classification and slot/entity extraction to query a DB . |
| Outcome: | The proposed approach simplifies the NLQ on structured data problem to the following "bread and butter" tasks. |
Syntax in End-to-End Natural Language Processing (2021.emnlp-tutorials)
Copied to clipboard
| Challenge: | tutorial focuses on syntactic parsing and syntax in end-to-end natural language processing (NLP) tasks. |
| Approach: | tutorial will introduce syntactic parsing and the role of syntax in end-to-end natural language processing (NLP) tasks. |
| Outcome: | This tutorial will introduce the background and the latest progress of syntactic parsing and SRL/NMT. |
The impact of lexical and grammatical processing on generating code from natural language (2022.findings-acl)
Copied to clipboard
| Challenge: | Yin and Neubig (2018) identify four key components of importance for natural language to code translation. |
| Approach: | They propose a seq2seq-based architecture that relies on a grammar-based decoder and a lexical substitution component for natural language to code translation. |
| Outcome: | The proposed architecture relies on a grammar-based decoder and a BERT encoder . the proposed architecture is based on lexical substitutions in natural language to code translation . |
ELQA: A Corpus of Metalinguistic Questions and Answers about English (2023.acl-long)
Copied to clipboard
| Challenge: | ELQA corpus is metalinguistic—it consists of language about language. |
| Approach: | They present a corpus of questions and answers in and about the English language . they use a free-form question answering task and multiple LLMs to analyze their capacity . |
| Outcome: | The ELQA corpus covers grammar, meaning, fluency, and etymology . the results can be used to investigate metalinguistic capabilities of NLU models . |
Mind the Query: A Benchmark Dataset towards Text2Cypher Task (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Graph databases store data in nodes and relationships, enabling more natural modeling of complex, interconnected data. |
| Approach: | They present a high-quality dataset for the Text2Cypher task . it is enabling the translation of natural language (NL) questions into executable Cypher queries over graph databases. |
| Outcome: | The proposed dataset includes 27,529 NL queries and corresponding Cyphers spanning across 11 real-world graph datasets. |
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations (2021.acl-demo)
Copied to clipboard
| Challenge: | ACL-IJCNLP 2021 will be an online conference . submissions range from early prototypes to mature production-ready systems . |
| Approach: | the ACL-IJCNLP 2021 will be an online conference . the system demonstration track invites submissions ranging from early prototypes to mature production-ready systems. |
| Outcome: | the ACL-IJCNLP 2021 system demonstration track received 133 submissions . the submission rate was 32.3% . |
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: Tutorial Abstracts (2021.acl-tutorials)
Copied to clipboard
| Challenge: | . - (EN) |
| Approach: | . - (EN) |
| Outcome: | . - (EN) |
NLPre: A Revised Approach towards Language-centric Benchmarking of Natural Language Preprocessing Systems (2024.lrec-main)
Copied to clipboard
| Challenge: | GLUE benchmarking system enables ongoing evaluation of multiple NLPre tools while credibly tracking their performance. |
| Approach: | They propose a language-centric benchmarking system that enables ongoing evaluation of multiple NLPre tools while credibly tracking their performance. |
| Outcome: | The proposed system is configured for Polish and integrated with the thoroughly assembled NLPre-PL benchmark. |