| Challenge: | Several previous approaches convert a sentence into a formal statement by mapping verbs to functions in the formal language. |
| Approach: | They propose a Guided Automatic Python Code Generation method based on Python syntactic constraints and semantic constraints. |
| Outcome: | The proposed method achieves better results on automatic Python code generation task than previous methods. |
Similar Papers
Python Code Generation by Asking Clarification Questions (2023.acl-long)
Copied to clipboard
| Challenge: | Recent work addresses text-to-code generation using pretrained language models (PLMs) for large-scale NLD: Logistic Regression. |
| Approach: | They propose a dataset containing pairs of natural language descriptions and code with created synthetic clarification questions and answers to solve the under-specified nature of a natural language description. |
| Outcome: | The proposed model improves on previous models, while introducing new challenges to the community, including when and what clarification questions should be asked. |
Explicit Syntactic Guidance for Neural Text Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing text generation models follow the sequence-to-sequence paradigm . generative grammar suggests humans generate language by learning language grammar . |
| Approach: | They propose a syntax-guided generation schema that searches the syntax tree in a top-down direction. |
| Outcome: | The proposed method outperforms autoregressive baselines on paraphrase generation and machine translation. |
Execution-Based Evaluation for Open-Domain Code Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | ODEX is the first open-domain EXecution-based natural language (NL) to Python code generation dataset. |
| Approach: | They propose to use a dataset to extend the scope of coding queries to more realistic settings by using open-domain EXecution-based natural language (NL) to Python. |
| Outcome: | The proposed dataset has 945 NL-Code pairs and 1,707 human-written test cases. |
Alignment with Fill-In-the-Middle for Enhancing Code Generation (2025.emnlp-main)
Copied to clipboard
Houxing Ren, Zimu Lu, Weikang Shi, Haotian Hou, Yunqiao Yang, Ke Wang, Aojun Zhou, Junting Pan, Mingjie Zhan, Hongsheng Li
| Challenge: | Existing methods for generating test cases with limited training data are not reliable and may be counterproductive. |
| Approach: | They propose a method that splits code snippets into smaller, granular blocks, creating more diverse DPO pairs from the same test cases. |
| Outcome: | The proposed approach shows significant improvements in code generation tasks on benchmark datasets such as HumanEval (+), MBPP (+), and APPS. |
Incorporating External Knowledge through Pre-training for Natural Language to Code Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing work on open-domain code generation focuses on limited domains or domain-specific languages with limited set of operators. |
| Approach: | They incorporate external knowledge into NL-to-code generation by combining StackOverflow and programming language API documentation with data augmentation and retrieval-based data re-sampling. |
| Outcome: | The proposed approach improves the current state-of-the-art by up to 2.2% absolute BLEU score on the code generation testbed CoNaLa. |
DocCGen: Document-based Controlled Code Generation (2024.emnlp-main)
Copied to clipboard
Sameer Pimparkhede, Mehant Kammakomati, Srikanth Tamilselvam, Prince Kumar, Ashok Kumar, Pushpak Bhattacharyya
| Challenge: | Large language models (LLMs) produce state-of-the-art performance on natural language to code generation for resource-rich general-purpose languages like C++, Java, and Python. |
| Approach: | They propose a framework that breaks the NL-to-Code generation task into two steps . they use library documentation to detect the correct libraries and schema rules extracted from the documentation to constrain the decoding . |
| Outcome: | The proposed framework improves different sized language models across all six evaluation metrics, reducing syntactic and semantic errors in structured code. |
Syntax-Guided Controlled Generation of Paraphrases (2020.tacl-1)
Copied to clipboard
| Challenge: | Recent work has explored the incorporation of complex syntactic-guidance as constraints in the task of controlled text generation. |
| Approach: | They propose an end-to-end framework for controlled paraphrase generation that incorporates complex syntactic-guidance constraints into the task. |
| Outcome: | The proposed framework generates syntax-conforming sentences while not compromising on relevance. |
Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to pretrain language models are limited by one-size-fits-all vocabulary . embeddings of mismatch tokens can be efficiently initialized in downstream tasks . |
| Approach: | They propose to extend pretrain-finetune pipeline with an embedding transfer step . plug-and-play embeddable generator is introduced to generate any input token . |
| Outcome: | The proposed approach allows for more efficient and better performed NLG models. |
Factorising AMR generation through syntax (N19-1)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic annotation framework which abstracts away from the surface form of text to capture the core 'who did what to whom' structure. |
| Approach: | They propose to decompose the generation process into two steps: first generate a syntactic structure, and then generate the surface form. |
| Outcome: | The proposed approach generates meaning-preserving syntactic paraphrases of the same graph, as judged by humans. |
GAP: A Graph-aware Language Model Framework for Knowledge Graph-to-Text Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Recent improvements in KG-to-text generation are due to additional pre-training tasks . these tasks require extensive computational resources while only suggesting marginal improvements. |
| Approach: | They propose a mask structure to capture neighborhood information and a type encoder that adds a bias to the graph-attention weights depending on the connection type. |
| Outcome: | The proposed model outperforms state-of-the-art models while requiring no additional pre-training tasks. |