Challenge: Existing spreadsheet formulas often produce near-miss outputs due to an incorrect function, operator, or reference.
Approach: They propose an abstract syntax tree-based error taxonomy that organizes common error modes by the kind of decision that goes wrong in the parse tree.
Outcome: The proposed framework improves Exact Match (EM) by 6.4 points over supervised fine-tuning and matches self-consistency (SC@5) accuracy.

Similar Papers

Contrastive Learning for Prompt-based Few-shot Language Learners (2022.naacl-main)

Copied to clipboard

Challenge: a recent study has shown that GPT-3 fine-tuning models with limited examples is effective . a contrastive learning framework clusters inputs from the same class under different augmented “views” and repels those from different classes.
Approach: They propose a supervised contrastive framework that clusters inputs from the same class under different augmented "views" they combine a contrastive loss with the standard masked language modeling loss in prompt-based few-shot learners .
Outcome: The proposed framework improves on the state-of-the-art methods in a diverse set of 15 language tasks.
C-ICL: Contrastive In-context Learning for Information Extraction (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for in-context learning with large language models focus on using correct or negative examples, ignoring the potential value of incorrect or negative samples.
Approach: They propose a few-shot technique that leverages both correct and incorrect sample constructions to create in-context learning demonstrations.
Outcome: The proposed technique outperforms previous few-shot in-context learning methods on a broad spectrum of related tasks.
Contrastive Data and Learning for Natural Language Processing (2022.naacl-tutorials)

Copied to clipboard

Challenge: Current NLP models heavily rely on effective representation learning algorithms.
Approach: This tutorial introduces contrastive learning and provides an introduction to the techniques.
Outcome: This tutorial provides an introduction to the fundamentals of contrastive learning approaches and the theory behind them.
Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods address few-shot intent detection tasks from two perspectives: data augmentation and task-adaptive training with pre-trained models.
Approach: They propose a few-shot intent detection schema using contrastive pre-training and fine-tuning.
Outcome: The proposed method achieves state-of-the-art performance on three challenging intent detection datasets under 5-shot and 10-shot settings.
A Two-Stage Prediction-Aware Contrastive Learning Framework for Multi-Intent NLU (2024.lrec-main)

Copied to clipboard

Challenge: Multi-intent natural language understanding (NLU) models lack the rich information between the shared intents, especially in low-data scenarios.
Approach: They propose a two-stage framework for multi-intent natural language understanding to harness shared intent information by word-level pre-training and prediction-aware contrastive fine-tuning.
Outcome: The proposed framework surpasses baselines on low-data and full-data scenarios.
Making Pre-trained Language Models Better Few-shot Learners (2021.acl-long)

Copied to clipboard

Challenge: Recent studies show that the GPT-3 model can perform few-shots on language understanding tasks with a natural-language prompt and a few task demonstrations.
Approach: They propose a technique for fine-tuning language models using a few examples . they propose LM-BFF, which uses prompt-based fine-uning and a pipeline for automating prompt generation .
Outcome: The proposed approach outperforms standard fine-tuning procedures on a range of NLP tasks.
Nearest Neighbour Few-Shot Learning for Cross-lingual Classification (2021.emnlp-main)

Copied to clipboard

Challenge: Existing pre-trained models can cause over-fitting when limited data are available.
Approach: They propose to use a nearest-neighbor few-shot technique to improve cross-lingual adaptation using 16 distinct languages across two NLP tasks.
Outcome: The proposed approach improves fine-tuning using only a handful of labeled samples in target locales and also generalizes across tasks.
Few-Shot Semantic Dependency Parsing via Graph Contrastive Learning (2024.lrec-main)

Copied to clipboard

Challenge: Existing graph neural networks (GNNs) have shown promising performance on semantic dependency parsing (SDP) training a high-performing model requires a large amount of labeled data and it is prone to over-fitting in the absence of sufficient labele .
Approach: They propose a syntax-guided graph contrastive learning framework to train GNNs with unlabeled data and fine-tune pre-trained GNN models with few-shot labeled SDP data.
Outcome: The proposed framework achieves promising results when few-shot training samples are available.
Nearest Neighbor Normalization Improves Multimodal Retrieval (2024.emnlp-main)

Copied to clipboard

Challenge: Recent training-free methods suggest that accuracy can be improved without fine-tuning.
Approach: They propose a method for correcting errors in trained contrastive image-text retrieval models with no additional training, called Nearest Neighbor Normalization.
Outcome: The proposed method improves retrieval metrics for all contrastive models and datasets and does not require training on the reference database.
KFCNet: Knowledge Filtering and Contrastive Learning for Generative Commonsense Reasoning (2021.findings-emnlp)

Copied to clipboard

Challenge: Pre-trained language models have led to substantial gains over a broad range of NLP tasks, but have limitations for high-quality tasks such as commonsense generation and ad keyword generation.
Approach: They propose a Knowledge Filtering and Contrastive learning Network which references external knowledge and achieves better generation performance.
Outcome: The proposed model outperforms the current state of the art on the CommonGen benchmark by a large margin.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations