From Examples to Rules: Neural Guided Rule Synthesis for Information Extraction (2022.lrec-1)
Copied to clipboard
Robert Vacareanu, Marco A. Valenzuela-Escárcega, George Caique Gouveia Barbosa, Rebecca Sharp, Gustave Hahn-Powell, Mihai Surdeanu
| Challenge: | a "deep learning tsunami" has brought tremendous improvements in performance to most NLP applications. |
| Approach: | They propose a method for rule synthesis from examples that combines the advantages of deep learning and rule-based methods. |
| Outcome: | The proposed method achieves state-of-the-art on 1-shot task and competitive performance in 5-shot scenario. |
Similar Papers
A Human-machine Interface for Few-shot Rule Synthesis for Information Extraction (2022.naacl-demo)
Copied to clipboard
Robert Vacareanu, George C.G. Barbosa, Enrique Noriega-Atala, Gus Hahn-Powell, Rebecca Sharp, Marco A. Valenzuela-Escárcega, Mihai Surdeanu
| Challenge: | Vacareanu et al., 2021) proposes a system that helps users build transparent information extraction models . rule-based methods address the opacity of neural architectures by producing models that are transparent . |
| Approach: | They propose a system that assists a user in constructing transparent information extraction models . the system generates high-precision rules even in a 1-shot setting, they show . |
| Outcome: | The proposed system generates high-precision rules even in a 1-shot setting . it outperforms manually written patterns on a widely-used relation extraction dataset . |
Learning to Generate Rules for Realistic Few-Shot Relation Classification: An Encoder-Decoder Approach (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a new approach to relation classification is proposed to use data-driven approaches to perform fewshot tasks with limited training data. |
| Approach: | They propose a neuro-symbolic approach for realistic few-shot relation classification via rules . they propose to generate rules that can be used to extract relations using custom T5-style models . |
| Outcome: | The proposed approach is interpretable and pliable and outperforms the state-of-the-art on TACRED and NYT29 benchmarks while maintaining pliability. |
Representation Learning for Information Extraction from Form-like Documents (2020.acl-main)
Copied to clipboard
| Challenge: | Form-like documents like invoices, purchase orders, tax forms and insurance quotes are common in day-to-day business workflows, but current techniques for processing them largely still employ manual effort or brittle and error-prone heuristics for extraction. |
| Approach: | They propose an extraction system that uses knowledge of the types of the target fields to generate extraction candidates and a neural network architecture that learns a dense representation of each candidate based on neighboring words in the document. |
| Outcome: | The proposed system generates extraction candidates based on neighboring words in the document and is interpretable, as shown using loss cases. |
Synthetic Data in the Era of Large Language Models (2025.acl-tutorials)
Copied to clipboard
| Challenge: | 'synthetic data' is a data generated with the assistance of large language models to make dataset construction faster and cheaper. |
| Approach: | This tutorial seeks to build a shared understanding of recent progress in synthetic data generation from NLP and related fields by grouping and describing major methods, applications, and open problems. |
| Outcome: | This tutorial will describe methods, applications, and open problems that have been developed and are being used to improve the quality and efficiency of synthetic data generation. |
Transforming Term Extraction: Transformer-Based Approaches to Multilingual Term Extraction Across Domains (2021.findings-acl)
Copied to clipboard
| Challenge: | Automated Term Extraction (ATE) is a challenging task, with few exceptions. |
| Approach: | They propose to use a transformer-based term extraction model to extract terms from sentences . they also propose to employ a language model for token classification and a sequence model to reduce sentences to terms . |
| Outcome: | The proposed models outperform baselines on the ATE challenge TermEval 2020 dataset in English, French, and Dutch. |
Exploiting Asymmetry for Synthetic Training Data Generation: SynthIE and the Case of Information Extraction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have great potential for synthetic data generation. |
| Approach: | They show that large language models can generate useful data even for complex tasks . they use a symmetric task difficulty asymmetry to prompt an LLM to generate plausible input text for a target output structure. |
| Outcome: | The proposed approach outperforms existing models by a substantial margin on closed information extraction tasks with 1.8M data points and 770M parameters. |
Searching for Effective Neural Extractive Summarization: What Works and What’s Next (P19-1)
Copied to clipboard
| Challenge: | Recent years have seen success in the use of deep neural networks on text summarization, but there is no clear understanding of why they perform so well or how they might be improved. |
| Approach: | They propose to use different types of model architectures to improve extractive summarization systems. |
| Outcome: | The proposed framework achieves state-of-the-art on CNN/DailyMail by a large margin based on observations and analysis. |
Reasoning Makes Good Annotators : An Automatic Task-specific Rules Distilling Framework for Low-resource Relation Extraction (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to extract knowledge from unlabeled data generate noise labels. |
| Approach: | They propose an automatic task-specific rules distilling framework to generate a logic rule from unlabeled data. |
| Outcome: | The proposed framework could power the labeling ability by discovering reliable model-labeled data. |
Harnessing Pre-Trained Neural Networks with Rules for Formality Style Transfer (D19-1)
Copied to clipboard
| Challenge: | Existing studies normalize informal sentences with rules, but they introduce noise if we use them in a naive way. |
| Approach: | They propose to harness rules into a state-of-the-art neural network that is typically pretrained on massive corpora. |
| Outcome: | The proposed method can be used to generate a state-of-the-art on a small dataset. |
Automatic Rule Induction for Efficient Semi-Supervised Learning (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to generalize from labeled and unlabeled data are difficult to explain and behave unreliably. |
| Approach: | They propose a framework for automatic discovery and integration of symbolic rules into pretrained transformer models by using an attention mechanism. |
| Outcome: | The proposed framework can improve state-of-the-art methods with no manual effort and minimal computational overhead. |