Pay-Per-Request Deployment of Neural Network Models Using Serverless Architectures (N18-5)
Copied to clipboard
| Challenge: | Using Amazon’s Lambda service for feedforward evaluation and DynamoDB for word embeddings, we demonstrate a serverless deployment of neural networks for NLP applications. |
| Approach: | They propose a pay-per-request pricing model for neural network deployment in NLP applications using Amazon’s Lambda service for feedforward evaluation and DynamoDB for storing word embeddings. |
| Outcome: | The proposed architecture is scalable and inexpensive. |
Similar Papers
NLP Service APIs and Models for Efficient Registration of New Clients (2020.findings-emnlp)
Copied to clipboard
| Challenge: | State-of-the-art NLP inference uses enormous neural architectures and models trained for GPU-months, well beyond the reach of most consumers of NLP. |
| Approach: | They propose a centralized NLP service that can be customized to suit clients . they propose NER, sentiment labeling, and predictive language modeling to improve client experience. |
| Outcome: | The proposed model can be used to improve word usage and salience across clients without re-training or fine-tuning. |
CNNs for NLP in the Browser: Client-Side Deployment and Visualization Opportunities (N18-5)
Copied to clipboard
| Challenge: | a JavaScript implementation of a convolutional neural network performs feedforward inference completely in the browser. |
| Approach: | They propose a JavaScript implementation that performs feedforward inference completely in the browser. |
| Outcome: | The proposed model performs feedforward inference completely in the browser without server requests . the proposed model is useful for applications with stringent latency requirements or low connectivity . |
Rethinking Complex Neural Network Architectures for Document Classification (N19-1)
Copied to clipboard
| Challenge: | Neural network models for many NLP tasks have grown increasingly complex in recent years . authors of recent papers question the necessity of such architectures and find them quite effective . |
| Approach: | They propose to use regularization techniques borrowed from language modeling to improve model accuracy . they find that a simple biLSTM architecture with appropriate regularization yields competitive results . |
| Outcome: | a simple biLSTM model outperforms the state-of-the-art on four benchmark datasets . authors say that improvements are not real, but are attributed to mundane reasons . |
Energy and Policy Considerations for Deep Learning in NLP (P19-1)
Copied to clipboard
| Challenge: | Recent advances in hardware and methodology for training neural networks have enabled significant accuracy improvements across many NLP tasks. |
| Approach: | They quantify the approximate financial and environmental costs of training neural network models . they propose actionable recommendations to reduce costs and improve equity in NLP research . |
| Outcome: | The proposed recommendations address the cost and environmental costs of training neural networks for NLP. |
Reusing Weights in Subword-Aware Neural Language Models (N18-1)
Copied to clipboard
| Challenge: | a statistical language model assigns a probability to a sequence of words . data sparsity is a major problem in building traditional n-gram language models . |
| Approach: | They propose several ways to reuse subword embeddings and other weights in subword-aware neural language models. |
| Outcome: | The proposed techniques do not benefit a competitive character-aware model . but they show significant reductions in model sizes and performance. |
EFTNAS: Searching for Efficient Language Models in First-Order Weight-Reordered Super-Networks (2024.lrec-main)
Copied to clipboard
| Challenge: | Depending on the size of transformer-based models, they can be restricted from deployment in resource-constrained environments. |
| Approach: | They propose to combine neural architecture search and network pruning techniques to generate and train weight-sharing super-networks that contain efficient transformer-based models. |
| Outcome: | The proposed model achieves high-performing, high-performance subnetworks on the general language understanding evaluation and the Stanford Question Answering Dataset. |
AutoNLU: An On-demand Cloud-based Natural Language Understanding System for Enterprises (2020.aacl-demo)
Copied to clipboard
| Challenge: | AutoNLU is an on-demand cloud-based system that enables users to create and edit datasets and train and test different state-of-the-art NLU models. |
| Approach: | They introduce an on-demand cloud-based system that provides an easy-to-use interface . they build powerful keyphrase extraction models that achieve state-of-the-art results . |
| Outcome: | The proposed model achieves state-of-the-art on two public benchmarks and is easy to use and use. |
Advances in Pre-Training Distributed Word Representations (L18-1)
Copied to clipboard
| Challenge: | Pre-trained word representations are a building block of many Natural Language Processing and Machine Learning applications. |
| Approach: | They propose to combine known tricks and a set of publicly available pre-trained word vector representations to train high-quality representations. |
| Outcome: | The proposed models outperform the current state of the art on a number of tasks while maintaining a high training speed to scale to massive amount of data. |
Neural Machine Translation without Embeddings (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing models operate over subword tokens, but byte-based models employ a different approach . a one-hot representation of each byte does not hurt performance, but it improves BLEU scores . |
| Approach: | They propose to represent every computerized text as a sequence of bytes via UTF-8 . this eliminates the need for an embedding layer and improves performance . |
| Outcome: | The proposed model improves BLEU scores on byte-to-byte translation models compared to character-level models . the proposed model does not require an embedding layer and does not drop out of the decoder . |
SkyLLM: Cross-LLM-APIs Federation for Cost-effective Query Processing (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated exceptional capabilities across a wide range of tasks, from text generation to complex problem-solving. |
| Approach: | They propose a system which federates multiple LLM APIs and dynamically assigns a non-empty subset of these APIs to each query prior to inference. |
| Outcome: | The proposed system can match the most accurate LLM with the lowest cost while cutting costs by 67.8%. |