Challenge: Existing methods require training millions of architectures to estimate the accuracy of the search results.
Approach: They propose a performance ranking method (RankNAS) that uses pairwise ranking and search space pruning to enlarge the search space.
Outcome: The proposed method significantly accelerates NAS through pairwise ranking and search space pruning.

Similar Papers

Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition (D19-1)

Copied to clipboard

Challenge: Neural architecture search (NAS) is a popular approach for finding new models and freeing researchers from the hard work of designing network architectures.
Approach: They propose differentiable neural architecture search methods for natural language processing . they remove the softmax-local constraint and apply it to named entity recognition .
Outcome: The proposed method outperforms strong baselines on the language modeling task.
Neural Architecture Search for Parameter-Efficient Fine-tuning of Large Pre-trained Language Models (2023.findings-acl)

Copied to clipboard

Challenge: Parameter-efficient tuning (PET) methods fit pre-trained language models to downstream tasks by computing a small compressed update for a subset of parameter updates or appending and fine-tuning a few new parameters to the pre-train network.
Approach: They propose a parameter-efficient tuning method that prunes PET architectures using structured pruning.
Outcome: The proposed method performs well in practice but could be improved via NAS . it can be used to fine-tune large pre-trained language models on multiple tasks .
FENAS: Flexible and Expressive Neural Architecture Search (2020.findings-emnlp)

Copied to clipboard

Challenge: Recent approaches to architecture search have shown good improvements in terms of performance with reasonable training speed.
Approach: They propose an algorithm with more activation functions, input edges, and atomic operations to search for architectures that are optimal for given task.
Outcome: The proposed algorithm reproduces well-known LSTM and GRU architectures and initializes with them for finding architectures more efficiently.
LoNAS: Elastic Low-Rank Adapters for Efficient Large Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) reach hundreds of billions of parameters and require resources for training and inference stages.
Approach: They propose a low-rank adapter to reduce the number of trainable parameters in a model and reduce memory requirements.
Outcome: The proposed approach reduces memory and compute requirements while preserving performance.
LLM Performance Predictors are good initializers for Architecture Search (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have diverse applications, encompassing both open-ended tasks (e.g., brainstorming and chat) and closed-ended ones (eg. question answering).
Approach: They construct PP prompts for Large Language Models (LLMs) that estimate the performance of specific deep neural network architectures on downstream tasks.
Outcome: The proposed model achieves a SoTA mean absolute error and a slight degradation in rank correlation coefficient compared to baseline predictors in machine translation tasks.
Training-free Neural Architecture Search for RNNs and Transformers (2023.acl-long)

Copied to clipboard

Challenge: Neural architecture search (NAS) has allowed for the automatic creation of new and effective neural network architectures.
Approach: They develop a new NAS metric that predicts the trained performance of an RNN architecture and significantly outperforms existing NAS metrics.
Outcome: The proposed metric outperforms existing training-free metrics on the NAS-Bench-NLP benchmark.
LM-Searcher: Cross-domain Neural Architecture Search with LLMs via Unified Numerical Encoding (2025.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models have opened new avenues for solving complex optimization problems, including Neural Architecture Search (NAS).
Approach: They propose a framework that leverages LLMs for cross-domain neural architecture optimization without extensive domain-specific tuning.
Outcome: The proposed framework achieves competitive performance in both in-domain and out-of-domain tasks.
Discovering Better Model Architectures for Medical Query Understanding (2021.naacl-industry)

Copied to clipboard

Challenge: Neural architecture search (NAS) has attracted intense attention in computer vision and NLP.
Approach: They propose to use neural architecture search to optimize model architectures for medical questions . they propose to modify the ENAS method to accelerate and stabilize the search results .
Outcome: The proposed approach outperforms baseline models on two medical questions . it is compared with other NAS methods and shows that it provides the best results .
Learning Architectures from an Extended Search Space for Language Modeling (2020.acl-main)

Copied to clipboard

Challenge: Neural architecture search (NAS) has advanced in recent years but most NAS systems restrict search to learning architectures of a recurrent or convolutional cell.
Approach: They propose a general approach to learn both intra-cell and inter-cell architectures . they implement their approach in a differentiable architecture search system .
Outcome: The proposed approach outperforms the baseline on PTB and WikiText data and shows good transferability to other systems.
Rethinking Complex Neural Network Architectures for Document Classification (N19-1)

Copied to clipboard

Challenge: Neural network models for many NLP tasks have grown increasingly complex in recent years . authors of recent papers question the necessity of such architectures and find them quite effective .
Approach: They propose to use regularization techniques borrowed from language modeling to improve model accuracy . they find that a simple biLSTM architecture with appropriate regularization yields competitive results .
Outcome: a simple biLSTM model outperforms the state-of-the-art on four benchmark datasets . authors say that improvements are not real, but are attributed to mundane reasons .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations