Abstract: Differentiable bilevel Neural Architecture Search (NAS) has emerged as a powerful approach in automated machine learning (AutoML) for efficiently searching for neural network architectures.