Auto-Tuning for Deep Neural Network Deployment

What, why, and most importantly… how?

Photo by S. Tsuchiya on Unsplash

Introduction

One of the metrics used to compare different Neural Network (NN) architectures is the time it takes to train them. Does it take hours? Days? Weeks? Usually, this can be improved just by updating the hardware used to train them. Replace lesser GPUs with more powerful ones…