9 Tips For Training Lightning-Fast Neural Networks In Pytorch

Let’s face it, your model is probably still stuck in the stone age. I bet you’re still using 32bit precision or *GASP* perhaps even training only on a single GPU.

😱.

I get it though, there are 99 speed-up guides but a checklist ain’t 1? (yup, that just happened). Well, consider this the ultimate, step-by-step guide to making sure you’re squeezing all the (GP-Use) 😂 out of your model.

This guide is structured from simplest to most PITA modifications you can make to get the…