Quantized Training with Deep Networks

How to cut neural net training time in half with minimal effort

Applying Quantization within a Neural Network’s Forward/Backward Pass (created by author)

Quantization at a Glance

Many approaches exist for reducing the overhead of neural network training, but one of the most promising methods is low-precision/quantized training. The approach is simple — just reduce the number of bits used to represent…