Accelerated Distributed Training with TensorFlow on Google’s TPU
Understand your Hardware to Optimize your Software
Published in
11 min readJan 31, 2022
In this post I will show you the basic principles of tensor processing units (TPUs) from a hardware perspective and show you step-by-step how you can perform accelerated distributed training on a TPU using TensorFlow to train your own models.