Hey GPU, What’s Up with My Matrix?
A gentle guide to understanding how GPUs perform matrix multiplication
Published in
8 min readJun 13, 2023
Matrix multiplication; the holy grail of deep neural networks and modern language understanding behemoths. As MLEs or data scientists, our fingers are too quick to type tf.matmul or torch.matmul and we never look back. But don’t tell me you’ve never had the millisecond infatuation to know…
