Exploring TensorFlow Model Prediction Issues

Steps to debug BERT’s (and other LLMs’) slow prediction times on a personal computer

This all started when I was playing around with BERT models, and I got the ominous message all Data Scientists hope to avoid:

The dreaded “Kernel Died” message 💀

This happened to me while I was running my TensorFlow BERT model on my Jupyter Notebook. Training large language models (LLMs) notoriously takes a large amount of data and compute, so it could make sense…