Load Testing Simplified With SageMaker Inference Recommender

Test TensorFlow ResNet50 on SageMaker Real-Time Endpoints

Image from Unsplash by Amokrane Ait-Kaci

In the past I’ve written extensively about the importance of load testing your Machine Learning models before deploying them into production. When it comes to real-time inference use-cases in specific it’s essential to ensure your solution meets your target latency…