Distributed Data Pre-processing using Dask, Amazon ECS and Python (Part 2)
Using Dask for EDA and Hyperparameters Optimization (HPO)
Published in
6 min readJan 3, 2019
In Part 1 of this series, I explained how to build a serverless cluster of Dask scheduler and workers on AWS Fargate. Scaling the number of workers up and down is quite simple. You can achieve that by running the below AWS CLI commands:
