Realtime prediction using Spark Structured Streaming, XGBoost and Scala

In this article we will discuss about building a complete machine learning pipeline. The first part will be focused on training a binary classifier in a standard batch mode and in the second part we will do some realtime prediction.

We will use data from the Titanic: Machine learning from disaster one of the many Kaggle competitions.