Apache Spark for Data Science: User-Defined Functions (UDF), Explained

You find Python easier than SQL? User-Defined Functions in PySpark might be what you’re looking for

Photo by SpaceX on Unsplash

Data scientists aren’t necessarily the best SQL users. Maybe you’re proficient in Python, but you don’t know how to translate that knowledge into SQL. That shouldn’t stop you from…