9/5/2019

Spark it up!

Today has been rough, but it's looking up. Three things incoming - ALL Spark related :)

1. cnvrg.io - spark-on-kubernetes webinar

I hope to finish this tonight it seems like a nice intro to Spark on Kubernetes and I'm digging it so far.

Cnvrg.io seems to be a botique data science platform similar to Databricks, I'll definitely have my eye on them.

2. Spark tuning for shuffles

Found this gem for spark tuning - a great outline on why shuffles occur and what you can do to tune them.

3. Spark exit status and exit codes.

Another great StackOverflow find regarding Spark exit status and exit codes.

See you party people tomorrow!