Spark on Kubernetes in 2022 - As someone using AWS EMR for running Spark jobs, the usage of Kubernetes is quite a fresh of air and Joom makes clear the pros and cons of this approach
Lightweight technology governance - This article can be a bit heavy but brings some good points on how automation and not locking the teams to a specific organization but give them enough advantages that they follow a common practice are great values I’d say any company should strive for
The Biggest Mistake I See Engineers Make - this article comes close to the heart as I tend to make these mistakes. Sure is a good reminder to go through fast iterations instead of falling into waterfall
I'm José Cabeda, a data engineer focused on improving data systems and educating on how to use them. I also do a lot of planning and read as much as I can.