Building a Cost-Efficient and Reliable Spark Platform on K8s (60–90% Savings)
notion.com
1 thread
I wrote this and I’m happy to answer any questions about savings, infrastructure, how we built and tested this in our environment, or open sourcing it with AWS.
Repo is here: https://github.com/aws-samples/sample-spot-balancer-spark-ek...