[SysDeg] Worksharing Framework and its design – Part 3: Prototype for the first version

Long time no see! After one month playing with caching in Spark, I learned many valuable lessons (which will be posted on other blog posts, about Cache Manager and Block Manager of Spark). Our team came back to the ┬ádesign of the system - spark SQL server. To be honest, i spent too much time … Continue reading [SysDeg] Worksharing Framework and its design – Part 3: Prototype for the first version

Advertisements

[Arch] Spark job submission breakdown

I did write the Spark deploy mode in this post too, but I realized that it would be too long, so I decided to split it into two posts. I suggest you to go to this to have a good and general view of Spark in the ecosystem. In this post, I will focus on … Continue reading [Arch] Spark job submission breakdown