[Tutorial]How to use spark-sql-perf

The situation is that: there’s one of our work need to be benchmarked. It’s still the SparkSQL Server that I designed and developed but new sharing technique was implemented and integrated into it. So, we decided to use the spark-sql-perf of Databricks to benchmark our work, and the benchmarked queries we used is TPCDS.

Advertisements

[Implementation]Simultaneous Pipeline technique of MRShare

After 6 months working, I've just defensed my master thesis at the middle of September. The system works properly and efficiently. So sorry since there wasn't any posts during July to August. As the previous posts, I had done with the design of my system, the rest that I need to do is implementing them. The … Continue reading [Implementation]Simultaneous Pipeline technique of MRShare