Q72 相关issue
- Combine low selectivity vectors generated by the hash join filter
https://github.com/facebookincubator/velox/pull/10987 - TPCDS q72 uses gluten calculation much worse than spark
https://github.com/apache/gluten/issues/8417 - VL Insanely slow on executing TPC-DS Q_72
https://github.com/apache/gluten/issues/1775
cpp
spark.sql.cbo.enabled true
spark.sql.cbo.joinReorder.enabled true
spark.sql.cbo.planStats.enabled true
Gluten fallback 配置
cpp
--conf spark.gluten.sql.columnar.joinOptimizationLevel=18 \
--conf spark.gluten.sql.columnar.physicalJoinOptimizeEnable=true \
--conf spark.gluten.sql.columnar.physicalJoinOptimizationLevel=18 \
--conf spark.gluten.sql.columnar.logicalJoinOptimizeEnable=true \
--conf spark.gluten.sql.columnar.logicalJoinOptimizationLevel=18 \
