spark.default.parallelism=6000
spark.sql.shuffle.partitions=6000
时OOM,
改为
spark.default.parallelism=2000
spark.sql.shuffle.partitions=2000
问题解决
微信扫一扫
spark.default.parallelism=6000
spark.sql.shuffle.partitions=6000
时OOM,
改为
spark.default.parallelism=2000
spark.sql.shuffle.partitions=2000
问题解决
相关推荐