如何黑名單上的遺囑執行人火花集群

[Hubert_Dudek1]

這是一個點燃的配置鍵啟用或改變黑名單機製:

spark.blacklist。啟用——設置為True

spark.blacklist.task。默認maxTaskAttemptsPerExecutor (1)

spark.blacklist.task。默認maxTaskAttemptsPerNode (2)

spark.blacklist.application。默認maxFailedTasksPerExecutor (2)

spark.blacklist.stage。默認maxFailedTasksPerExecutor (2)

spark.blacklist.application。默認maxFailedExecutorsPerNode (2)

spark.blacklist.stage。默認maxFailedExecutorsPerNode (2)

spark.blacklist。超時(不是默認設置)

spark.blacklist。killBlacklistedExecutors(默認錯誤)