0
点赞
收藏
分享

微信扫一扫

hive on spark报timed out waiting for connection from the Remote Spark Driver解决方案

IT影子 2022-03-12 阅读 84
[INFO] 2022-03-09 00:55:34.227  - [taskAppId=TASK-122-55596-532256]:[138] -  -> FAILED: Execution Error, return code 30041 from org.apache.hadoop.hive.ql.exec.spark.SparkTask. Failed to create Spark client for Spark session 1c5c0ae6-d56d-47b3-ae5a-d85fd941b14e_0: java.util.concurrent.TimeoutException: Client '1c5c0ae6-d56d-47b3-ae5a-d85fd941b14e_0' timed out waiting for connection from the Remote Spark Driver

Client '1c5c0ae6-d56d-47b3-ae5a-d85fd941b14e_0' timed out waiting for connection from the Remote Spark Driver

报错的原因是连接5分钟超时

解决方案:

hive on spark报timed out waiting for connection from the Remote Spark Driver解决方案_解决方案

hive on spark报timed out waiting for connection from the Remote Spark Driver解决方案_hive_02

调整的参数:

hive.spark.client.server.connect.timeout=300000

hive.spark.client.connect.timeout=30000

hive.spark.client.future.timeout=1200

调整后调整中的任务无报错。

举报

相关推荐

0 条评论