spark sql on yarn 启动失败 ERROR : Failed to send RPC RPC

时间:2025-05-15 07:44:02
19/04/17 02:54:57 ERROR : Failed to send RPC RPC 7651764253676103503 to /10.169.12.139:45996: 

        at $(...)(Unknown Source)
19/04/17 02:54:57 ERROR $YarnSchedulerEndpoint: Sending RequestExecutors(0,0,Map(),Set()) to AM was unsuccessful
: Failed to send RPC RPC 7651764253676103503 to /10.169.12.139:45996: 
        at $(:357)
        at $(:334)
        at .notifyListener0(:507)
        at (:481)
 

出现这样的原因主要是 给节点分配的内存少,yarn kill了spark application。

给增加配置:

<property>
    		<name>-check-enabled</name>
    		<value>false</value>
	</property>
	<property>
		<name>-check-enabled</name>
    		<value>false</value>
	</property>