报错信息:
2016-07-27 10:53:14,102 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container exec
utor initialization is : 24
ExitCodeException exitCode=24: Invalid configuration provided in /etc/hadoop/conf.cloudera.yarn/container-executor.cfg
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.init(LinuxContainerExecutor.java:181)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:209)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:462)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509)
2016-07-27 10:53:14,111 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor:
2016-07-27 10:53:14,111 INFO org.apache.hadoop.service.AbstractService: Service NodeManager failed in state INITED; cause: o
rg.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to initialize container executor
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Failed to initialize container executor
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:211)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:462)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509)
Caused by: java.io.IOException: Linux container executor not configured properly (error=24)
at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.init(LinuxContainerExecutor.java:187)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:209)
... 3 more
Caused by: ExitCodeException exitCode=24: Invalid configuration provided in /etc/hadoop/conf.cloudera.yarn/container-executo
r.cfg
解决办法:
看到ClouderaManager启动NodeManager失败,读取的配置文件是/etc/hadoop/conf.cloudera.yarn/container-executor.cfg,这个文件为空。
参考/module/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/etc/hadoop/conf.empty/container-executor.cfg配置文件,将对应信息写入到/etc/hadoop/conf.cloudera.yarn/container-executor.cfg文件中,问题解决。
echo "yarn.nodemanager.linux-container-executor.group=yarn" > /etc/hadoop/conf.cloudera.yarn/container-executor.cfg
还没有发现副作用,发现再更新。
【参考】http://blog.****.net/yangzongzhao/article/details/41867793