I am getting the following exception when running a map/reduce job. We submit map/reduce jobs through oozie.
我在运行map/reduce作业时遇到以下异常。我们通过oozie提交地图/减少工作。
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.JavaMain], main() threw exception, Could not find Yarn tags property (mapreduce.job.tags) java.lang.RuntimeException: Could not find Yarn tags property (mapreduce.job.tags) at org.apache.oozie.action.hadoop.LauncherMainHadoopUtils.getChildYarnJobs(LauncherMainHadoopUtils.java:53) at org.apache.oozie.action.hadoop.LauncherMainHadoopUtils.killChildYarnJobs(LauncherMainHadoopUtils.java:88) at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:46) at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:46) at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:228) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:378) at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:296) at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181) at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745
失败的Oozie启动程序，主类。main()抛出异常，无法找到纱线标记属性(mapreduce.job.tags) java.lang。RuntimeException:不能在org.apache.oozie.action.hadoop. launopchermainoputilus . getchildyarnjobs (launchermainhadoop .javasun.reflect.NativeMethodAccessorImpl。invoke0(本机方法)在sun.reflect.nativemethodaccessorrequest .invoke(NativeMethodAccessorImpl.java:57)在sun.reflec . delegate方法accessorrequest .invoke(委托methodaccessor. java:43) at java.lang.reflect.Method.invoke(Method.java:606)。运行(MapTask.java:343)在org. apache.org .hadoop. mapresite . localcontainer . $EventHandler. runsubtask (LocalContainerLauncher.java:378)上在java.util.concurrent.FutureTask.run(futuretask.c .java:262)的java.util. concurrentl .call(executor .java:471)
I did a google search, and found the following SO post: Hadoop MapReduce job starts but can not find Map class? However the resolution mentioned in this post is not working for me, I cannot see any file permission related errors in the log files.
我做了一个谷歌搜索，找到了下面的SO post: Hadoop MapReduce任务启动但找不到Map类?然而，本文中提到的解决方案对我不起作用，我在日志文件中看不到任何与文件权限相关的错误。
We are using Cloudera distribution.
我们用的是云的分布。
1 个解决方案
#1
1
You need to upgrade Oozie sharelibs. Follow instructions in Cloudera's documentation. Namely:
你需要升级Oozie的sharelibs。按照Cloudera文档中的说明操作。即:
sudo oozie-setup sharelib create -fs FS_URI -locallib /usr/lib/oozie/oozie-sharelib-yarn
sudo oozie-setup sharelib创建-fs FS_URI -locallib /usr/lib/oozie/oozie-sharelib纱线
Don't forget to restart Oozie afterwards. This helped us to solve this particular problem after CDH 5.5 upgrade.
之后别忘了重启Oozie。这帮助我们在CDH 5.5升级后解决了这个特殊的问题。
#1
1
You need to upgrade Oozie sharelibs. Follow instructions in Cloudera's documentation. Namely:
你需要升级Oozie的sharelibs。按照Cloudera文档中的说明操作。即:
sudo oozie-setup sharelib create -fs FS_URI -locallib /usr/lib/oozie/oozie-sharelib-yarn
sudo oozie-setup sharelib创建-fs FS_URI -locallib /usr/lib/oozie/oozie-sharelib纱线
Don't forget to restart Oozie afterwards. This helped us to solve this particular problem after CDH 5.5 upgrade.
之后别忘了重启Oozie。这帮助我们在CDH 5.5升级后解决了这个特殊的问题。