oozie出错:找不到action.xml文件
chenai3223
2015-05-02
各位大神,请教一下,我通过oozie,在hadoop中执行shell脚本,oozie控制台打印下面的错误:
Oozie Launcher starts Heart beat Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exception invoking main(), File does not exist: hdfs://Master:9000/user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/action.xml Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exception invoking main(), File does not exist: hdfs://Master:9000/user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/action.xml java.io.FileNotFoundException: File does not exist: hdfs://Master:9000/user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/action.xml at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1093) at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1085) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1085) at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:337) at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:289) at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1970) at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1939) at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1915) at org.apache.oozie.action.hadoop.LauncherMapper.setupMainConfiguration(LauncherMapper.java:423) at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:171) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) java.io.FileNotFoundException: File does not exist: hdfs://traceMaster:9000/user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/action.xml at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1093) at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1085) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1085) at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:337) at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:289) at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1970) at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1939) at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1915) at org.apache.oozie.action.hadoop.LauncherMapper.setupMainConfiguration(LauncherMapper.java:423) at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:171) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Oozie Launcher failed, finishing Hadoop job gracefully Oozie Launcher, uploading action data to HDFS sequence file: hdfs://Master:9000/user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/action-data.seq Oozie Launcher ends 在oozie的web控制台上看到的是failed: error message:JA017: Unknown hadoop job [job_local1945068546_0001] associated with action [0000000-150430155539137-oozie-hado-W@shell-node]. Failing this action! 查看hdfs上的/user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell目录,只有这三个文件,没有action.xml: [root@Master oozie]# hdfs dfs -ls /user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell Found 3 items -rw-r--r-- 1 hadoop supergroup 24 2015-04-30 16:02 /user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/0000000-150430155539137-oozie-hado-W@shell-node@0 -rw-r--r-- 1 hadoop supergroup 777 2015-04-30 16:02 /user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/action-data.seq drwxr-xr-x - hadoop supergroup 0 2015-04-30 16:02 /user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/output 请教一下,action.xml这个文件是从哪来的?怎么会报这个错误?谢谢! |
|
xuehuashenjian08
2015-05-15
action.xml文件应该是oozie-server向Hadoop提交作业过程中自己生成的,可以讲oozie的debug打开,看看oozie后台日志。再不行,只能跟踪oozie源码了。
|
|
zfpigpig
2016-04-20
这个文件是属于hadoop,你那个进程是不是hadoop的,如果不是得话,即使文件有也找不到~
|