oozie出错:找不到action.xml文件

chenai3223 2015-05-02
各位大神,请教一下,我通过oozie,在hadoop中执行shell脚本,oozie控制台打印下面的错误:

Oozie Launcher starts


Heart beat
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exception invoking main(), File does not exist: hdfs://Master:9000/user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/action.xml
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exception invoking main(), File does not exist: hdfs://Master:9000/user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/action.xml
java.io.FileNotFoundException: File does not exist: hdfs://Master:9000/user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/action.xml
at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1093)
at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1085)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1085)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:337)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:289)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1970)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1939)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1915)
at org.apache.oozie.action.hadoop.LauncherMapper.setupMainConfiguration(LauncherMapper.java:423)
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:171)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
java.io.FileNotFoundException: File does not exist: hdfs://traceMaster:9000/user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/action.xml
at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1093)
at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1085)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1085)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:337)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:289)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1970)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1939)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1915)
at org.apache.oozie.action.hadoop.LauncherMapper.setupMainConfiguration(LauncherMapper.java:423)
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:171)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)


Oozie Launcher failed, finishing Hadoop job gracefully


Oozie Launcher, uploading action data to HDFS sequence file: hdfs://Master:9000/user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/action-data.seq


Oozie Launcher ends


在oozie的web控制台上看到的是failed:


error message:JA017: Unknown hadoop job [job_local1945068546_0001] associated with action [0000000-150430155539137-oozie-hado-W@shell-node]. Failing this action!


查看hdfs上的/user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell目录,只有这三个文件,没有action.xml:
[root@Master oozie]# hdfs dfs -ls /user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell
Found 3 items
-rw-r--r-- 1 hadoop supergroup 24 2015-04-30 16:02 /user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/0000000-150430155539137-oozie-hado-W@shell-node@0
-rw-r--r-- 1 hadoop supergroup 777 2015-04-30 16:02 /user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/action-data.seq
drwxr-xr-x - hadoop supergroup 0 2015-04-30 16:02 /user/hadoop/oozie-hado/0000000-150430155539137-oozie-hado-W/shell-node--shell/output


请教一下,action.xml这个文件是从哪来的?怎么会报这个错误?谢谢!
xuehuashenjian08 2015-05-15
action.xml文件应该是oozie-server向Hadoop提交作业过程中自己生成的,可以讲oozie的debug打开,看看oozie后台日志。再不行,只能跟踪oozie源码了。
zfpigpig 2016-04-20
这个文件是属于hadoop,你那个进程是不是hadoop的,如果不是得话,即使文件有也找不到~
Global site tag (gtag.js) - Google Analytics