I have some problems understanding what kind of error Oozie returns to me. Explanation:
I created a very simple "job" in Oozie, the XML is that:
<workflow-app name="Massimiliano" xmlns="uri:oozie:workflow:0.5">
<start to="spark-2adf"/>
<kill name="Kill">
<message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<action name="spark-2adf">
<spark xmlns="uri:oozie:spark-action:0.1">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<master>local[*]</master>
<mode>client</mode>
<name>MySpark</name>
<class>org.XXX.SimpleApp</class>
<jar>${nameNode}/user/${wf:user()}//prova_spark/SimpleApp1.jar</jar>
</spark>
<ok to="End"/>
<error to="Kill"/>
</action>
<end name="End"/>
</workflow-app>
The job.properties is the follow:
nameNode=hdfs://10.203.17.90:8020
jobTracker=10.203.17.90:8021
master=local[*]
queueName=default
oozie.use.system.libpath=true
oozie.wf.application.path=${nameNode}/user/${user.name}/hdfs/user/oozie/share/lib/lib_20160628182408/spark
I tried more and more time to change all the parameters with absolutely no result.
The error that afflicts me is this:
Main class [org.apache.oozie.action.hadoop.SparkMain], exit code [101]
The name node is the Master node;
I don't know if oozie.wf.application.path
is sets correctly;
More detail of error:
hdfs://nameservice1/user/hdfs//prova_spark/SimpleApp1.jar
=================================================================
>>> Invoking Spark class now >>>
Intercepting System.exit(101)
<<< Invocation of Main class completed <<<
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], exit code [101]
Oozie Launcher failed, finishing Hadoop job gracefully
Oozie Launcher, uploading action data to HDFS sequence file: hdfs://nameservice1/user/hdfs/oozie-oozi/0000117-160804173605999-oozie-oozi-W/spark-2adf--spark/action-data.seq
Oozie Launcher ends
The path hdfs://nameservice1/user/hdfs//prova_spark/SimpleApp1.jar
is correct! But I don't know where I have to look to resolve this problem.
Can you help me, please?