9

Is it possible to run a hadoop job without specifying output file ? When i try to run a hadoop job , no output file specified Exception is thrown . can any one please give any procedure to do so using Java.

I am writing the data processed by reduce to a non relational database so i no longer require it to write to HDFS.

2
  • You need to supply more information about what you've tried and what you're trying to do. What is the purpose of running your MR job? For it to be meaningful it will be producing output of some kind. Where does it go? Not HDFS, obviously. Does it go to HBase or some external store or service? Commented Oct 3, 2012 at 15:37
  • Sorry for it , I have update my Question . Commented Oct 4, 2012 at 4:58

1 Answer 1

5

Unfortunately, you can't really do this. Writing output is part of the framework. When you work outside of the framework, you basically have to just deal with the consequences.

You can use NullOutputFormat, which doesn't write any data to HDFS. I think it still creates the folder, though. You could always let Hadoop create the folder, then delete it.

1
  • 3
    FYI NullOutputFormat doesn't require an output folder to be defined, so should give you what you need Commented Oct 4, 2012 at 0:40

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.