0

I am running a PigScript through REST API and I want to store my Pig output to another hadoop cluster .Is there any way I set PigStorage to some other hdfs .

1 Answer 1

2

You can use distcp to copy from one hdfs to another.

distcp is used to copy large amounts of data to and from hadoop file systems in parallel.

$ hadoop distcp hdfs://namenode1/foo hdfs://namenode2/bar

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.