Tuesday, March 5, 2019

Hadoop Submitting a MapReduce Job

HDFS Input Location:

/user/deepakdubey/input/stocks

HDFS Output Location (relative to user):

output/mapreduce/stocks



Delete Output Directory:

hadoop fs -rm -r output/mapreduce/stocks



Submit Job:

hadoop jar /deepakdubey/mapreduce/stocks/MaxClosePriceByStock-1.0.jar com.deepakdubey.MaxClosePriceByStock /user/deepakdubey/input/stocks output/mapreduce/stocks



View Result:

hadoop fs -cat output/mapreduce/stocks/part-r-00000



=========================


HDFS Input Location:

/user/deepakdubey/input/stocks

HDFS Output Location (relative to user):

output/mapreduce/stocks



Delete Output Directory:

hadoop fs -rm -r output/mapreduce/stocks



Submit Job:

hadoop jar /deepakdubey-starterkit/mapreduce/stocks/MaxClosePriceByStock-1.0.jar com.deepakdubey.MaxClosePriceByStock /user/deepakdubey/input/stocks output/mapreduce/stocks



View Result:

hadoop fs -cat output/mapreduce/stocks/part-r-00000