How to setup notification on completion of Mapreduce jobs


I want to get notification on completion of Mapreduce jobs, How do I do it? Heavy mapreduce jobs may run for several hours. There can be several jobs and checking the status of mapreduce jobs manually will be a boring task. I don’t like this  J. If we try to manage java pr… Source: Notification onContinue reading “How to setup notification on completion of Mapreduce jobs”

How to calculate hadoop cluster growth plan based on storage


How to calculate Hadoop cluster growth plan based on storage? This calculation is for small 3 node Hadoop cluster assume average daily ingest rate of 10 GB per node. Average daily ingest rate 10 GB Replication factor 3 (copies of each block) Daily raw consumption 30 GB  (Ingest × replication) Node raw storage 600 GBContinue reading “How to calculate hadoop cluster growth plan based on storage”