Fair Scheduler in YARN

This post talks about Fair Scheduler in Hadoop which is a pluggable scheduler provided in Hadoop framework. FairScheduler allows YARN applications to share resources in large clusters fairly. Overview of Fair Scheduler in YARN Fair scheduling is a method of assigning resources to applications so that all applications running on…

Continue reading

final in Java

final keyword in Java can be used with a field, method or class. In whichever context you use final in Java, it restricts the access in some way. Final variable – If a field is declared as final its value can’t be changed once assigned. Final method – A method…

Continue reading

Capacity Scheduler in YARN

This post talks about Capacity Scheduler in YARN which is a pluggable scheduler provided in Hadoop framework. Capacity Scheduler improves the multi tenancy of the shared cluster by allocating a certain capacity of the overall cluster to each organization sharing the cluster. Capacity Scheduler overview Rather than setting independent cluster…

Continue reading