Hadoop Framework Tutorial

Hadoop – Overview

  1. What is Big Data
  2. What is Hadoop
  3. Installing Hadoop in Pseudo-distributed mode
  4. GenericOptionsParser And ToolRunner in Hadoop

HDFS

  1. Introduction to HDFS
  2. Frequently Used HDFS Commands
  3. NameNode, Secondary Namenode and Datanode in HDFS
  4. HDFS Replica Placement Policy
  5. How to Fix Corrupt Blocks And Under Replicated Blocks in HDFS
  6. Namenode in Safemode
  7. What is HDFS Federation
  8. HDFS High Availability
  9. HDFS Data Flow – File Read And Write in HDFS
  10. Java Program to Read a File From HDFS
  11. Java Program to Write a File in HDFS

YARN in Hadoop

  1. Introduction to YARN
  2. Capacity Scheduler in Yarn
  3. Fair Scheduler in Yarn
  4. Uber Task in YARN

MapReduce

  1. Word Count Program Using MapReduce in Hadoop
  2. How MapReduce Works in Hadoop
  3. MapReduce Execution Internal Steps in YARN
  4. Input Split in Hadoop MapReduce
  5. Mapper Only Job in Hadoop MapReduce
  6. Speculative Execution in Hadoop Framework
  7. What is Data Locality in Hadoop
  8. How to Compress Intermediate Output of The Map Phase
  9. How to Compress MapReduce Job Output
  10. How to See Logs And Sysouts in Hadoop MapReduce
  11. Combiner in Hadoop MapReduce
  12. Distributed Cache in Hadoop
  13. How to Chain MapReduce Job in Hadoop
  14. Predefined Mapper and Reducer Classes in Hadoop
  15. Counters in Hadoop MapReduce
  16. OutputCommitter in Hadoop MapReduce
  17. Shuffle Phase in Hadoop MapReduce
  18. How to Improve Map-Reduce Performance

Hadoop-IO

  1. Data Compression in Hadoop Framework
  2. How to Check For Which Compressors Native Libraries Are Present
  3. Java Program to Compress File in gzip Format in Hadoop
  4. Java Program to Compress File in bzip2 Format in Hadoop
  5. How to Use LZO Compression in Hadoop
  6. Sequence File in Hadoop
  7. How to Read And Write SequenceFile in Hadoop
  8. Avro File Format in Hadoop
  9. How to Read And Write Avro Files in Hadoop
  10. Avro MapReduce Example
  11. Parquet File Format in Hadoop
  12. How to Read And Write Parquet File in Hadoop

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.