Avro MapReduce Example

This post shows an Avro MapReduce example program using the Avro MapReduce API. As an example word count MapReduce program is used where the output will be an Avro data file. Required jars avro-mapred-1.8.2.jar Avro word count MapReduce example Since output is Avro file so an Avro schema has to…

Continue reading

How to Check For Which Compressors Native Libraries Are Present

If you want to check for which compressors native libraries are present in Hadoop, you can do that using checknative -a command. $ hadoop checknative -a 18/03/16 19:47:24 INFO bzip2.Bzip2Factory: Successfully loaded & initialized native-bzip2 library system-native 18/03/16 19:47:24 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library Native library checking:…

Continue reading