Word count example in Apache Spark

No BigData example is complete without WordCount example Here in this example we will learn how to setup spark in standalone mode using Java API with word count example. 1) Create a new maven project in Eclipse.   2) Add Spark dependency in the pom.xml file.

3) Get the SparkConf object in the java class. […]

Screen-2BShot-2B2015-07-13-2Bat-2B10.37.32-2BPM

How to install Hadoop 2.7.0 on MacOS with Yarn

This post will describe the Hadoop 2.7.0 installation on MacOS in simple steps. Let’s see how to do that: 1) First download the Hadoop-2.7.0.tar.gz. You can download it from here . Or you can go to the downloads page of Hadoop: http://hadoop.apache.org/releases.html 2) Untar the file by using command: tar -xvf hadoop-2.7.0.tar.gz It will extract […]

How to install Apache Flume 1.6.0 on MacOS

Here we will see in simple steps how to install Apache Flume 1.6.0 version on MacOS. The installation of Apache Flume is very easy. Below are the steps defined: 1) Download apache flume from the site. https://flume.apache.org/download.html 2) Extract the tar file by using command tar -xvf Documents/flume/apache-flume-1.6.0-bin where Documents/flume is the directory where I […]