Hadoop Project on NCDC ( National Climate Data Center – NOAA ) Dataset
NOAA's National Climatic Data Center (NCDC) is responsible for preserving, monitoring, assessing, and providing public access to weather data.
NCDC provides access to daily data from...
Set up a Hadoop Stream Processing Stack in less than 10 minutes
Overview
Thanks to all the hardwork by the Apache Software foundation big data streaming tools and development environments are getting very easy to set up...
Create a Twitter Stream Processor in 15 Lines of Code.
Articles Series Synopsis
This is a series of articles where we look at problems you can encounter when building Applications with the Hadoop Ecosystem. We...
Guide to Import, Export, Run A MapReduce Program
A MapReduce program is written in Java. And mostly Eclipse IDE is used for programming by the developers. In our last guide we saw...
MapReduce Program In Detail
In our previous guides, we saw how to run wordcount MapReduce program on a single node Hadoop cluster. Now we will understand the MapReduce...
Running a MapReduce Program on Amazon EC2 Hadoop Cluster with YARN
As in the previous guide we configured Hadoop cluster with YARN on Amazon EC2 instance. Now we will run a simple MapReduce Program on...
A step by step guide to install Hadoop cluster on Amazon EC2
This is a step by step guide to install a Hadoop cluster on Amazon EC2. I have my AWS EC2 instance ec2-54-169-106-215.ap-southeast-1.compute.amazonaws.com ready on...
Flume Installation and Streaming Twitter Data Using Flume
Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and...