demo 2 install hadoop, and docker.pdf - New York Institute...

New York Institute of
Technology
CSCI-436/636 Big Data Management and
Analytics
This manual is based on Apache Hadoop official manual, and it will help you to install Apache
Hadoop 2.7.4 and set up a single node cluster.
Ref
/docs/r2.7.4/
HW: write the singe node setup if you cannot understand some steps.
Step 1.
Download Apache Hadoop 2.7.6.
*Apache Hadoop 2.7.6:
Step 2.
Extract hadoop-2.7.4.tar.gz by command:
tar xvf hadoop-2.7.4.tar.gz
Once finished, there will be a directory named as hadoop-2.7.4.
Step 3.
Install required software in Ubuntu.
sudo apt-get install ssh
sudo apt-get install rsync
sudo apt-get install default-jre default-jdk
Step 4.
Set JAVA_HOME for Hadoop. Go to hadoop-2.7.4 by command:
cd hadoop-2.7.4
In the directory, edit the file etc/hadoop/hadoop-env.sh to define parameter as follows:
export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
Step 5.
Try the following command:
bin/hadoop
This will display the usage documentation for the hadoop script.
PS: if it can not find the format JAVA_HOME try to use the follow command:
1. cd
2. sudo apt-get install vim
3. vim .bashrc
4. i
5. [move to end of the logs]

6. [type Enter]
7.