demo 2 install hadoop, and docker.pdf - New York Institute of Technology CSCI-436\/636 Big Data Management and Analytics This manual is based on Apache

demo 2 install hadoop, and docker.pdf - New York Institute...

This preview shows page 1 - 3 out of 7 pages.

New York Institute of Technology CSCI-436/636 Big Data Management and Analytics This manual is based on Apache Hadoop official manual, and it will help you to install Apache Hadoop 2.7.4 and set up a single node cluster. Ref /docs/r2.7.4/ HW: write the singe node setup if you cannot understand some steps. Step 1. Download Apache Hadoop 2.7.6. *Apache Hadoop 2.7.6: Step 2. Extract hadoop-2.7.4.tar.gz by command: tar xvf hadoop-2.7.4.tar.gz Once finished, there will be a directory named as hadoop-2.7.4. Step 3. Install required software in Ubuntu. sudo apt-get install ssh sudo apt-get install rsync sudo apt-get install default-jre default-jdk Step 4. Set JAVA_HOME for Hadoop. Go to hadoop-2.7.4 by command: cd hadoop-2.7.4 In the directory, edit the file etc/hadoop/hadoop-env.sh to define parameter as follows: export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 Step 5. Try the following command: bin/hadoop This will display the usage documentation for the hadoop script. PS: if it can not find the format JAVA_HOME try to use the follow command: 1. cd 2. sudo apt-get install vim 3. vim .bashrc 4. i 5. [move to end of the logs]
Image of page 1
6. [type Enter] 7.
Image of page 2
Image of page 3

You've reached the end of your free preview.

Want to read all 7 pages?

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture

  • Left Quote Icon

    Student Picture