The sample script looks like the following binbash set e wget S T 10 t 5

The sample script looks like the following binbash

This preview shows page 108 - 110 out of 395 pages.

The sample script looks like the following: #!/bin/bash set -e wget -S -T 10 -t 5 mkdir -p /home/hadoop/contents tar -xzf file.tar.gz -C /home/hadoop/contents To create a cluster with a custom bootstrap action using the AWS CLI When using the AWS CLI to include a bootstrap action, specify the Path and Args as a comma- separated list. The following example does not use an arguments list. To launch a cluster with a custom bootstrap action, type the following command, replace myKey with the name of your EC2 key pair. Linux, UNIX, and Mac OS X users: aws emr create-cluster --name "Test cluster" --release-label emr-4.0.0 \ --use-default-roles --ec2-attributes KeyName= myKey \ --applications Name= Hive Name= Pig \ --instance-count 3 --instance-type m5.xlarge \ --bootstrap-actions Path= "s3://elasticmapreduce/bootstrap-actions/" 102
Image of page 108
Amazon EMR Management Guide Create Bootstrap Actions to Install Additional Software Windows users: aws emr create-cluster --name "Test cluster" --release-label emr-4.2.0 --use-default- roles --ec2-attributes KeyName= myKey --applications Name= Hive Name= Pig --instance- count 3 --instance-type m5.xlarge --bootstrap-actions Path= "s3://elasticmapreduce/ bootstrap-actions/" When you specify the instance count without using the --instance-groups parameter, a single Master node is launched, and the remaining instances are launched as core nodes. All nodes will use the instance type specified in the command. Note If you have not previously created the default Amazon EMR service role and EC2 instance profile, type aws emr create-default-roles to create them before typing the create- cluster subcommand. For more information on using Amazon EMR commands in the AWS CLI, see https:// . Add Custom Bootstrap Actions Using the Console The following procedure describes how to use your own custom bootstrap action. To create a cluster with a custom bootstrap action using the console 1. Open the Amazon EMR console at . 2. Choose Create cluster . 3. Click Go to advanced options . 4. In Create Cluster - Advanced Options, Steps 1 and 2 choose the options as desired and proceed to Step 3: General Cluster Settings . 5. Under Bootstrap Actions select Configure and add to specify the Name, JAR location, and arguments for your bootstrap action. Choose Add . 6. Optionally add more bootstrap actions as desired. 7. Proceed to create the cluster. Your bootstrap action(s) will be performed after the cluster has been provisioned and initialized. While the cluster's master node is running, you can connect to the master node and see the log files that the bootstrap action script generated in the /mnt/var/log/bootstrap-actions/1 directory.
Image of page 109
Image of page 110

You've reached the end of your free preview.

Want to read all 395 pages?

  • Spring '12
  • LauraParker
  • Amazon Web Services, Amazon Elastic Compute Cloud

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern

Ask Expert Tutors You can ask You can ask ( soon) You can ask (will expire )
Answers in as fast as 15 minutes