Avoid installing packages by connecting to individual cluster instances using

Avoid installing packages by connecting to individual

This preview shows page 99 - 101 out of 395 pages.

Avoid installing packages by connecting to individual cluster instances using SSH. Instead, use a bootstrap action to install and update packages on all cluster instances as necessary. This requires that you terminate a cluster and relaunch it. For more information, see Create Bootstrap Actions to Install Additional Software (p. 100) . Using a Custom AMI When you use Amazon EMR 5.7.0 or later, you can choose to specify a custom Amazon Linux AMI instead of the default Amazon Linux AMI for Amazon EMR. A custom AMI is useful if you want to do the following: Pre-install applications and perform other customizations instead of using bootstrap actions. This can improve cluster start time and streamline the startup work flow. For more information and an example, see Creating a Custom Amazon Linux AMI from a Preconfigured Instance (p. 96) . Implement more sophisticated cluster and node configurations than bootstrap actions allow. Encrypt the EBS root device volumes (boot volumes) of EC2 instances in your cluster if you are using an Amazon EMR version earlier than 5.24.0. For more information, see Creating a Custom AMI with an Encrypted Amazon EBS Root Device Volume (p. 97) . Note Beginning with Amazon EMR version 5.24.0, you can use a security configuration option to encrypt EBS root device and storage volumes when you specify AWS KMS as your key provider. For more information, see Local Disk Encryption (p. 166) . Best Practices and Considerations When you create a custom AMI for Amazon EMR, consider the following: You must use an Amazon Linux AMI. Amazon Linux 2 AMIs are not supported. Only 64-bit Amazon Linux AMIs are supported. Amazon Linux AMIs with multiple Amazon EBS volumes are not supported. Base your customization on the most recent EBS-backed Amazon Linux AMI . For a list of Amazon Linux AMIs and corresponding AMI IDs, see Amazon Linux AMI . 93
Image of page 99
Amazon EMR Management Guide Using a Custom AMI Do not copy a snapshot of an existing Amazon EMR instance to create a custom AMI. This causes errors. Only the HVM virtualization type and instances compatible with Amazon EMR are supported. Be sure to select the HVM image and an instance type compatible with Amazon EMR as you go through the AMI customization process. For compatible instances and virtualization types, see Supported Instance Types (p. 106) . Your service role must have launch permissions on the AMI, so either the AMI must be public, or you must be the owner of the AMI or have it shared with you by the owner. Creating users on the AMI with the same name as applications causes errors (for example, hadoop , hdfs , yarn , or spark ). The contents of /tmp , /var , and /emr —if they exist on the AMI—are moved to /mnt/tmp , /mnt/var , and /mnt/emr respectively during startup. Files are preserved, but if there is a large amount of data, startup may take longer than expected.
Image of page 100
Image of page 101

You've reached the end of your free preview.

Want to read all 395 pages?

  • Spring '12
  • LauraParker
  • Amazon Web Services, Amazon Elastic Compute Cloud

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern

Stuck? We have tutors online 24/7 who can help you get unstuck.
A+ icon
Ask Expert Tutors You can ask You can ask ( soon) You can ask (will expire )
Answers in as fast as 15 minutes
A+ icon
Ask Expert Tutors