Note The private IP address for the replacement master node remains the same as

Note the private ip address for the replacement

This preview shows page 64 - 66 out of 395 pages.

Note The private IP address for the replacement master node remains the same as the previous one. The public IP address for the replacement master node may change. You can retrieve the new IP addresses in the console or by using the describe-cluster command in the AWS CLI. NameNode only runs on two of the master nodes. However, you can run hdfs CLI commands and operate jobs to access HDFS on all three master nodes. Working with Steps in an EMR Cluster with Multiple Master Nodes You can submit steps to an EMR cluster with multiple master nodes in the same way you work with steps in a cluster with a single master node. For more information, see Submit Work to a Cluster . The following are considerations for working with steps in an EMR cluster with multiple master nodes: If a master node fails, the steps that are running on the master node are marked as FAILED. Any data that were written locally are lost. However, the status FAILED may not reflect the real state of the steps. If a running step has started a YARN application when the master node fails, the step can continue and succeed due to the automatic failover of the master node. It is recommended that you check the status of steps by referring to the output of the jobs. For example, MapReduce jobs use a _SUCCESS file to determine if the job completes successfully. It is recommended that you set ActionOnFailure parameter to CONTINUE, or CANCEL_AND_WAIT, instead of TERMINATE_JOB_FLOW, or TERMINATE_CLUSTER. Unsupported Features in an EMR Cluster with Multiple Master Nodes The following EMR features are currently not available in an EMR cluster with multiple master nodes: EMR Notebooks Instance fleets Note To use Kerberos authentication in your cluster, you must configure an external KDC. Beginning with Amazon EMR version 5.27.0, you can configure HDFS Transparent encryption on an EMR cluster with multiple master nodes. For more information, see Transparent Encryption in HDFS on Amazon EMR . 58
Image of page 64
Amazon EMR Management Guide Launching an EMR Cluster with Multiple Master Nodes Launching an EMR Cluster with Multiple Master Nodes This topic provides configuration details and examples for launching an EMR cluster with multiple master nodes. Prerequisites You can launch an EMR cluster with multiple master nodes in both public and private VPC subnets. EC2-Classic is not supported. To launch an EMR cluster with multiple master nodes in a public subnet, you must enable the instances in this subnet to receive a public IP address by selecting Auto-assign IPv4 in the console or running the following command. Replace 22XXXX01 with your subnet ID. aws ec2 modify-subnet-attribute --subnet-id subnet- 22XXXX01 --map-public-ip-on-launch To run Hive, Hue, or Oozie on an EMR cluster with multiple master nodes, you must create an external metastore. For more information, see Configuring an External Metastore for Hive , Using Hue with a Remote Database in Amazon RDS , or Apache Oozie .
Image of page 65
Image of page 66

You've reached the end of your free preview.

Want to read all 395 pages?

  • Spring '12
  • LauraParker
  • Amazon Web Services, Amazon Elastic Compute Cloud

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern

Ask Expert Tutors You can ask You can ask ( soon) You can ask (will expire )
Answers in as fast as 15 minutes