aws emr modify cluster attributes cluster id j 3KVTXXXXXX7UG no termination

Aws emr modify cluster attributes cluster id j

This preview shows page 66 - 68 out of 395 pages.

aws emr modify-cluster-attributes --cluster-id j-3KVTXXXXXX7UG --no-termination-protected aws emr terminate-clusters --cluster-id j-3KVTXXXXXX7UG Considerations and Best Practices Limitations of an EMR cluster with multiple master nodes: If any two master nodes fail simultaneously, EMR cannot recover the cluster. EMR clusters with multiple master nodes are not tolerant to Availability Zone failures. In the case of an Availability Zone outage, you lose access to the EMR cluster. EMR does not guarantee the high availability features of open-source applications other than the ones specified in Supported Applications in an EMR Cluster with Multiple Master Nodes (p. 55) . Considerations for configuring subnet: 60
Image of page 66
Amazon EMR Management Guide EMR Clusters on AWS Outposts An EMR cluster with multiple master nodes can reside only in one Availability Zone or subnet. EMR cannot replace a failed master node if the subnet is fully utilized or oversubscribed in the event of a failover. To avoid this scenario, it is recommended that you dedicate an entire subnet to an Amazon EMR cluster. In addition, make sure that there are enough private IP addresses available in the subnet. Considerations for configuring core nodes: To ensure the core node instance group is also highly available, it is recommended that you launch at least four core nodes. If you decide to launch a smaller cluster with three or fewer core nodes, configure HDFS with sufficient DFS replication by setting dfs.replication parameter to at least 2. For more information, see HDFS Configuration . Considerations for Setting Alarms on Metrics: EMR currently does not provide application specific metrics about HDFS or YARN. It is recommended that you set up alarms to monitor the master node instance count. You can configure the alarms using the following CloudWatch metrics: MultiMasterInstanceGroupNodesRunning , MultiMasterInstanceGroupNodesRunningPercentage , or MultiMasterInstanceGroupNodesRequested . You will be notified in the case of master node failure and replacement. For example, If the MultiMasterInstanceGroupNodesRunningPercentage is lower than 1.0 and greater than 0.5, the cluster may have lost a master node. In this situation, EMR attempts to replace a master node. If the MultiMasterInstanceGroupNodesRunningPercentage drops below 0.5, two master nodes may have failed. In this situation, the quorum is lost and the cluster cannot be recovered. Manual intervention is required to migrate data off of this cluster. For more information, see Setting Alarms on Metrics . EMR Clusters on AWS Outposts Beginning with Amazon EMR version 5.28.0, you can create and run EMR clusters on AWS Outposts. AWS Outposts enables native AWS services, infrastructure, and operating models in on-premises facilities. In AWS Outposts environments, you can use the same AWS APIs, tools, and infrastructure that you use in the AWS Cloud. Amazon EMR on AWS Outposts is ideal for low latency workloads that need to be run in close proximity to on-premises data and applications. For more information about AWS Outposts, see
Image of page 67
Image of page 68

You've reached the end of your free preview.

Want to read all 395 pages?

  • Spring '12
  • LauraParker
  • Amazon Web Services, Amazon Elastic Compute Cloud

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern

Stuck? We have tutors online 24/7 who can help you get unstuck.
A+ icon
Ask Expert Tutors You can ask You can ask ( soon) You can ask (will expire )
Answers in as fast as 15 minutes
A+ icon
Ask Expert Tutors