Interrupting a Resize Using Amazon EMR version 410 or later you can issue a

Interrupting a resize using amazon emr version 410 or

This preview shows page 345 - 348 out of 395 pages.

Interrupting a Resize Using Amazon EMR version 4.1.0 or later, you can issue a resize in the midst of an existing resize operation. Additionally, you can stop a previously submitted resize request or submit a new request to override a previous request without waiting for it to finish. You can also stop an existing resize from the 339
Image of page 345
Amazon EMR Management Guide Manually Resizing a Running Cluster console or using the ModifyInstanceGroups API call with the current count as the target count of the cluster. The following screenshot shows a task instance group that is resizing but can be stopped by choosing Stop . To interrupt a resize using the AWS CLI You can use the AWS CLI to stop a resize by using the modify-instance-groups subcommand. Assume that you have six instances in your instance group and you want to increase this to 10. You later decide that you would like to cancel this request: The initial request: aws emr modify-instance-groups --instance-groups InstanceGroupId=ig- myInstanceGroupId ,InstanceCount=10 The second request to stop the first request: aws emr modify-instance-groups --instance-groups InstanceGroupId=ig- myInstanceGroupId ,InstanceCount=6 Note Because this process is asynchronous, you may see instance counts change with respect to previous API requests before subsequent requests are honored. In the case of shrinking, it is possible that if you have work running on the nodes, the instance group may not shrink until nodes have completed their work. Arrested State An instance group goes into an arrested state if it encounters too many errors while trying to start the new cluster nodes. For example, if new nodes fail while performing bootstrap actions, the instance group goes into an ARRESTED state, rather than continuously provisioning new nodes. After you resolve the underlying issue, reset the desired number of nodes on the cluster's instance group, and then the instance group resumes allocating nodes. Modifying an instance group instructs Amazon EMR to attempt to provision nodes again. No running nodes are restarted or terminated. In the AWS CLI, the list-instances subcommand returns all instances and their states as does the describe-cluster subcommand. If Amazon EMR detects a fault with an instance group, it changes the group's state to ARRESTED . To reset a cluster in an ARRESTED state using the AWS CLI Type the describe-cluster subcommand with the --cluster-id parameter to view the state of the instances in your cluster. To view information on all instances and instance groups in a cluster, type the following command and replace j-3KVXXXXXXY7UG with the cluster ID. aws emr describe-cluster --cluster-id j-3KVXXXXXXY7UG The output displays information about your instance groups and the state of the instances: { "Cluster": { 340
Image of page 346
Amazon EMR Management Guide Manually Resizing a Running Cluster "Status": { "Timeline": { "ReadyDateTime": 1413187781.245, "CreationDateTime": 1413187405.356 }, "State": "WAITING", "StateChangeReason": { "Message": "Waiting after step completed" } }, "Ec2InstanceAttributes": { "Ec2AvailabilityZone": "us-west-2b" }, "Name": "Development Cluster", "Tags": [],
Image of page 347
Image of page 348

You've reached the end of your free preview.

Want to read all 395 pages?

  • Spring '12
  • LauraParker
  • Amazon Web Services, Amazon Elastic Compute Cloud

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern

Stuck? We have tutors online 24/7 who can help you get unstuck.
A+ icon
Ask Expert Tutors You can ask You can ask ( soon) You can ask (will expire )
Answers in as fast as 15 minutes
A+ icon
Ask Expert Tutors