xlarge Market ONDEMAND 1 1 Status

Xlarge market ondemand 1 1 status

This preview shows page 282 - 285 out of 395 pages.

"InstanceType": "m5.xlarge", "Market": "ON_DEMAND", "RunningInstanceCount": 1 }, { "RequestedInstanceCount": 1, "Status": { "Timeline": { "ReadyDateTime": 1438281023.879, "CreationDateTime": 1438280702.499 }, "State": "RUNNING", "StateChangeReason": { "Message": "" } }, "Name": "MASTER", "InstanceGroupType": "MASTER", "Id": "ig-2A1234567XP", "Configurations": [], "InstanceType": "m5.xlarge", "Market": "ON_DEMAND", "RunningInstanceCount": 1 } ], "Applications": [ { "Version": "1.0.0", 276
Image of page 282
Amazon EMR Management Guide View Cluster Status and Details "Name": "Hive" }, { "Version": "2.6.0", "Name": "Hadoop" }, { "Version": "0.14.0", "Name": "Pig" }, { "Version": "1.4.1", "Name": "Spark" } ], "BootstrapActions": [], "MasterPublicDnsName": "ec2-X-X-X-X.compute-1.amazonaws.com", "AutoTerminate": false, "Id": "j-jobFlowID", "Configurations": [ { "Properties": { "hadoop.security.groups.cache.secs": "250" }, "Classification": "core-site" }, { "Properties": { "mapreduce.tasktracker.reduce.tasks.maximum": "5", "mapred.tasktracker.map.tasks.maximum": "2", "mapreduce.map.sort.spill.percent": "90" }, "Classification": "mapred-site" }, { "Properties": { "hive.join.emit.interval": "1000", "hive.merge.mapfiles": "true" }, "Classification": "hive-site" } ] } } Example Listing Clusters by Creation Date To retrieve clusters created within a specific data range, use the list-clusters command with the -- created-after and --created-before parameters. The following command lists all clusters created between October 09, 2014 and October 12, 2014. aws emr list-clusters --created-after 2014-10-09T00:12:00 --created- before 2014-10-12T00:12:00 Example Listing Clusters by State To list clusters by state, use the list-clusters command with the --cluster-states parameter. Valid cluster states include: STARTING, BOOTSTRAPPING, RUNNING, WAITING, TERMINATING, TERMINATED, and TERMINATED_WITH_ERRORS. aws emr list-clusters --cluster-states TERMINATED 277
Image of page 283
Amazon EMR Management Guide Enhanced Step Debugging You can also use the following shortcut parameters to list all clusters in the states specified.: --active filters clusters in the STARTING,BOOTSTRAPPING, RUNNING, WAITING, or TERMINATING states. --terminated filters clusters in the TERMINATED state. --failed parameter filters clusters in the TERMINATED_WITH_ERRORS state. The following commands return the same result. aws emr list-clusters --cluster-states TERMINATED aws emr list-clusters --terminated Enhanced Step Debugging If an Amazon EMR step fails and you submitted your work using the Step API operation with an AMI of version 5.x or later, Amazon EMR can identify and return the root cause of the step failure in some cases, along with the name of the relevant log file and a portion of the application stack trace via API. For example, the following failures can be identified: A common Hadoop error such as the output directory already exists, the input directory does not exist, or an application runs out of memory. Java errors such as an application that was compiled with an incompatible version of Java or run with a main class that is not found. An issue accessing objects stored in Amazon S3.
Image of page 284
Image of page 285

You've reached the end of your free preview.

Want to read all 395 pages?

  • Spring '12
  • LauraParker
  • Amazon Web Services, Amazon Elastic Compute Cloud

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern

Stuck? We have tutors online 24/7 who can help you get unstuck.
A+ icon
Ask Expert Tutors You can ask You can ask ( soon) You can ask (will expire )
Answers in as fast as 15 minutes
A+ icon
Ask Expert Tutors