EBS costs are pro rated by the hour based on the monthly Amazon EBS charges for

Ebs costs are pro rated by the hour based on the

This preview shows page 116 - 118 out of 395 pages.

their size, and the total size per instance type. EBS costs are pro-rated by the hour based on the monthly Amazon EBS charges for gp2 volumes in the region where the cluster runs. For example, the EBS cost per hour for the root volume on each cluster node in a region that charges $0.10/GB/month would be approximately $0.00139 per hour ($0.10/GB/ month divided by 30 days divided by 24h times 10 GB). Default EBS Storage Volumes and Size By Instance Type for Amazon EMR 5.22.0 and Later Instance Size Number of Volumes Volume Size (GiB) Total Size (GiB) *.large 1 32 32 *.xlarge 2 32 64 *.2xlarge 4 32 128 *.4xlarge 4 64 256 *.8xlarge 4 128 512 *.9xlarge 4 144 576 110
Image of page 116
Amazon EMR Management Guide Configure Networking Instance Size Number of Volumes Volume Size (GiB) Total Size (GiB) *.10xlarge 4 160 640 *.12xlarge 4 192 768 *.16xlarge 4 256 1024 *.18xlarge 4 288 1152 *.24xlarge 4 384 1536 Specifying Additional EBS Storage Volumes When you configure instance types in Amazon EMR, you can specify additional EBS volumes, which adds capacity beyond the instance store (if present) and the default EBS volume. Amazon EBS provides the following volume types: General Purpose (SSD), Provisioned IOPS (SSD), Throughput Optimized (HDD), Cold (HDD), and Magnetic. They differ in performance characteristics and price, so you can tailor your storage based on the analytic and business needs of your applications. For example, some applications may have a need to spill to disk while others can safely work in-memory or using Amazon S3. You can only attach EBS volumes to instances at cluster startup time unless you add an extra task node instance group, at which time you can add EBS volumes. If an instance in an EMR cluster fails, then both the instance and attached EBS volumes are replaced as new. Consequently, if you manually detach an EBS volume, Amazon EMR treats that as a failure and replaces both instance storage (if applicable) and the volume stores. Configure Networking There may be two network platform options you can choose for your cluster: EC2-Classic or EC2-VPC . In EC2-Classic, your instances run in a single, flat network that you share with other customers. EC2-Classic is available only with certain accounts in certain regions. For more information, see Amazon EC2 and Amazon VPC in the Amazon EC2 User Guide for Linux Instances . In EC2-VPC, your cluster uses Amazon Virtual Private Cloud (Amazon VPC), and EC2 instances run in a VPC that's logically isolated within your AWS account. Amazon VPC enables you to provision a virtual private cloud (VPC), an isolated area within AWS where you can configure a virtual network, controlling aspects such as private IP address ranges, subnets, routing tables, and network gateways. VPC offers the following capabilities: Processing sensitive data Launching a cluster into a VPC is similar to launching the cluster into a private network with additional tools, such as routing tables and network ACLs, to define who has access to the network. If you are processing sensitive data in your cluster, you may want the additional access control that launching your cluster into a VPC provides. Furthermore, you can choose to launch your resources into a private
Image of page 117
Image of page 118

You've reached the end of your free preview.

Want to read all 395 pages?

  • Spring '12
  • LauraParker
  • Amazon Web Services, Amazon Elastic Compute Cloud

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern

Stuck? We have tutors online 24/7 who can help you get unstuck.
A+ icon
Ask Expert Tutors You can ask You can ask ( soon) You can ask (will expire )
Answers in as fast as 15 minutes
A+ icon
Ask Expert Tutors