For more information see Amazon S3 Pricing and AWS Free Tier If you are

For more information see amazon s3 pricing and aws

This preview shows page 17 - 19 out of 395 pages.

AWS Free Tier. For more information, see Amazon S3 Pricing and AWS Free Tier . If you are considering Amazon EMR in a production capacity, use the AWS Simple Monthly Calculator to estimate your costs. Steps in This Tutorial Step 1: Set Up Prerequisites for Your Sample Cluster (p. 11) Step 2: Launch Your Sample Amazon EMR Cluster (p. 12) Step 3: Allow SSH Connections to the Cluster From Your Client (p. 16) Step 4: Process Data By Running The Hive Script as a Step (p. 18) Step 5: Terminate the Cluster and Delete the Bucket (p. 21) Step 1: Set Up Prerequisites for Your Sample Cluster Before you begin setting up your Amazon EMR cluster, make sure that you complete the prerequisites in this topic. Sign Up for AWS If you do not have an AWS account, complete the following steps to create one. To sign up for an AWS account 1. Open . 2. Follow the online instructions. Part of the sign-up procedure involves receiving a phone call and entering a verification code on the phone keypad. 11
Image of page 17
Amazon EMR Management Guide Create an Amazon S3 Bucket Create an Amazon S3 Bucket In this tutorial, you specify an Amazon S3 bucket and folder to store the output data from a Hive query. The tutorial uses the default log location, but you can also specify a custom location if you prefer. Because of Hadoop requirements, bucket and folder names that you use with Amazon EMR have the following limitations: They must contain only letters, numbers, periods (.), and hyphens (-). They cannot end in numbers. If you already have access to a folder that meets these requirements, you can use it for this tutorial. The output folder should be empty. Another requirement to remember is that bucket names must be unique across all AWS accounts . For more information about creating a bucket, see Create a Bucket in the Amazon Simple Storage Service Getting Started Guide . After you create the bucket, choose it from the list and then choose Create folder , replace New folder with a name that meets the requirements, and then choose Save . The bucket and folder name used later in the tutorial is s3://mybucket/MyHiveQueryResults . Create an Amazon EC2 Key Pair You must have an Amazon Elastic Compute Cloud (Amazon EC2) key pair to connect to the nodes in your cluster over a secure channel using the Secure Shell (SSH) protocol. If you already have a key pair that you want to use, you can skip this step. If you don't have a key pair, follow one of the following procedures depending on your operating system. Creating Your Key Pair Using Amazon EC2 in the Amazon EC2 User Guide for Windows Instances Creating Your Key Pair Using Amazon EC2 in the Amazon EC2 User Guide for Linux Instances . Use this procedure for Mac OS as well. Step 2: Launch Your Sample Amazon EMR Cluster In this step, you launch your sample cluster by using Quick Options in the Amazon EMR console and leaving most options to their default values. To learn more about these options, see Summary of Quick Options (p. 13) after the procedure. You can also select Go to advanced options to explore the additional configuration options available for a cluster. Before you create your cluster for this
Image of page 18
Image of page 19

You've reached the end of your free preview.

Want to read all 395 pages?

  • Spring '12
  • LauraParker
  • Amazon Web Services, Amazon Elastic Compute Cloud

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern

Ask Expert Tutors You can ask You can ask ( soon) You can ask (will expire )
Answers in as fast as 15 minutes