sqsCreateQueue Resource arnawssqs us west 2 123456789012 EMRFS Inconsistency

Sqscreatequeue resource arnawssqs us west 2

This preview shows page 192 - 195 out of 395 pages.

"sqs:CreateQueue" ], "Resource": "arn:aws:sqs: us-west-2 : 123456789012 :EMRFS-Inconsistency-*" } } Archiving Log Files to Amazon S3 The following policy statement allows the Amazon EMR cluster to archive log files to the Amazon S3 location specified. In the example below, when the cluster was created, s3://MyLoggingBucket/ MyEMRClusterLogs was specified using the Log folder S3 location in the console, using the --log- uri option from the AWS CLI, or using the LogUri parameter in the RunJobFlow command. For more information, see Archive Log Files to Amazon S3 (p. 137) . { "Version": "2012-10-17", "Statement": [ 186
Image of page 192
Amazon EMR Management Guide Configure Service Roles for Amazon EMR { "Effect": "Allow", "Action": "s3:PutObject", "Resource": "arn:aws:s3::: MyLoggingBucket/MyEMRClusterLogs /*" } ] } Using the Debugging Tools The following policy statement allows actions that are required if you enable the Amazon EMR debugging tool. Archiving log files to Amazon S3, and the associated permissions shown in the example above, are required for debugging. For more information, see Enable the Debugging Tool (p. 138) . { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "sqs:GetQueueUrl", "sqs:SendMessage" ], "Resource": "arn:aws:sqs: us-west-2 : 123456789012 :AWS-ElasticMapReduce-*" } ] } Using the AWS Glue Data Catalog The following policy statement allows actions that are required if you use the AWS Glue Data Catalog as the metastore for applications. For more information, see Using the AWS Glue Data Catalog as the Metastore for Spark SQL , Using the AWS Glue Data Catalog as the Metastore for Hive , and Using Presto with the AWS Glue Data Catalog in the Amazon EMR Release Guide . { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Resource": "*", "Action": [ "glue:CreateDatabase", "glue:UpdateDatabase", "glue:DeleteDatabase", "glue:GetDatabase", "glue:GetDatabases", "glue:CreateTable", "glue:UpdateTable", "glue:DeleteTable", "glue:GetTable", "glue:GetTables", "glue:GetTableVersions", "glue:CreatePartition", "glue:BatchCreatePartition", "glue:UpdatePartition", "glue:DeletePartition", "glue:BatchDeletePartition", "glue:GetPartition", "glue:GetPartitions", "glue:BatchGetPartition", 187
Image of page 193
Amazon EMR Management Guide Configure Service Roles for Amazon EMR "glue:CreateUserDefinedFunction", "glue:UpdateUserDefinedFunction", "glue:DeleteUserDefinedFunction", "glue:GetUserDefinedFunction", "glue:GetUserDefinedFunctions" ] } ] } Service Role for Automatic Scaling in EMR (Auto Scaling Role) The auto scaling role for EMR performs a similar function as the service role, but allows additional actions for dynamically scaling environments. The default role is EMR_AutoScaling_DefaultRole . The default managed policy attached to EMR_AutoScaling_DefaultRole is AmazonElasticMapReduceforAutoScalingRole . The contents of version 1 of AmazonElasticMapReduceforAutoScalingRole are shown below. { "Version": "2012-10-17", "Statement": [ { "Action": [ "cloudwatch:DescribeAlarms", "elasticmapreduce:ListInstanceGroups", "elasticmapreduce:ModifyInstanceGroups" ], "Effect": "Allow", "Resource": "*" } ] } Service Role for EMR Notebooks Each EMR notebook needs permissions to access other AWS resources and perform actions. The IAM
Image of page 194
Image of page 195

You've reached the end of your free preview.

Want to read all 395 pages?

  • Spring '12
  • LauraParker
  • Amazon Web Services, Amazon Elastic Compute Cloud

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern

Ask Expert Tutors You can ask You can ask ( soon) You can ask (will expire )
Answers in as fast as 15 minutes