281 instance type m5xlarge emrfs Consistent true

281 instance type m5xlarge emrfs consistent true

This preview shows page 75 - 78 out of 395 pages.

emr-5.28.1 --instance-type m5.xlarge \ --emrfs Consistent= true ,Args=[fs.s3.consistent.metadata.read.capacity= 600 ,\ fs.s3.consistent.metadata.write.capacity= 300 ] --ec2-attributes KeyName= myKey 69
Image of page 75
Amazon EMR Management Guide Consistent View Alternatively, use the following configuration file and save it locally or in Amazon S3: [ { "Classification": "emrfs-site", "Properties": { "fs.s3.consistent.metadata.read.capacity": "600", "fs.s3.consistent.metadata.write.capacity": "300" } } ] Use the configuration you created with the following syntax: aws emr create-cluster --release-label emr-5.28.1 --applications Name=Hive \ --instance-type m5.xlarge --instance-count 2 --configurations Note Linux line continuation characters (\) are included for readability. They can be removed or used in Linux commands. For Windows, remove them or replace with a caret (^). The following options can be set using configurations or AWS CLI --emrfs arguments. For information about those arguments, see the AWS CLI Command Reference . emrfs-site.xml properties for consistent view Property Default value Description fs.s3.consistent false When set to true , this property configures EMRFS to use DynamoDB to provide consistency. fs.s3.consistent.retryPolicyType exponential This property identifies the policy to use when retrying for consistency issues. Options include: exponential, fixed, or none. fs.s3.consistent.retryPeriodSeconds 1 This property sets the length of time to wait between consistency retry attempts. fs.s3.consistent.retryCount 10 This property sets the maximum number of retries when inconsistency is detected. fs.s3.consistent.throwExceptionOnInconsistency true This property determines whether to throw or log a consistency exception. When set to true , a ConsistencyException is thrown. fs.s3.consistent.metadata.autoCreate true When set to true , this property enables automatic creation of metadata tables. fs.s3.consistent.metadata.etag.verification.enabled false With Amazon EMR 5.29.0., this property defaults to true. When enabled, EMRFS uses S3 ETags 70
Image of page 76
Amazon EMR Management Guide Consistent View Property Default value Description to verify that objects being read are the latest available version. This feature is helpful for read- after-update use cases in which files on S3 are being overwritten while retaining the same name. This ETag verification capability currently does not work with S3 Select. fs.s3.consistent.metadata.tableName EmrFSMetadata This property specifies the name of the metadata table in DynamoDB. fs.s3.consistent.metadata.read.capacity 500 This property specifies the DynamoDB read capacity to provision when the metadata table is created. fs.s3.consistent.metadata.write.capacity 100 This property specifies the DynamoDB write capacity to provision when the metadata table is created.
Image of page 77
Image of page 78

You've reached the end of your free preview.

Want to read all 395 pages?

  • Spring '12
  • LauraParker
  • Amazon Web Services, Amazon Elastic Compute Cloud

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern

Stuck? We have tutors online 24/7 who can help you get unstuck.
A+ icon
Ask Expert Tutors You can ask You can ask ( soon) You can ask (will expire )
Answers in as fast as 15 minutes
A+ icon
Ask Expert Tutors