To view history server pages on the cluster master node you must set up an SSH

To view history server pages on the cluster master

This preview shows page 35 - 38 out of 395 pages.

To view history server pages on the cluster master node, you must set up an SSH client and proxy as appropriate. For more information, see View Web Interfaces Hosted on Amazon EMR Clusters (p. 318) . To view logs in Amazon S3, cluster logging must be enabled, which is the default for new clusters. For more information, see View Log Files Archived to Amazon S3 (p. 285) . The following is an example of the Spark job monitoring widget. 29
Image of page 35
Amazon EMR Management Guide Security EMR Notebooks Security and Access Control Several features are available to help you tailor the security posture of EMR Notebooks. This helps ensure that only authorized users have access to an EMR notebook, can work with notebooks, and use the notebook editor to execute code on the cluster. These features work along with the security features available for Amazon EMR and Amazon EMR clusters. For more information, see Security in Amazon EMR (p. 145) . You can use AWS Identity and Access Management policy statements together with notebook tags to limit access. For more information, see Condition Keys (p. 176) and Example Identity-Based Policy Statements for EMR Notebooks (p. 210) . EC2 security groups act as virtual firewalls that control network traffic between the cluster's master instance and the notebook editor. You can use defaults or customize these security groups. For more information, see Specifying EC2 Security Groups for EMR Notebooks (p. 266) . You specify an AWS Service Role that determines what permissions an EMR notebook has when interacting with other AWS services. For more information, see Service Role for EMR Notebooks (p. 188) . 30
Image of page 36
Amazon EMR Management Guide Using Notebook-Scoped Libraries Using Notebook-Scoped Libraries If the default libraries available with EMR Notebooks on your cluster are not sufficient for your application, with Amazon EMR 5.26.0 and later, you can install notebook-scoped Python libraries from within the notebook editor from public or private Python Package Index (PyPI) repositories. Notebook- scoped libraries are installed in a virtual Python environment scoped to the current notebook session. They are available only during the notebook session. After the session ends, the libraries are deleted. Subsequent sessions are not able to use the libraries. To have libraries available across EMR notebook sessions, you can install them on cluster instances using a bootstrap action or a custom Amazon Linux AMI for EMR. For more information, see Create Bootstrap Actions to Install Additional Software (p. 100) and Using a Custom AMI (p. 93) . Notebook-scoped libraries provide the following benefits: You can use libraries in an EMR notebook without having to re-create the cluster or re-attach the notebook to a cluster. You can isolate library dependencies of an EMR notebook to the individual notebook session. The libraries installed from within the notebook cannot interfere with other libraries on the cluster or libraries installed within other notebook sessions.
Image of page 37
Image of page 38

You've reached the end of your free preview.

Want to read all 395 pages?

  • Spring '12
  • LauraParker
  • Amazon Web Services, Amazon Elastic Compute Cloud

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern

Stuck? We have tutors online 24/7 who can help you get unstuck.
A+ icon
Ask Expert Tutors You can ask You can ask ( soon) You can ask (will expire )
Answers in as fast as 15 minutes
A+ icon
Ask Expert Tutors