With Amazon EMR version 5250 or later you can access Spark history server UI

With amazon emr version 5250 or later you can access

This preview shows page 325 - 327 out of 395 pages.

With Amazon EMR version 5.25.0 or later, you can access Spark history server UI from the console without setting up a web proxy through an SSH connection. For more information, see One-click Access to Persistent Spark History Server . Topics Option 1: Set Up an SSH Tunnel to the Master Node Using Local Port Forwarding (p. 319) Option 2, Part 1: Set Up an SSH Tunnel to the Master Node Using Dynamic Port Forwarding (p. 320) Option 2, Part 2: Configure Proxy Settings to View Websites Hosted on the Master Node (p. 323) Access the Web Interfaces on the Master Node Using the Console (p. 324) Option 1: Set Up an SSH Tunnel to the Master Node Using Local Port Forwarding To connect to the local web server on the master node, you create an SSH tunnel between your computer and the master node. This is also known as port forwarding . If you do not wish to use a SOCKS proxy, you can set up an SSH tunnel to the master node using local port forwarding. With local port forwarding, you specify unused local ports that are used to forward traffic to specific remote ports on the master node's local web server. Setting up an SSH tunnel using local port forwarding requires the public DNS name of the master node and your key pair private key file. For information about how to locate the master public DNS name, see To retrieve the public DNS name of the master node using the Amazon EMR console (p. 314) . For more information about accessing your key pair, see Amazon EC2 Key Pairs in the Amazon EC2 User Guide for Linux Instances . For more information about the sites you might want to view on the master node, see View Web Interfaces Hosted on Amazon EMR Clusters (p. 318) . 319
Image of page 325
Amazon EMR Management Guide View Web Interfaces Hosted on Amazon EMR Clusters Set Up an SSH Tunnel to the Master Node Using Local Port Forwarding on Linux, Unix, and Mac OS X To set up an SSH tunnel using local port forwarding in terminal 1. Open a terminal window. On Mac OS X, choose Applications > Utilities > Terminal . On other Linux distributions, terminal is typically found at Applications > Accessories > Terminal . 2. Type the following command to open an SSH tunnel on your local machine. This command accesses the ResourceManager web interface by forwarding traffic on local port 8157 (a randomly chosen, unused local port) to port 8088 on the master node's local web server. In the command, replace ~/ mykeypair.pem with the location and file name of your .pem file and replace ec2-###-##-##- ###.compute-1.amazonaws.com with the master public DNS name of your cluster. ssh -i ~/mykeypair.pem -N -L 8157:ec2-###-##-##-###.compute-1.amazonaws.com :8088 [email protected] ec2-###-##-##-###.compute-1.amazonaws.com After you issue this command, the terminal remains open and does not return a response. Note -L signifies the use of local port forwarding which allows you to specify a local port used to forward data to the identified remote port on the master node's local web server.
Image of page 326
Image of page 327

You've reached the end of your free preview.

Want to read all 395 pages?

  • Spring '12
  • LauraParker
  • Amazon Web Services, Amazon Elastic Compute Cloud

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern

Stuck? We have tutors online 24/7 who can help you get unstuck.
A+ icon
Ask Expert Tutors You can ask You can ask ( soon) You can ask (will expire )
Answers in as fast as 15 minutes
A+ icon
Ask Expert Tutors