11-oozie-notes - Oozie Oozie Workflow Overview Purpose...

This preview shows page 1 - 10 out of 25 pages.

Oozie
Image of page 1

Subscribe to view the full document.

Image of page 2
Image of page 3

Subscribe to view the full document.

Oozie Workflow Overview Purpose: Execution of workflows on the Grid Oozie Hadoop/Pig/HDFS DB WS API Tomcat web-app
Image of page 4
Image of page 5

Subscribe to view the full document.

Image of page 6
Oozie Workflow Example <workflow- app name=’wordcount - wf’> <start to=‘wordcount’/> <action name=’wordcount'> <map-reduce> <job-tracker>foo.com:9001</job-tracker> <name-node>hdfs://bar.com:9000</name-node> <configuration> <property> <name>mapred.input.dir</name> <value> ${inputDir} </value> </property> <property> <name>mapred.output.dir</name> <value> ${outputDir} </value> </property> </configuration> </map-reduce> <ok to=’end'/> <error to=’kill'/> </action> <kill name=‘kill’/> <end name=‘end’/> </workflow-app> Start M-R wordcount End OK Start Kill Error
Image of page 7

Subscribe to view the full document.

Oozie Workflow Nodes Control Flow: start/end/kill decision fork/join Actions: map-reduce pig hdfs sub-workflow java run custom Java code
Image of page 8
Oozie Workflow Application A HDFS directory containing: Definition file: workflow.xml Configuration file: config-default.xml App files: lib/ directory with JAR and SO files Pig Scripts
Image of page 9

Subscribe to view the full document.

Image of page 10
  • Spring '16
  • dncj ncnd
  • Computer program, Oozie Workflow

{[ snackBarMessage ]}

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern