Oozie Installation

This post is an attempt to provide you with a very consolidated list of commands that are required to install Oozie, since the documentation involves many optional steps and requires you to refine lot many links to get to correct procedure.

As mentioned in my previous post, Oozie has two flavors, one is the Cloudera distribution and the other is the Yahoo distribution. This post is an attempt to state Cloudera Oozie's installation using two methods :

• Installing Oozie debian package
• Installing Oozie tarball 

Installing Cloudera's Oozie

Prerequisites

• A Unix-like system (tested on Centos 5.5, Ubuntu 9.10+, SUSE Linux Enterprise Server 11, OS X 10.6)
• Java 1.6+ (tested with JRE 1.6.0_20)
• A Unix user and group named oozie on your machine

Installing Oozie debian package

The Oozie debian package for installing Oozie has separate packages for Oozie server(oozie) and the client(oozie-client). 

  1. Download them from the following link :

• http://archive.cloudera.com/debian/pool/contrib/o/

  
  2. Before proceeding further, it is required to install the Cloudera's Yum, for which you need to add a repository by creating a new file (a normal text file named cloudera.list) /etc/apt/sources.list.d/cloudera.list with the following two lines of content.

• deb http://archive.cloudera.com/debian <RELEASE>-cdh3 contrib
• deb-src http://archive.cloudera.com/debian <RELEASE>-cdh3 contrib

where <RELEASE> is to be replaced by the output of the command lsb_release -c.

  
  3. Run the following command

$ sudo apt-get update

  4. After this simply install the oozie server and client using the debian packages.  

  5. Start the oozie server using

• $ sudo -u oozie /usr/lib/oozie/bin/oozie-start.sh

  6. Stop the oozie server

• $ sudo -u oozie /usr/lib/oozie/bin/oozie-stop.sh

Installing Oozie Tarball

  1. Download the Oozie tarball(ver Oozie 2.3.0+31.2) from :

• https://ccp.cloudera.com/display/SUPPORT/CDH3+Downloadable+Tarballs

  
  2. Unpack the tarball in the appropriate directory. For example: 

• $ (cd /home/abc/ && sudo tar -zxvf <PATH_TO_OOZIE_TAR_GZ>)

  
  3. Change ownership of the Oozie installation to oozie:oozie:

• $ sudo chown -R oozie:oozie /home/abc/oozie-2.3.0+31.2

This installs both the client and the server and the directory contains all the necessary client and server files. 

  
  4. Start the oozie server

• $ sudo -u oozie /home/abc/oozie-*/bin/oozie-start.sh

  5. Stop the oozie server

• $ sudo -u oozie /home/abc/oozie-*/bin/oozie-stop.sh

Oozie Web Console

Though it is optional to use the web console, and there are command line utilities that can be used instead, I would recommend installing it as it presents a very clear picture of the running oozie jobs and is very easy to install.

  1. Download the ExtJS library from

• http://extjs.com/deploy/ext-2.2.zip

  
  2. Place it in a convinient location and add to Oozie through this command

• $ sudo -u oozie /usr/lib/oozie/bin/oozie-setup.sh -extjs /path_to_ExtJS/ext-2.2.z

                          or 

• $ sudo -u oozie /home/abc/oozie-*/bin/oozie-setup.sh -extjs /path_to_ExtJS/ext-2.2.zip

  
  3. Having done this, after starting the oozie server as described above , you can view the console at :

• http://localhost:11000/oozie

That's all about installing Oozie, my next post would be on how to run an oozie sample application.