Oracle Data Integrator (ODI) 11g : Architecture & Installation Overview

Oracle Data Integrator (ODI) is an E-LT (Extract – Load & Transform) based data transformation and integration tool. This post covers overview (and architecture) of ODI 11g, for ODI 10g (earlier Sunopsis) click here

ODI consists of following components

1. ODI Studio – is a design time components which consists of Designer, Operator, Topology and Security Navigator. This is developer tool and used mainly by developers and administrators to develop and manage ODI . ODI studio is NOT required at run time.

2. Agents – This is run time component which connects to repository and executes the code . Agents also records execution time, logging, and messages for each execution. Agents are of two type a) Standalone Agents b) Java EE agents.

Both type of agents are mulct threaded java programs and can be configured for high availability. Java EE agents require WebLogic Server where as Standalone Agents run in their own JVM container (no application server is required for standalone agent)

3. ODI Repository– is database schema which contains configuration information, metadata, project scenario and execution logs. ODI repository consists of one Master Repository and multiple Work Repository.

a) Master Repository – contains security information (users, profiles, access rights), topology definition (server , schemas, contexts, languages), versions and achieved objects.
b) Work Repository – contains developed objects like Models, Projects and Scenario execution.

Execution Repository – This is work repository which contains only execution information like for production environment.

4. ODI Console– is a Web based User Interface (accessible via browser) which can be used to perform topology configuration, production operations and read access to ODI repository. ODI Console is a web application and can be deployed on J2EE application server like Oracle WebLogic Server.

5. Public Web Services– ODI comes with several run-time service like a) “Public Web Service” b) “Agent Web Service” which can be deployed and executed from J2EE Application Server like Oracle WebLogic Server. Agent Web Service can also be invoked from Standalone Agent.

a) Public Web Service connects to ODI repository to retrieve list of contexts and scenarios in ODI
b) Agent Web Service commands the ODI Agent (Standalone and Java EE) to start and monitor a scenario in ODI.

Key points for Installing ODI 11g

1.You can install ODI 11g with or without WebLogic (depending on components you select). If you planning to use Java EE Agents, ODI Console, or Public Web Services then WebLogic Server is required.

2.If you are planning to use WebLogic Server (Java EE Agent or ODI Console) on 64 bit machine then use JAR version of WebLogic Server. More here to install WebLogic on 32 bit machine click here

3. Oracle Database is required for Master and Work Repository

4. Master and Work Repository Schema can be created using Repository Creation Utility (RCU). More on RCU here here

5. ODI Installation Type consists of
a) Developer Installation (ODI Studio, ODI SDK)
b) Standalone Installation (ODI Installation Agent)
c) Java EE Installation (Java EE Agent, ODI Console, Public Web Service)

High Level Installation steps for ODI

1. Create a database which will hold Master and Work Repository schema

2. Run RCU schema to create master repository

3. If you are planning to use Java EE Agents, ODI Console or Public Web Service then install WebLogic Server

4. Install ODI software (ODI Studio, ODI SDK, ODI Standalone Agent, Java EE Agent, ODI Console, Public web Service). Note : ODI Studio and ODI SDK is required only for development environments. There is no need to install ODI Studio or ODI SDK on production instance. You can use either Standalone Agent or Java EE Agent or both in production environment.

5. If you wish to use Java EE Agent, ODI Console, or Public web Service then create WebLogic Domain and select these components from Domain Template.

6. If you are using Standalone Agents you can additionally configure Oracle Process Manager and Notification (OPMN) server to manage (start, stop, restart) Standalone Agent

Related/References

Configure High Availability for Java EE Agents (in Active Active cluster) coming soon.

About the Author Atul Kumar

Oracle ACE, Author, Speaker and Founder of K21 Technologies & K21 Academy : Specialising in Design, Implement, and Trainings.

follow me on:

Leave a Comment:

17 comments

Parag says August 22, 2011

Hi Atul,

Thanks for the providing the summary for ODI installation tasks. I am wondering if you can share thoughts on below:-

#1. The criteria to select Standalone agent or Java EE agent?

#2. Assuming standalone agent is deployed in a virtualized environment (hosted on 2 physical boxes)for the DW (oracle RAC environment), does it makes sense to deploy JAVA EE agent on weblogic for the scalability & HA as provided by JAVA EE agent?

#3. Any known issues for standalone agent deployment in virtual enviroment or for target which is on clustered database?

#4. How is the scheduling done in case of a standalone agent? Is there need to have any external scheduler?

Regards

Parag

» Installing ODI 11g (including Agents) in High Availability (Active-Active Cluster) : Overview Online Apps DBA: One Stop Shop for Apps DBA’s says August 24, 2011

[…] This post covers deploying Oracle Data Integrator (ODI) in High Availability (HA) setup, for overview of ODI 11g components check my previous post here […]

Atul Kumar says August 25, 2011

@ Parag,

#1. The criteria to select Standalone agent or Java EE agent?

Java EE agent give benefit of HA & clustering.

A: Yes so instead of putting them (standalone agents in two RAC nodes , deploy J2EE agent on apps tier in active-active weblogic cluster. coherence will take of job scheduler.

Look at my post http://onlineappsdba.com/index.php/2011/08/24/installing-odi-11g-including-agents-in-high-availability-active-active-cluster-overview/

#3. Any known issues for standalone agent deployment in virtual enviroment or for target which is on clustered database?

A3: nothing which I am aware of, please search metalink (MOS)

#4. How is the scheduling done in case of a standalone agent? Is there need to have any external scheduler?

A4: Schedule this via ODI design tool

Parag says August 30, 2011

Thank you Atul. Link to your earlier post quite useful 🙂

HueTechnician says September 9, 2011

Hi, Atul.
I can`t find an answer to my question anywhere: does it make sense to insert ODI as a intermediate layer between web-services and database on the late stage of project development? Is it really worth trying in order to stop webservices from drawing data every second from DB?

Thanks in advance.

Atul Kumar says September 12, 2011

@ HueTechnician, It is difficult to answer your query without understanding proper requirement. Any thing at late stage of development life cycle is risk (provided there are valid reasons to introduce something new)

Naveen says October 3, 2011

Hi! Atul,

I was trying to create RCU Schemas for ODI Product using the silent mode, but was getting the following error:
Value of Custom Variable Master Repository ID(001) is invalid. Value should be a number.
RCU-6091:Component name/schema prefix validation failed.

I couldn’t understand how can I specify value for the Master Repo ID in the /rcu/integration/odi/odi_ComponentInfo.xml file. Pls. guide me.

Thanks,
Naveen.

Naveen says October 3, 2011

Hi! Atul,

This is the continuation of my earlier post.

I used the following command to run the RCU tool from command line:
./rcu -silent -createRepository -databaseType ORACLE -connectString $CONECTION_STRING -dbUser $DB_USER_NAME -dbRole SYSDBA -schemaPrefix $DB_NEW_PREFIX_NAME -component ODI -f < $DB_PASSWORD_FILE_PATH

Pls. guide me.

Regards,
Naveen.

Naveen says October 3, 2011

Hi! Atul,

This is the continuation of my earlier Query.

I used the following command to run the RCU tool from command line:
,/rcu -silent -createRepository -databaseType ORACLE -connectString $CONECTION_STRING -dbUser $DB_USER_NAME -dbRole SYSDBA -schemaPrefix $DB_NEW_PREFIX_NAME -component ODI -f < $DB_PASSWORD_FILE_PATH

Pls. guide me.

Regards,
Naveen.

» How to access ODI Studio on Linux Online Apps DBA: One Stop Shop for Apps DBA’s says February 29, 2012

[…] How to access ODI Studio on Linux Posted in February 29th, 2012 byAtul Kumar in odi Print This Post Oracle Data Integrator (ODI) Studio is used by Developers and Administrators to access ODI Repository (Master and Work Repository) […]

Rajarshi says September 4, 2012

Hi Atul,

I am using ODI Console in my machine whereas the Weblogic Server is in another machine. I am trying to call Web Service via ODI Invoke tool. But getting error like “javax.xml.ws.WebServiceException: java.lang.NoClassDefFoundError: Could not initialize class com.sun.xml.internal.ws.fault.SOAPFaultBuilder
”
Can you please tell me what might be the resonds behind this?
I checked that, in my local machine, there is not Java path included in PATH variable. Any issue related with that? and JAVA_HOME is not set up also in my local machine.
But the same Web Service can be called from Oracle SOA.

Thanks a ton for your help.

athide says July 29, 2013

Hi Atul

I need to install the ODI 11g on server(Linux) client (windows) model. Please provide the installation steps.
Thanks
athide

Atul Kumar says July 29, 2013

@ athide,
Follow steps as mentioned in ODI installation guide http://docs.oracle.com/cd/E28280_01/install.1111/e16453/overview.htm#CEGJJIFH

any doubts then post them as comments here

Lukas says June 16, 2015

Hi Atul,
can i install ODI 10g with Hyperion Planning 11g on one machine, Win 2008R2 x64 ?

Santhosh says July 29, 2015

I am very new to this software, Please enlighten me in , how to get the work repository details in ODI Console.

I have developed some interfaces in ODI studio, later I have opened console, there I am unable to view the details of the work repository which I have created in ODI Studio.
Is there any procedure to get those details in the console.

Phani says August 21, 2015

Hi atul,
Im new to odi and wanted to know how to deploy the RCU with obiee and odi on the solaris 10 environment in production level. Please reply me asap.

Anil Reddy Gopathi says March 9, 2017

Hi, I am new to ODI, I want to learn ODI. I have experience in Oracle Golden Gate. In my present project we have ODI. so please train me where to start

Add Your Reply