Page 1 of 1

Multi-instance job with Oracle source and DB2 target

Posted: Sat Feb 01, 2020 5:32 pm
by rakesh.puli
Hi

I have a requirement like to load 50 DB2 target tables from 50 Oracle source tables or source files with different schemas with only using source as Oracle connector stage.

How can I achieve this? Please let me know.

Thanks
Rakesh

Posted: Sun Feb 02, 2020 3:41 am
by chulett
Well, the short answer is RCP a.k.a. runtime column propagation, is that anything you're familiar with? And one problem will be your "or source files" statement along with "only using source as oracle connector stage". While there are ways in Oracle to read a file as if it were a table, it's what I'd call an advanced topic that I have yet to see many (any?) people use. Is that really a requirement here? :?

Posted: Sat Feb 08, 2020 5:13 pm
by rakesh.puli
Hi Chulett,

Here the source is only files, All these source files have different schemas.
But we have to read the files using the Oracle connector stage and load into target DB2 tables.

Thanks
Rakesh Puli

Posted: Sun Feb 09, 2020 3:20 am
by chulett
rakesh.puli wrote:but we have to read the files from oracle connector stage
No, no you don't. It makes zero sense. Push back on that "requirement". And still wondering if you've ever used RCP, something critical to have any chance of doing this in a generic sense. Otherwise (unless someone has other thoughts) you're back to defining a job per file schema and launching the right job for each file. AND... if for some odd reason you have no other choice than to use an Oracle connector, here is an introduction to Oracle External Tables. BUT I don't see how that won't lock you into a non-RCP / non-generic solution. :?

Posted: Tue Feb 11, 2020 1:20 pm
by asorrell
I concur with Craig.

You need to use the correct stage for the correct source / target.

1) If your source is an Oracle table, then use an Oracle Connector
2) If your source is a file, use a Sequential File stage with a schema file
3) If your target is DB2 table, use DB2 stage

If you are doing no data manipulation, this can be accomplished with two jobs using RCP.

1) One job that reads from a sequential file and dumps to DB2.
2) One job that reads from an Oracle table and dumps to DB2.

RCP can be used, assuming all source columns (fields) are represented in the target tables. All the source and target names and schema file names would have to be job parameters that are updated as required.

Posted: Sun Feb 16, 2020 1:25 am
by rakesh.puli
From your points I understand that we cannot read a file from oracle connectorstage or anyother database connector stages. We can read the file from only filestages like sequential file stage. If we read only from sequential file stage, then why we have to enable the run time column propagation and what happens if we dont enable it.

Posted: Sun Feb 16, 2020 2:02 am
by rakesh.puli
Suppose if i want to load the metadata in sequential file at source stage, I will import the metadata from the table definition and load it into the sequential file stage, but I dont understand here while loading, what is the use of enabling the rcp option? what happens if we dont enable it.