DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 595 matches
Author Message
 Topic: Slowly Changing Dimension stage: Anybody encountered this?
abc123

Replies: 0
Views: 387

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Nov 08, 2018 5:40 pm   Subject: Slowly Changing Dimension stage: Anybody encountered this?
DataStage® Release: 9x
Job Type: Parallel
OS: Unix
I have a dimension table (Dim1) being updated using Type 2. The existing data of Dim1 (based on certain criteria) is being used as the Reference set (Ref1).

Between runs of the DataStage job to lo ...
 Topic: Default Date format
abc123

Replies: 2
Views: 1463

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Nov 14, 2016 7:26 pm   Subject: Default Date format
When you wrote to the dataset, what data type did you write it as? You need to read it using the same data type. You can then manipulate the format downstream (if needed) using something like what Cra ...
 Topic: Remove Duplicates
abc123

Replies: 4
Views: 2188

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Nov 14, 2016 3:57 pm   Subject: Remove Duplicates
I am assuming that what he is saying is, other than the indicator column, he wants to find duplicates of the rest of the columns. If there is a Y in the indicator column of a row, it is a duplicate of ...
 Topic: Removal of Repeated Characters
abc123

Replies: 14
Views: 6075

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Nov 14, 2016 3:40 pm   Subject: Removal of Repeated Characters
qt_ky, I am assuming that you are talking about a parallel transformer loop, right?
 Topic: Removal of Repeated Characters
abc123

Replies: 14
Views: 6075

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Nov 14, 2016 11:33 am   Subject: Removal of Repeated Characters
Datastage 9.1 has eReplace in the parallel transformer stage.

Ray/qt_ky, if the OP was to replace strings such as AAAA with A using eReplace, how would he do it?

I would think that the OP would ...
Resolved
 Topic: Reading multiple spreadsheet using unstructured datastage
abc123

Replies: 4
Views: 2840

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Nov 11, 2016 11:46 am   Subject: Reading multiple spreadsheet using unstructured datastage
If you want to read multiple Excel files by using one unstructured stage, you need to use a wild card. So if you have files like this:

File1.xls
File2.xls
File3.xls

you need to put:

File*. ...
Resolved
 Topic: get unique columns
abc123

Replies: 3
Views: 1491

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Nov 11, 2016 10:10 am   Subject: get unique columns
You can also use Sort stage and then Remove Duplicate stage. Leave the partitioning as Auto.
Resolved
 Topic: Parameter Set Import
abc123

Replies: 7
Views: 3153

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 10, 2016 11:15 am   Subject: Parameter Set Import
Interesting.

Is this script file provided by Datastage?
What folder do you run it from?
Workaround Reported
 Topic: Duplicate entry issue - Lookup stage
abc123

Replies: 14
Views: 6553

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 10, 2016 11:02 am   Subject: Duplicate entry issue - Lookup stage
Tony, I don't see an issue here. When you use "entire", it copies 8 times and you get the warning. When you use "hash", you don't get it because each node gets only one unique key. This is how it is s ...
 Topic: Oracle Connector "After SQL statement"
abc123

Replies: 8
Views: 3465

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon May 30, 2016 7:02 pm   Subject: Oracle Connector "After SQL statement"
Craig, I need to update some data in the inserted rows after all rows have been inserted into the table. That's why I need to use "After SQL statement".

Let me know what other detail you need.
 Topic: Oracle Connector "After SQL statement"
abc123

Replies: 8
Views: 3465

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed May 25, 2016 8:06 pm   Subject: Oracle Connector "After SQL statement"
Thanks Teej and Craig for your responses. Craig, building a stored procedure in Oracle and calling it from Datastage is not an option. I have to do this from within the job.

Teej, it has to be done ...
 Topic: Oracle Connector "After SQL statement"
abc123

Replies: 8
Views: 3465

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed May 25, 2016 5:08 pm   Subject: Oracle Connector "After SQL statement"
I tried to raise an error by doing a SELECT into a variable from an empty table. The code hits the exception block and raises an error like it should in Oracle but when I put it in Datastage "After SQ ...
 Topic: Oracle Connector "After SQL statement"
abc123

Replies: 8
Views: 3465

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sat May 21, 2016 4:32 pm   Subject: Oracle Connector "After SQL statement"
DataStage® Release: 9x
Job Type: Parallel
OS: Unix
Is there a way to see the output of:

dbms_output.put_line

in an "After SQL statement"?

It doesn't show up in the Director.
 Topic: Slowly Changing Dimension stage with Type 2
abc123

Replies: 2
Views: 2215

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue May 17, 2016 1:38 pm   Subject: Slowly Changing Dimension stage with Type 2
I guess my question is, if the rows come in that order, would
12 X
be the first row inserted and made current? Would
12 A
be the second row inserted and made current and
12 X
row expired?
 Topic: Slowly Changing Dimension stage with Type 2
abc123

Replies: 2
Views: 2215

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri May 13, 2016 11:46 am   Subject: Slowly Changing Dimension stage with Type 2
DataStage® Release: 9x
Job Type: Parallel
OS: Unix
If I send 5 rows to a SCD stage with the same key for Type 2 determination, does it insert/update rows based on a certain criteria or does it do it at random?

For example, if I have data like this: ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours