DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 346 matches
Author Message
 Topic: Evaluate Arithmatic Expression coming in input string
UCDI

Replies: 13
Views: 484

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Feb 13, 2019 4:38 am   Subject: Evaluate Arithmatic Expression coming in input string
are they all of the same format, like A operator B operator C?
Resolved
 Topic: How to retain ONE record after comparing 2 different columns
UCDI

Replies: 5
Views: 390

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Feb 06, 2019 8:15 am   Subject: How to retain ONE record after comparing 2 different columns
you can do something snarky like make the key A*B (200*300 is the same as 300*200) or sort the 2 keys (stage variables can do this for 2 values really simple) and put them in the same order every tim ...
 Topic: [File Connector] Not delimited Files
UCDI

Replies: 12
Views: 527

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Feb 06, 2019 8:08 am   Subject: [File Connector] Not delimited Files
for fixed positions, left and right should do it. you can string these together eg
f1 = left(in, 12)
f2 = left(right(in,12),12)
etc
 Topic: How to abort job when a string value is in a decimal field?
UCDI

Replies: 1
Views: 356

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jan 31, 2019 3:56 am   Subject: How to abort job when a string value is in a decimal field?
Feed it to a transformer.

In the transformer, have two output links. On one of the links, have a constraint send the data down if the column value is NULL. Also set the the link properties to abo ...
Resolved
 Topic: How to retain ONE record after comparing 2 different columns
UCDI

Replies: 5
Views: 390

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jan 31, 2019 3:52 am   Subject: How to retain ONE record after comparing 2 different columns
is the data really big? If not, can you copy the input and then do a join stage? I think that might work, what you wold do is something like

read file
copy stage
modify left, add party1 as new f ...
 Topic: Check if multiple rows returned from Lookup Stage
UCDI

Replies: 5
Views: 474

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Jan 15, 2019 11:56 am   Subject: Check if multiple rows returned from Lookup Stage
can you rig some sort of having clause into your lookup query so that if it has more than 1 it returns nothing?
 Topic: Write to excel using Unstructured Data stage
UCDI

Replies: 1
Views: 278

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jan 03, 2019 8:57 am   Subject: Write to excel using Unstructured Data stage
I use it all the time.
Its kinda like a dataset: if you have an input, you can't have an output, and if you have an output, you can't have an input. Its either the start or the end of a chain of w ...
 Topic: Datastage -- Produces More Rows after each run
UCDI

Replies: 2
Views: 326

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Nov 28, 2018 11:21 am   Subject: Datastage -- Produces More Rows after each run
we have an outstanding ticket with IBM about the H-stage dropping a record here and there at random. We can run the same data 3 times and get {one record missed, all the data, different record missed ...
Resolved
 Topic: Relationship between Nodes and Partitions...
UCDI

Replies: 7
Views: 584

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Nov 19, 2018 11:11 am   Subject: Relationship between Nodes and Partitions...
If the data isn't suited to partitions "as is", run some of it through a Checksum stage and use that field as the partition key. It should give solid results.
 Topic: Calculating age using date
UCDI

Replies: 9
Views: 5727

PostForum: IBM® Infosphere DataStage Server Edition   Posted: Tue Oct 09, 2018 9:49 am   Subject: Calculating age using date
do you need some sort of logic to round up? That is doable but I have never heard of anyone doing that for your age in years. you can add a +1 if the # of days until next birthday is within N days, ...
 Topic: Need DataStage to abort rather than loading 0 rows
UCDI

Replies: 5
Views: 654

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Aug 14, 2018 12:09 pm   Subject: Need DataStage to abort rather than loading 0 rows
Answering the subject and not the body...

You can drop your extract to a dataset, count the # of records in the dataset with a routine, and use that to gracefully exit or proceed depending on havin ...
Resolved
 Topic: Can we copy Datasets from one server to another?
UCDI

Replies: 11
Views: 1094

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jul 26, 2018 2:04 pm   Subject: Can we copy Datasets from one server to another?
there is something that works for many small simple DS too:

orchadmin dump -delim ',' dsname.ds outputname.csv

but this is a quick fix for simple problems; there are times when it won't be suf ...
 Topic: Shifting and Truncating
UCDI

Replies: 3
Views: 524

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jul 23, 2018 12:22 pm   Subject: Shifting and Truncating
a mix of substring operations should get you there, eg
newvalue = left(oldvalue, 2):'S':right(oldvalue,4)
newvalue2 = left(oldvalue, 2):'SS':right(oldvalue,3)
..etc

do that in a stage variable i ...
Resolved
 Topic: Can we copy Datasets from one server to another?
UCDI

Replies: 11
Views: 1094

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jul 23, 2018 12:18 pm   Subject: Can we copy Datasets from one server to another?
it is better if you do not do this. In an emergency, you can move the dataset AND its underlying files AND change the 'header' file (the one you interface to in datastage when you open or write a dat ...
 Topic: Handling Junk Characters
UCDI

Replies: 3
Views: 657

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Jul 13, 2018 2:15 pm   Subject: Handling Junk Characters
to just remove the records entirely you can do it with a single convert, or possibly even more efficiently with 'alpha' if that fits the data need? A single convert, you convert all the valid chars ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours