| Author |
Message |
|
Topic: Evaluate Arithmatic Expression coming in input string |
UCDI
Replies: 13
Views: 484
|
 Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Wed Feb 13, 2019 4:38 am Subject: Evaluate Arithmatic Expression coming in input string |
|
are they all of the same format, like A operator B operator C?
|
|
Topic: How to retain ONE record after comparing 2 different columns |
UCDI
Replies: 5
Views: 390
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Wed Feb 06, 2019 8:15 am Subject: How to retain ONE record after comparing 2 different columns |
|
you can do something snarky like make the key A*B (200*300 is the same as 300*200) or sort the 2 keys (stage variables can do this for 2 values really simple) and put them in the same order every tim ...
|
|
Topic: [File Connector] Not delimited Files |
UCDI
Replies: 12
Views: 527
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Wed Feb 06, 2019 8:08 am Subject: [File Connector] Not delimited Files |
for fixed positions, left and right should do it. you can string these together eg
f1 = left(in, 12)
f2 = left(right(in,12),12)
etc
|
|
Topic: How to abort job when a string value is in a decimal field? |
UCDI
Replies: 1
Views: 356
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Thu Jan 31, 2019 3:56 am Subject: How to abort job when a string value is in a decimal field? |
Feed it to a transformer.
In the transformer, have two output links. On one of the links, have a constraint send the data down if the column value is NULL. Also set the the link properties to abo ...
|
|
Topic: How to retain ONE record after comparing 2 different columns |
UCDI
Replies: 5
Views: 390
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Thu Jan 31, 2019 3:52 am Subject: How to retain ONE record after comparing 2 different columns |
is the data really big? If not, can you copy the input and then do a join stage? I think that might work, what you wold do is something like
read file
copy stage
modify left, add party1 as new f ...
|
|
Topic: Check if multiple rows returned from Lookup Stage |
UCDI
Replies: 5
Views: 474
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Tue Jan 15, 2019 11:56 am Subject: Check if multiple rows returned from Lookup Stage |
|
can you rig some sort of having clause into your lookup query so that if it has more than 1 it returns nothing?
|
|
Topic: Write to excel using Unstructured Data stage |
UCDI
Replies: 1
Views: 278
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Thu Jan 03, 2019 8:57 am Subject: Write to excel using Unstructured Data stage |
I use it all the time.
Its kinda like a dataset: if you have an input, you can't have an output, and if you have an output, you can't have an input. Its either the start or the end of a chain of w ...
|
|
Topic: Datastage -- Produces More Rows after each run |
UCDI
Replies: 2
Views: 326
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Wed Nov 28, 2018 11:21 am Subject: Datastage -- Produces More Rows after each run |
|
we have an outstanding ticket with IBM about the H-stage dropping a record here and there at random. We can run the same data 3 times and get {one record missed, all the data, different record missed ...
|
|
Topic: Relationship between Nodes and Partitions... |
UCDI
Replies: 7
Views: 584
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Mon Nov 19, 2018 11:11 am Subject: Relationship between Nodes and Partitions... |
|
If the data isn't suited to partitions "as is", run some of it through a Checksum stage and use that field as the partition key. It should give solid results.
|
|
Topic: Calculating age using date |
UCDI
Replies: 9
Views: 5727
|
Forum: IBM® Infosphere DataStage Server Edition
Posted: Tue Oct 09, 2018 9:49 am Subject: Calculating age using date |
|
do you need some sort of logic to round up? That is doable but I have never heard of anyone doing that for your age in years. you can add a +1 if the # of days until next birthday is within N days, ...
|
|
Topic: Need DataStage to abort rather than loading 0 rows |
UCDI
Replies: 5
Views: 654
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Tue Aug 14, 2018 12:09 pm Subject: Need DataStage to abort rather than loading 0 rows |
Answering the subject and not the body...
You can drop your extract to a dataset, count the # of records in the dataset with a routine, and use that to gracefully exit or proceed depending on havin ...
|
|
Topic: Can we copy Datasets from one server to another? |
UCDI
Replies: 11
Views: 1094
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Thu Jul 26, 2018 2:04 pm Subject: Can we copy Datasets from one server to another? |
there is something that works for many small simple DS too:
orchadmin dump -delim ',' dsname.ds outputname.csv
but this is a quick fix for simple problems; there are times when it won't be suf ...
|
|
Topic: Shifting and Truncating |
UCDI
Replies: 3
Views: 524
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Mon Jul 23, 2018 12:22 pm Subject: Shifting and Truncating |
a mix of substring operations should get you there, eg
newvalue = left(oldvalue, 2):'S':right(oldvalue,4)
newvalue2 = left(oldvalue, 2):'SS':right(oldvalue,3)
..etc
do that in a stage variable i ...
|
|
Topic: Can we copy Datasets from one server to another? |
UCDI
Replies: 11
Views: 1094
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Mon Jul 23, 2018 12:18 pm Subject: Can we copy Datasets from one server to another? |
|
it is better if you do not do this. In an emergency, you can move the dataset AND its underlying files AND change the 'header' file (the one you interface to in datastage when you open or write a dat ...
|
|
Topic: Handling Junk Characters |
UCDI
Replies: 3
Views: 657
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Fri Jul 13, 2018 2:15 pm Subject: Handling Junk Characters |
|
to just remove the records entirely you can do it with a single convert, or possibly even more efficiently with 'alpha' if that fits the data need? A single convert, you convert all the valid chars ...
|
| |
