Search found 380 matches

by UCDI
Wed Jun 19, 2019 1:24 pm
Forum: General
Topic: Check in datastage
Replies: 14
Views: 24773

DS locking is a mostly functional tool to prevent 2 people from editing the same job at the same time. It works for that, more or less -- the biggest issue we have with it is that it can lock you out from the job you were editing (locked by you preventing you from entry) which is mostly caused by ev...
by UCDI
Thu Jun 13, 2019 3:04 pm
Forum: General
Topic: Check in datastage
Replies: 14
Views: 24773

our group managed to connect it into microsoft's TFS but it was too clunky to use. There was some direct connect via a third party library or plug in to tfs. There are all sorts of ways to set something up. you can export jobs/whatever and save those in any normal repository tool. you can also use t...
by UCDI
Sun Jun 09, 2019 12:39 pm
Forum: General
Topic: Check in datastage
Replies: 14
Views: 24773

if you intentionally crash out of, lose the network, or similar while having it open in datastage designer it will lock as you without being actively open (alt f4 will do the trick). However, in either case, be aware that its possible to force them unlocked if someone is annoyed. We wrote a job to d...
by UCDI
Wed May 29, 2019 9:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Source file Structure in Columns not rows
Replies: 5
Views: 4023

it looks to me like you need to add a column to your data for account number, and once you have that, a pivot should work? If you don't want to do a pivot or can't get it to work, you can parse it any number of ways. Datastage can do it with transformers and funnels and such, but it is clunky ... st...
by UCDI
Wed May 29, 2019 9:09 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Varchar(max) SQL Server
Replies: 5
Views: 5112

its been a while but if I remember this right, sql server wanted nvarchar not long varchar for long strings. try that?
by UCDI
Tue May 28, 2019 10:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Source file Structure in Columns not rows
Replies: 5
Views: 4023

the first line is inconsistent (it has the column label 3 times, the others only once). Is that correct?

what do you want from it... 3 records? One big record with _1 _2 _3 on the columns?
by UCDI
Wed May 15, 2019 11:24 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remove Carriage Return in Sequential Stage Filter
Replies: 10
Views: 7509

perhaps less well know, you can call several unix commands back to back with a ; between them in the shell execute stage. here, piped stream is perhaps as good or better, but if you need it... you can invoke the unix commands in a parallel job too, via a routine, if the before/after is insufficient.
by UCDI
Mon May 13, 2019 9:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need help in creating transposed file
Replies: 8
Views: 6630

it may be easiest to just extract it to a text file, and process the text file in your favorite file fixer -- basic routine? unix shell command? Write your own program? Etc...
by UCDI
Mon May 13, 2019 9:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: NEED LOGIC IN DATASTGE
Replies: 2
Views: 3201

if you can't get the transformer, sort by date take top and bottom each down a link and send to a funnel... but the loop is probably the way to go.
by UCDI
Mon May 06, 2019 10:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need help in creating transposed file
Replies: 8
Views: 6630

1000+ right... personally I would write something that fixed the file outside of datastage for something that big and load the fixed file. But you can probably do it with a transformer loop as you wanted, using the names. If not, a basic routine maybe? that is too many to do it the simple way I said...
by UCDI
Mon May 06, 2019 3:13 am
Forum: General
Topic: how to not create sequential file if there are 0 records
Replies: 2
Views: 2710

you can get the count of records and conditionally bypass the file creation if you are willing to move the parallel job into a sequence job and break it up. Is it worth it?
by UCDI
Mon May 06, 2019 3:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need help in creating transposed file
Replies: 8
Views: 6630

it looks easy enough. take your input data into a transformer. output 1 of the transformer has this: 11 1 Col1 12 and output #2 has this one: 11 1 Col2 2 put them into a funnel stage. Write to target. I assume there are a fixed number of columns that can be transposed (11,12,13,... N right). each on...
by UCDI
Tue Apr 23, 2019 9:51 pm
Forum: Site/Forum
Topic: Premium Membership
Replies: 2
Views: 12608

is there a hidden / premium message you need to read in the meantime? Someone here can repost it exposed
by UCDI
Mon Apr 15, 2019 10:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Transformer compilation error in AIX
Replies: 4
Views: 4469

"/usr/include/string.h". this concerns me. string.h is part of the C language and should not need a path to include it; has someone tried to override the standard one? try this sample program. Can you compile this? #include <cstring> #include <iostream> using namespace std; int main() { ch...
by UCDI
Thu Apr 11, 2019 9:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Run time column propogation
Replies: 6
Views: 5089

how complex are these rules, and can you change your extract?
seems like a coalesce or similar statement for each rule would work if the rules are binary (eg column rule 1 = if any of these are null, null else 1) and then trip off the rule columns would be easier if you have this much leeway...