| Author |
Message |
|
Topic: Running a stage within a job with a different config file |
UCDI
Replies: 8
Views: 283
|
 Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Mon Jul 29, 2019 1:10 pm Subject: Running a stage within a job with a different config file |
|
if you run into something that cannot be set as a parameter, and there are a very few things that are like this, you can make 2 copies of the parallel job with the different setups and call the one yo ...
|
|
Topic: generate json file |
UCDI
Replies: 9
Views: 357
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Mon Jul 29, 2019 1:01 pm Subject: generate json file |
|
right, what I was saying is you can just craft the text you need for small xml/json etc files. Its easier and more efficient than parsing and scheming and whatnot so long as you are ok with having to ...
|
|
Topic: generate json file |
UCDI
Replies: 9
Views: 357
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Wed Jul 24, 2019 3:36 pm Subject: generate json file |
|
for small, non nested, extremely simple markup files, I am often willing to just generate them directly without any parsing/thinking/schema/etc. Its faster, easier to code, etc but its no good if yo ...
|
|
Topic: Add a new column without using Transformer Stage |
UCDI
Replies: 6
Views: 467
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Wed Jul 10, 2019 11:45 am Subject: Add a new column without using Transformer Stage |
|
what do you already have? Several stages will let you inject a column at will in 11.x. You can also add them to your extract if its from a database, just add a column as type & name to the sel ...
|
|
Topic: Orphan and defunct processes are left by InfoSphereDataStage |
UCDI
Replies: 4
Views: 188
|
Forum: General
Posted: Wed Jun 26, 2019 1:16 pm Subject: Orphan and defunct processes are left by InfoSphereDataStage |
|
we only ever get them when a job crashes hard and leaves a thread outstanding. I would advise focus on finding out why you have such a high number of them -- see if its one or three or whatever small ...
|
|
Topic: Check in datastage |
UCDI
Replies: 13
Views: 675
|
Forum: General
Posted: Mon Jun 24, 2019 4:21 pm Subject: Check in datastage |
Like I said we had so much trouble we made a job for it.
it just calls a tcl command 'unlock all'. I don't know if there is a lock all or what available; this is above my digging around.
|
|
Topic: Check in datastage |
UCDI
Replies: 13
Views: 675
|
Forum: General
Posted: Sun Jun 23, 2019 10:09 am Subject: Check in datastage |
|
Dastastage can lock jobs to prevent multiple people editing at once. You can manually lock and unlock them yourself, but I am advising against this as a form of code repository control because locks ...
|
|
Topic: Print date in particular range in Datastage |
UCDI
Replies: 1
Views: 363
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Sun Jun 23, 2019 10:05 am Subject: Print date in particular range in Datastage |
transformer loops are really for splitting 1 record into multiples.
what I think you might want here would be a row-generator, and a stage variable. The stage variable would increment the date ea ...
|
|
Topic: Check in datastage |
UCDI
Replies: 13
Views: 675
|
Forum: General
Posted: Wed Jun 19, 2019 1:24 pm Subject: Check in datastage |
|
DS locking is a mostly functional tool to prevent 2 people from editing the same job at the same time. It works for that, more or less -- the biggest issue we have with it is that it can lock you out ...
|
|
Topic: Check in datastage |
UCDI
Replies: 13
Views: 675
|
Forum: General
Posted: Thu Jun 13, 2019 3:04 pm Subject: Check in datastage |
our group managed to connect it into microsoft's TFS but it was too clunky to use. There was some direct connect via a third party library or plug in to tfs.
There are all sorts of ways to set ...
|
|
Topic: Check in datastage |
UCDI
Replies: 13
Views: 675
|
Forum: General
Posted: Sun Jun 09, 2019 12:39 pm Subject: Check in datastage |
|
if you intentionally crash out of, lose the network, or similar while having it open in datastage designer it will lock as you without being actively open (alt f4 will do the trick). However, in eith ...
|
|
Topic: Source file Structure in Columns not rows |
UCDI
Replies: 5
Views: 523
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Wed May 29, 2019 9:18 pm Subject: Source file Structure in Columns not rows |
it looks to me like you need to add a column to your data for account number, and once you have that, a pivot should work?
If you don't want to do a pivot or can't get it to work, you can parse i ...
|
|
Topic: Varchar(max) SQL Server |
UCDI
Replies: 5
Views: 552
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Wed May 29, 2019 9:09 pm Subject: Varchar(max) SQL Server |
|
its been a while but if I remember this right, sql server wanted nvarchar not long varchar for long strings. try that?
|
|
Topic: Source file Structure in Columns not rows |
UCDI
Replies: 5
Views: 523
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Tue May 28, 2019 10:37 pm Subject: Source file Structure in Columns not rows |
the first line is inconsistent (it has the column label 3 times, the others only once). Is that correct?
what do you want from it... 3 records? One big record with _1 _2 _3 on the columns?
|
|
Topic: Remove Carriage Return in Sequential Stage Filter |
UCDI
Replies: 10
Views: 791
|
Forum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Posted: Wed May 15, 2019 11:24 pm Subject: Remove Carriage Return in Sequential Stage Filter |
perhaps less well know, you can call several unix commands back to back with a ; between them in the shell execute stage. here, piped stream is perhaps as good or better, but if you need it...
yo ...
|
| |
