DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 377 matches
Author Message
 Topic: Running a stage within a job with a different config file
UCDI

Replies: 8
Views: 283

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jul 29, 2019 1:10 pm   Subject: Running a stage within a job with a different config file
if you run into something that cannot be set as a parameter, and there are a very few things that are like this, you can make 2 copies of the parallel job with the different setups and call the one yo ...
 Topic: generate json file
UCDI

Replies: 9
Views: 357

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jul 29, 2019 1:01 pm   Subject: generate json file
right, what I was saying is you can just craft the text you need for small xml/json etc files. Its easier and more efficient than parsing and scheming and whatnot so long as you are ok with having to ...
 Topic: generate json file
UCDI

Replies: 9
Views: 357

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Jul 24, 2019 3:36 pm   Subject: generate json file
for small, non nested, extremely simple markup files, I am often willing to just generate them directly without any parsing/thinking/schema/etc. Its faster, easier to code, etc but its no good if yo ...
 Topic: Add a new column without using Transformer Stage
UCDI

Replies: 6
Views: 467

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Jul 10, 2019 11:45 am   Subject: Add a new column without using Transformer Stage
what do you already have? Several stages will let you inject a column at will in 11.x. You can also add them to your extract if its from a database, just add a column as type & name to the sel ...
 Topic: Orphan and defunct processes are left by InfoSphereDataStage
UCDI

Replies: 4
Views: 188

PostForum: General   Posted: Wed Jun 26, 2019 1:16 pm   Subject: Orphan and defunct processes are left by InfoSphereDataStage
we only ever get them when a job crashes hard and leaves a thread outstanding. I would advise focus on finding out why you have such a high number of them -- see if its one or three or whatever small ...
 Topic: Check in datastage
UCDI

Replies: 13
Views: 675

PostForum: General   Posted: Mon Jun 24, 2019 4:21 pm   Subject: Check in datastage
Like I said we had so much trouble we made a job for it.
it just calls a tcl command 'unlock all'. I don't know if there is a lock all or what available; this is above my digging around.
 Topic: Check in datastage
UCDI

Replies: 13
Views: 675

PostForum: General   Posted: Sun Jun 23, 2019 10:09 am   Subject: Check in datastage
Dastastage can lock jobs to prevent multiple people editing at once. You can manually lock and unlock them yourself, but I am advising against this as a form of code repository control because locks ...
 Topic: Print date in particular range in Datastage
UCDI

Replies: 1
Views: 363

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Jun 23, 2019 10:05 am   Subject: Print date in particular range in Datastage
transformer loops are really for splitting 1 record into multiples.

what I think you might want here would be a row-generator, and a stage variable. The stage variable would increment the date ea ...
 Topic: Check in datastage
UCDI

Replies: 13
Views: 675

PostForum: General   Posted: Wed Jun 19, 2019 1:24 pm   Subject: Check in datastage
DS locking is a mostly functional tool to prevent 2 people from editing the same job at the same time. It works for that, more or less -- the biggest issue we have with it is that it can lock you out ...
 Topic: Check in datastage
UCDI

Replies: 13
Views: 675

PostForum: General   Posted: Thu Jun 13, 2019 3:04 pm   Subject: Check in datastage
our group managed to connect it into microsoft's TFS but it was too clunky to use. There was some direct connect via a third party library or plug in to tfs.

There are all sorts of ways to set ...
 Topic: Check in datastage
UCDI

Replies: 13
Views: 675

PostForum: General   Posted: Sun Jun 09, 2019 12:39 pm   Subject: Check in datastage
if you intentionally crash out of, lose the network, or similar while having it open in datastage designer it will lock as you without being actively open (alt f4 will do the trick). However, in eith ...
 Topic: Source file Structure in Columns not rows
UCDI

Replies: 5
Views: 523

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed May 29, 2019 9:18 pm   Subject: Source file Structure in Columns not rows
it looks to me like you need to add a column to your data for account number, and once you have that, a pivot should work?

If you don't want to do a pivot or can't get it to work, you can parse i ...
 Topic: Varchar(max) SQL Server
UCDI

Replies: 5
Views: 552

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed May 29, 2019 9:09 pm   Subject: Varchar(max) SQL Server
its been a while but if I remember this right, sql server wanted nvarchar not long varchar for long strings. try that?
 Topic: Source file Structure in Columns not rows
UCDI

Replies: 5
Views: 523

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue May 28, 2019 10:37 pm   Subject: Source file Structure in Columns not rows
the first line is inconsistent (it has the column label 3 times, the others only once). Is that correct?

what do you want from it... 3 records? One big record with _1 _2 _3 on the columns?
Resolved
 Topic: Remove Carriage Return in Sequential Stage Filter
UCDI

Replies: 10
Views: 791

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed May 15, 2019 11:24 pm   Subject: Remove Carriage Return in Sequential Stage Filter
perhaps less well know, you can call several unix commands back to back with a ; between them in the shell execute stage. here, piped stream is perhaps as good or better, but if you need it...

yo ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours