Search found 42 matches

by sec105105
Fri Apr 04, 2014 8:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unexplained behaviour using DB2 connector
Replies: 6
Views: 2138

Final note....

If you drop the connector entirely, and rebuild from scratch, problem disappears. Whatever old code is behind the scenes gets discarded when the new one is built.
by sec105105
Thu Apr 03, 2014 2:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unexplained behaviour using DB2 connector
Replies: 6
Views: 2138

Yes, after a complete rebuild from scratch, it's working. Exporting: that was one of the first things I did - could not find any reference to the bare T_Schema variable, except in the parameter section where $T_Schema was listed. As a result, I'm fearful that SQL code using old parameters hangs arou...
by sec105105
Thu Apr 03, 2014 1:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unexplained behaviour using DB2 connector
Replies: 6
Views: 2138

Well, I rebuilt the job from scratch, having only $T_Schema in the parameter list, and #$T_Schema# used in my SQL code within the DB2 connector. This is what the end result of the original job was (T_Schema gone, $T_Schema everywhere), yet the original job kept failing. Somewhere, the job/connector ...
by sec105105
Mon Dec 16, 2013 3:33 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Updating / writing ONLY to certain columns in a hashed file
Replies: 3
Views: 2344

Updating / writing ONLY to certain columns in a hashed file

Is it possible to update *certain* columns in a hashed file? I know writes to HFs are row-destructive (if that's the term) , but has anyone come up with an approach through transformer or whatever to update conditionally certain columns? In my case, I have a group of X records within a key, and vari...
by sec105105
Tue Dec 10, 2013 7:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to generate sequence numbers within a sorted list
Replies: 3
Views: 2982

deeplind07 wrote:Hash Partition (on F1 )and sort(and f1 and f3) in the input link of transformer. ...
SVF1_1=F1
IF SVF11=SVF12 THEN SVF2= SVF2+1 ELSE 1
SVF12=SVF11
Something similar to the above worked. Thanks!
by sec105105
Thu Jun 13, 2013 1:24 pm
Forum: General
Topic: Deleting DB2 table's rows very slow
Replies: 5
Views: 2540

Yes: It's feeding the 2 leading columns of a 3-column Primary key. Multiple rows from the target table may be deleted for each key that's fed, but that's OK. It appears there's an average 120 rows for each row passed. So in reality, the job is passing 4 rows/second to the DB2 stage, but probably 4-5...
by sec105105
Thu Jun 13, 2013 9:31 am
Forum: General
Topic: Deleting DB2 table's rows very slow
Replies: 5
Views: 2540

When we do the subsequent insert, it goes around 200+ rows/second. When the delete occurs, it's feeding the 2 leading columns of a 3-column Primary key. Multiple rows from the target table may be deleted for each key that's fed, but that's OK. EG: 700K keys may result in 1.5m rows deleted. I will as...
by sec105105
Thu Jun 13, 2013 8:45 am
Forum: General
Topic: Deleting DB2 table's rows very slow
Replies: 5
Views: 2540

Deleting DB2 table's rows very slow

I have a job that takes rows from a hashed file and deleted records from a DB2 (9.5) table. The target table has 122 million rows. The deletion process is very slow - rarely above 5 rows/second. Each week, the hashed file is refreshed, and contains about 1 million rows. The deletes are done in order...
by sec105105
Wed Apr 17, 2013 7:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using mkdbfile in a Unix script - foreground & backgroun
Replies: 9
Views: 5522

Doh! That'll learn me not to paraphrase other people's text! Eric - I later tried: nohup $binDir/mkdbfile $projectDir/tmp_date_ids2 30 34183 4 20 50 80 1639 -32BIT 2>&1 < /dev/null & disown And, although I still got the 'disown not found' error, the hashfile seems to have been created! I the...
by sec105105
Wed Apr 17, 2013 7:27 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using mkdbfile in a Unix script - foreground & backgroun
Replies: 9
Views: 5522

eph - tried: nohup $binDir/mkdbfile $projectDir/tmp_date_ids2 30 34183 4 20 50 80 1639 -32BIT 2>&1 & disown Got "ksh: disown: not found" (I'm on SunOS). What I'm seeing is - it just hangs - ie the process just exists (I check from another window), and it seems like there's no cpu a...
by sec105105
Tue Apr 16, 2013 8:05 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using mkdbfile in a Unix script - foreground & backgroun
Replies: 9
Views: 5522

Hi, I have tried it within a shell, and also just the base command from the prompt. Same behaviour in a shell, or not. As soon as I tack on the & , it hangs. chulett - no, when run from command line, finishes on its own without further interaction. ray - I have tried with nohup. Eg: nohup mkdbfi...
by sec105105
Tue Apr 16, 2013 5:19 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using mkdbfile in a Unix script - foreground & backgroun
Replies: 9
Views: 5522

Using mkdbfile in a Unix script - foreground & backgroun

I have a Unix(ksh) script that I use to build hash files using mkdbfile. If I run interactively, it works fine. If I run in background (using & ), it either hangs, or times out with a STTY-like error. Anyone know if anything special has to be done to get this command working successfully in back...