Search found 18 matches

by jeisma
Fri Jan 12, 2018 1:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fork-join with condition
Replies: 1
Views: 2761

Fork-join with condition

Hi, This simple programming task made me spent couple of days trying to implement in ds, to no avail :oops: If I have this data: col1 col2 id1 5 id2 0 id3 0 id4 0 id5 0 I'd lke to output to become just one row, where col2 is the last non zero value read. col1 col2 row 5 My approach is compare curren...
by jeisma
Mon Jun 05, 2017 10:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: An empty file is being created by lookup stage
Replies: 4
Views: 3573

so i used an execute command stage, to test the filesize, if it's zero, do something, else, some else.

thanks for the inputs!
by jeisma
Fri Jun 02, 2017 4:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: An empty file is being created by lookup stage
Replies: 4
Views: 3573

An empty file is being created by lookup stage

hi, i have a lookup stage that if there is a failure, a log will be inserted in the error log file. however, even if there is no lookup failure (reject), the log file is created although it's empty. is this an expected behaviour? i don't want the file being created if there is no lookup failure. TIA!
by jeisma
Fri Jun 02, 2017 2:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to use DSLogWarn
Replies: 1
Views: 2314

How to use DSLogWarn

hi, there as so many links/samples about DSLogWarn. but i could not find any how/where to enter the code? it seems like it can only be done on a server job? what of with parallel? i have a lookup that is set to "Reject", but i want to write a custom warning message in the log as well. TIA
by jeisma
Fri Jun 02, 2017 8:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job design to do table maintenance task
Replies: 6
Views: 3838

preparing, like updating old records before new ones come in.

thank you for your inputs.
by jeisma
Fri Jun 02, 2017 8:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job design to do table maintenance task
Replies: 6
Views: 3838

there is no before/after sql. this job is actually part of a sequence. it's like preparing the table before the main job does it's thing.
by jeisma
Thu Jun 01, 2017 3:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job design to do table maintenance task
Replies: 6
Views: 3838

ok. i must mention RG is creating one dummy record just to have an input to next stage. because it will not work having just db2 stage there by itself. this design just feels a little awkward.
by jeisma
Thu Jun 01, 2017 3:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job design to do table maintenance task
Replies: 6
Views: 3838

Job design to do table maintenance task

hi,

i needed a job to update records on the db. so i created

row_generator -> db2_connector

above works, but, how would you design the job differently?


TIA!
by jeisma
Thu Jun 01, 2017 8:42 am
Forum: General
Topic: how to check if file exists
Replies: 4
Views: 4528

thank you so much for the tips.
by jeisma
Wed May 31, 2017 2:47 pm
Forum: General
Topic: how to check if file exists
Replies: 4
Views: 4528

how to check if file exists

hi,

the op in this link pretty much describe what i need.

viewtopic.php?p=313299

however, i could not find execute command stage in my pallet.

any idea how to check if file exists, and rename afterwards before running the job runs?
by jeisma
Wed May 31, 2017 9:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to rollback all written records if lookup fails
Replies: 5
Views: 3620

i was just citing an example. but thank you. indeed i will try Paul's suggestion.
by jeisma
Wed May 31, 2017 9:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to rollback all written records if lookup fails
Replies: 5
Views: 3620

You mean Transaction - Record Count? It was at default, 2000. I changed it to value higher than the number of records being processed. Still no good. (Although, I would not do this as the number of records is unknown).
by jeisma
Tue May 30, 2017 4:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to rollback all written records if lookup fails
Replies: 5
Views: 3620

How to rollback all written records if lookup fails

hi,

I have a look that is set to FAIL on lookup failure. However, if there were already written records before the failure, they are not reverted.

For example if I have 10 records, and 6th record fail, the job aborts indeed, but the previously written 5 records stays in the database.


TIA!
by jeisma
Wed Apr 05, 2017 1:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Write Mode : Delete and Insert fails
Replies: 2
Views: 2463

Hi, Incoming data have unique key values. Auto Commit : off Array Size: 2000 Transaction Record Count : 2000 to test, changed to: On 1 2000 it worked! thank you. Tried different numbers for Array Size and Record Count, all tests failed except only when Array Size is 1. It's running painfully slow ho...
by jeisma
Wed Apr 05, 2017 12:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Write Mode : Delete and Insert fails
Replies: 2
Views: 2463

Write Mode : Delete and Insert fails

Hi, I have a stage where write mode is Delete and Insert. If I run the job, I would get a warning that says the Delete "failed to run", followed by fatal error "QLSTATE = 02000: Native Error Code = 100: Msg = [IBM][CLI Driver][DB2/NT64] SQL0100W No row was found for FETCH, UPDATE or D...