DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 18 matches
Author Message
 Topic: Fork-join with condition
jeisma

Replies: 1
Views: 530

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Jan 12, 2018 1:16 pm   Subject: Fork-join with condition
DataStage® Release: 11x
Job Type: Parallel
OS: Windows
Hi,

This simple programming task made me spent couple of days trying to implement in ds, to no avail Embarassed

If I have this data:

col1 col2
id1 5
id2 0
id3 0
i ...
Resolved
 Topic: An empty file is being created by lookup stage
jeisma

Replies: 4
Views: 1802

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jun 05, 2017 10:46 am   Subject: An empty file is being created by lookup stage
so i used an execute command stage, to test the filesize, if it's zero, do something, else, some else.

thanks for the inputs!
Resolved
 Topic: An empty file is being created by lookup stage
jeisma

Replies: 4
Views: 1802

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Jun 02, 2017 4:30 pm   Subject: An empty file is being created by lookup stage
DataStage® Release: 11x
Job Type: Parallel
OS: Windows
hi,

i have a lookup stage that if there is a failure, a log will be inserted in the error log file.

however, even if there is no lookup failure (reject), the log file is created although it's em ...
 Topic: How to use DSLogWarn
jeisma

Replies: 1
Views: 1272

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Jun 02, 2017 2:11 pm   Subject: How to use DSLogWarn
DataStage® Release: 11x
Job Type: Parallel
OS: Windows
hi,

there as so many links/samples about DSLogWarn. but i could not find any how/where to enter the code?

it seems like it can only be done on a server job? what of with parallel?

i have a lo ...
Resolved
 Topic: Job design to do table maintenance task
jeisma

Replies: 6
Views: 1603

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Jun 02, 2017 8:53 am   Subject: Job design to do table maintenance task
preparing, like updating old records before new ones come in.

thank you for your inputs.
Resolved
 Topic: Job design to do table maintenance task
jeisma

Replies: 6
Views: 1603

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Jun 02, 2017 8:30 am   Subject: Job design to do table maintenance task
there is no before/after sql. this job is actually part of a sequence. it's like preparing the table before the main job does it's thing.
Resolved
 Topic: Job design to do table maintenance task
jeisma

Replies: 6
Views: 1603

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jun 01, 2017 3:28 pm   Subject: Job design to do table maintenance task
ok. i must mention RG is creating one dummy record just to have an input to next stage. because it will not work having just db2 stage there by itself. this design just feels a little awkward.
Resolved
 Topic: Job design to do table maintenance task
jeisma

Replies: 6
Views: 1603

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jun 01, 2017 3:14 pm   Subject: Job design to do table maintenance task
DataStage® Release: 11x
Job Type: Parallel
OS: Windows
hi,

i needed a job to update records on the db. so i created

row_generator -> db2_connector

above works, but, how would you design the job differently?


TIA!
 Topic: how to check if file exists
jeisma

Replies: 4
Views: 1306

PostForum: General   Posted: Thu Jun 01, 2017 8:42 am   Subject: how to check if file exists
thank you so much for the tips.
 Topic: how to check if file exists
jeisma

Replies: 4
Views: 1306

PostForum: General   Posted: Wed May 31, 2017 2:47 pm   Subject: how to check if file exists
DataStage® Release: 11x
Job Type: Parallel
OS: Windows
hi,

the op in this link pretty much describe what i need.

http://www.dsxchange.com/viewtopic.php?p=313299

however, i could not find execute command stage in my pallet.

any idea how to che ...
 Topic: How to rollback all written records if lookup fails
jeisma

Replies: 5
Views: 1649

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed May 31, 2017 9:33 am   Subject: How to rollback all written records if lookup fails
i was just citing an example. but thank you. indeed i will try Paul's suggestion.
 Topic: How to rollback all written records if lookup fails
jeisma

Replies: 5
Views: 1649

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed May 31, 2017 9:09 am   Subject: How to rollback all written records if lookup fails
You mean Transaction - Record Count? It was at default, 2000. I changed it to value higher than the number of records being processed. Still no good. (Although, I would not do this as the number of re ...
 Topic: How to rollback all written records if lookup fails
jeisma

Replies: 5
Views: 1649

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue May 30, 2017 4:30 pm   Subject: How to rollback all written records if lookup fails
DataStage® Release: 11x
Job Type: Parallel
OS: Windows
hi,

I have a look that is set to FAIL on lookup failure. However, if there were already written records before the failure, they are not reverted.

For example if I have 10 records, and 6th reco ...
 Topic: Write Mode : Delete and Insert fails
jeisma

Replies: 2
Views: 874

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Apr 05, 2017 1:49 pm   Subject: Write Mode : Delete and Insert fails
Hi,

Incoming data have unique key values.

Auto Commit : off
Array Size: 2000
Transaction Record Count : 2000

to test, changed to:
On
1
2000

it worked! thank you. Tried different numbe ...
 Topic: Write Mode : Delete and Insert fails
jeisma

Replies: 2
Views: 874

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Apr 05, 2017 12:29 pm   Subject: Write Mode : Delete and Insert fails
DataStage® Release: 11x
Job Type: Parallel
OS: Windows
Hi,

I have a stage where write mode is Delete and Insert. If I run the job, I would get a warning that says the Delete "failed to run", followed by fatal error "QLSTATE = 02000: Native Error Code = ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours