Search found 117 matches

by UAUITSBI
Wed Dec 07, 2022 4:53 pm
Forum: General
Topic: DataStage 11.7 Not showing Performance Statistics with a large number of objects in job
Replies: 2
Views: 7001

Re: DataStage 11.7 Not showing Performance Statistics with a large number of objects in job

I have not tried to increase memory in the client machine however the job has been opened in multiple client machines and the stats just don't seem to exist... I don't think the stats are recorded by the clients... I believe they are recorded by the engine server correct? So the memory of the client...
by UAUITSBI
Fri Dec 02, 2022 10:24 am
Forum: General
Topic: DataStage 11.7 Not showing Performance Statistics with a large number of objects in job
Replies: 2
Views: 7001

DataStage 11.7 Not showing Performance Statistics with a large number of objects in job

I have noticed in DataStage 11.5 and 11.7 (only ones I have used) that when I have a large number of objects (links, stages) on a Parallel Job that eventually there are no stats showing (row counts) on any of the monitors (performance statistics in Parallel Job or Monitor in Director). If I take the...
by UAUITSBI
Tue Jul 31, 2018 1:25 pm
Forum: General
Topic: Start Loop passing just first row into the loop
Replies: 12
Views: 5545

@chulett: You are right! I have used Field($Counter,'|',1) in job activity and that picked up second and third row respectively.

Thanks for the help !
by UAUITSBI
Tue Jul 31, 2018 11:57 am
Forum: General
Topic: Start Loop passing just first row into the loop
Replies: 12
Views: 5545

I have moved the user variable activity to the outside of the loop but still just first row is getting looped all 3 times.
by UAUITSBI
Tue Jul 31, 2018 11:45 am
Forum: General
Topic: Start Loop passing just first row into the loop
Replies: 12
Views: 5545

Yes that makes sense to use outside the loop. But still I need to map the UserActivity variables in the job activity to pass the parameters.

Below is the Start Loop Properties:

https://imgur.com/aykaFJk
by UAUITSBI
Tue Jul 31, 2018 10:29 am
Forum: General
Topic: Start Loop passing just first row into the loop
Replies: 12
Views: 5545

I will try with other image hosting site.

Job Activity:
https://imgur.com/gFsV786

User Variable Activity:
https://imgur.com/5RhoHkw

Loop Activity:
https://imgur.com/mDdXtwx


Thanks.
by UAUITSBI
Tue Jul 31, 2018 8:48 am
Forum: General
Topic: Start Loop passing just first row into the loop
Replies: 12
Views: 5545

@chulett: I am currently using UserVariableActivity inside the loop to derive the parameters coming from a file and in the job activity stage I am assigning these values to the job parameters in the job activity. I am including images: Example: Parameter value of 'AB' (from text file) is been assign...
by UAUITSBI
Mon Jul 30, 2018 6:51 pm
Forum: General
Topic: Start Loop passing just first row into the loop
Replies: 12
Views: 5545

@chulett -- Thanks for bringing that up. No I am not leveraging $Counter from start loop in the Job Activity. I am using User Variable Activity to set values for the parameters in the table (in job activity). How can I leverage the $Counter in job activity when I am setting values for the parameters...
by UAUITSBI
Mon Jul 30, 2018 6:07 pm
Forum: General
Topic: Start Loop passing just first row into the loop
Replies: 12
Views: 5545

Start Loop passing just first row into the loop

Hello, I have a text file (pipe delimited) with 3 rows. I am combining these 3 rows with a ',' (comma) as delimiter via Execute Command Stage. I am passing the output of the execute command to the Start Loop to define delimited values. Issue: When running the job, 3 iterations are performed as expec...
by UAUITSBI
Thu Jul 27, 2017 4:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error during change Connector Variant in Oracle connector
Replies: 1
Views: 2710

Error during change Connector Variant in Oracle connector

Hi, We are trying to change the Connector Variant in DataStage jobs which are using Oracle connector stages (if it is defined as 10g, when we import in 11.5, the oracle version will be blank and it gives error when running). We had used below command from the command line as per the defined in the I...
by UAUITSBI
Wed May 31, 2017 9:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP capability into server shared container
Replies: 8
Views: 6132

thompsonp: I am trying to implement the functionality of each individual SAP jobs, the data is being loaded into Persistent Cache tables which are later being used as reference in other data flows. We are merely implementing the logic that is there in SAP DSXi on datastage per client request inorder...
by UAUITSBI
Wed May 31, 2017 8:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP capability into server shared container
Replies: 8
Views: 6132

Mike, Yes RCP is strictly a parallel feature, I was hoping if there were any other techniques that we can to push through the columns dynamically to the hash file but guess there is none. I agree, parallel datasets are much effective in this case, but as weird as it sounds my client is picky about d...
by UAUITSBI
Wed May 31, 2017 8:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP capability into server shared container
Replies: 8
Views: 6132

I'm suspecting the caching you are thinking of only applies to hashed files used as a lookup, not as a source or target. Ah okay. I always thought once the data is cached whenever we read from it (either as a source or reference) data will be read from the cache. Now I think about it you might be r...
by UAUITSBI
Wed May 24, 2017 12:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP capability into server shared container
Replies: 8
Views: 6132

Hi chulett, We have jobs in SAP dataservices that we are trying to convert into parallel jobs in datastage. SAP jobs are writing to persistent cache tables which store the data in memory than a physical table and are used as a source in other jobs. We are trying to replicate similar process in datas...
by UAUITSBI
Wed May 24, 2017 11:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP capability into server shared container
Replies: 8
Views: 6132

RCP capability into server shared container

Hello, I am building a server shared container with a hash file in it. I will be using this container in my parallel jobs to load the hash file and re-use this container as a source in other parallel jobs. Metadata is different in each of the parallel jobs that I intend to use this container in. I w...