Search found 117 matches
- Wed Dec 07, 2022 4:53 pm
- Forum: General
- Topic: DataStage 11.7 Not showing Performance Statistics with a large number of objects in job
- Replies: 2
- Views: 7565
Re: DataStage 11.7 Not showing Performance Statistics with a large number of objects in job
I have not tried to increase memory in the client machine however the job has been opened in multiple client machines and the stats just don't seem to exist... I don't think the stats are recorded by the clients... I believe they are recorded by the engine server correct? So the memory of the client...
- Fri Dec 02, 2022 10:24 am
- Forum: General
- Topic: DataStage 11.7 Not showing Performance Statistics with a large number of objects in job
- Replies: 2
- Views: 7565
DataStage 11.7 Not showing Performance Statistics with a large number of objects in job
I have noticed in DataStage 11.5 and 11.7 (only ones I have used) that when I have a large number of objects (links, stages) on a Parallel Job that eventually there are no stats showing (row counts) on any of the monitors (performance statistics in Parallel Job or Monitor in Director). If I take the...
- Tue Jul 31, 2018 1:25 pm
- Forum: General
- Topic: Start Loop passing just first row into the loop
- Replies: 12
- Views: 5665
- Tue Jul 31, 2018 11:57 am
- Forum: General
- Topic: Start Loop passing just first row into the loop
- Replies: 12
- Views: 5665
- Tue Jul 31, 2018 11:45 am
- Forum: General
- Topic: Start Loop passing just first row into the loop
- Replies: 12
- Views: 5665
Yes that makes sense to use outside the loop. But still I need to map the UserActivity variables in the job activity to pass the parameters.
Below is the Start Loop Properties:
https://imgur.com/aykaFJk
Below is the Start Loop Properties:
https://imgur.com/aykaFJk
- Tue Jul 31, 2018 10:29 am
- Forum: General
- Topic: Start Loop passing just first row into the loop
- Replies: 12
- Views: 5665
I will try with other image hosting site.
Job Activity:
https://imgur.com/gFsV786
User Variable Activity:
https://imgur.com/5RhoHkw
Loop Activity:
https://imgur.com/mDdXtwx
Thanks.
Job Activity:
https://imgur.com/gFsV786
User Variable Activity:
https://imgur.com/5RhoHkw
Loop Activity:
https://imgur.com/mDdXtwx
Thanks.
- Tue Jul 31, 2018 8:48 am
- Forum: General
- Topic: Start Loop passing just first row into the loop
- Replies: 12
- Views: 5665
@chulett: I am currently using UserVariableActivity inside the loop to derive the parameters coming from a file and in the job activity stage I am assigning these values to the job parameters in the job activity. I am including images: Example: Parameter value of 'AB' (from text file) is been assign...
- Mon Jul 30, 2018 6:51 pm
- Forum: General
- Topic: Start Loop passing just first row into the loop
- Replies: 12
- Views: 5665
@chulett -- Thanks for bringing that up. No I am not leveraging $Counter from start loop in the Job Activity. I am using User Variable Activity to set values for the parameters in the table (in job activity). How can I leverage the $Counter in job activity when I am setting values for the parameters...
- Mon Jul 30, 2018 6:07 pm
- Forum: General
- Topic: Start Loop passing just first row into the loop
- Replies: 12
- Views: 5665
Start Loop passing just first row into the loop
Hello, I have a text file (pipe delimited) with 3 rows. I am combining these 3 rows with a ',' (comma) as delimiter via Execute Command Stage. I am passing the output of the execute command to the Start Loop to define delimited values. Issue: When running the job, 3 iterations are performed as expec...
- Thu Jul 27, 2017 4:52 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Error during change Connector Variant in Oracle connector
- Replies: 1
- Views: 2763
Error during change Connector Variant in Oracle connector
Hi, We are trying to change the Connector Variant in DataStage jobs which are using Oracle connector stages (if it is defined as 10g, when we import in 11.5, the oracle version will be blank and it gives error when running). We had used below command from the command line as per the defined in the I...
- Wed May 31, 2017 9:06 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: RCP capability into server shared container
- Replies: 8
- Views: 6198
thompsonp: I am trying to implement the functionality of each individual SAP jobs, the data is being loaded into Persistent Cache tables which are later being used as reference in other data flows. We are merely implementing the logic that is there in SAP DSXi on datastage per client request inorder...
- Wed May 31, 2017 8:58 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: RCP capability into server shared container
- Replies: 8
- Views: 6198
Mike, Yes RCP is strictly a parallel feature, I was hoping if there were any other techniques that we can to push through the columns dynamically to the hash file but guess there is none. I agree, parallel datasets are much effective in this case, but as weird as it sounds my client is picky about d...
- Wed May 31, 2017 8:53 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: RCP capability into server shared container
- Replies: 8
- Views: 6198
I'm suspecting the caching you are thinking of only applies to hashed files used as a lookup, not as a source or target. Ah okay. I always thought once the data is cached whenever we read from it (either as a source or reference) data will be read from the cache. Now I think about it you might be r...
- Wed May 24, 2017 12:52 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: RCP capability into server shared container
- Replies: 8
- Views: 6198
Hi chulett, We have jobs in SAP dataservices that we are trying to convert into parallel jobs in datastage. SAP jobs are writing to persistent cache tables which store the data in memory than a physical table and are used as a source in other jobs. We are trying to replicate similar process in datas...
- Wed May 24, 2017 11:37 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: RCP capability into server shared container
- Replies: 8
- Views: 6198
RCP capability into server shared container
Hello, I am building a server shared container with a hash file in it. I will be using this container in my parallel jobs to load the hash file and re-use this container as a source in other parallel jobs. Metadata is different in each of the parallel jobs that I intend to use this container in. I w...