Search found 97 matches

by atul9806
Tue May 29, 2018 8:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallel Processing of Rest Object in Rest Call
Replies: 1
Views: 2280

Parallel Processing of Rest Object in Rest Call

Hi Gurus There is a requirement of a REST call which has the Request as below - { "key1": [ "value1 ], "idSet": [ { "id": [ { "idType": "com.server1" "idValue": "451902123" } ], "id": [ { "idType": "c...
by atul9806
Sat Jul 01, 2017 3:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Table Data Comparison Between Sybase and SQL Server
Replies: 1
Views: 2430

Table Data Comparison Between Sybase and SQL Server

Hi Guys We are working on a migration project from V8.5 to V11.5 and Sybase to SQL Server. Currently facing the issue while comparing the data between Sybase and SQL Server tables and it is too much time consuming. Is there a way by which we can develop a job which can compare the data between Sybas...
by atul9806
Tue Jan 03, 2017 12:32 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hierarchical Stage is terminated while calling REST Service
Replies: 4
Views: 8776

Thanks craig for your inputs FYI - My input json file is only having 7 records and size is 22kb. Please find the job log when reset the job - From previous run DataStage Job 208 Phantom 20225 Abnormal termination of DataStage. Fault type is 11. Layer type is BASIC run machine. Fault occurred in BASI...
by atul9806
Mon Jan 02, 2017 6:33 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hierarchical Stage is terminated while calling REST Service
Replies: 4
Views: 8776

Hierarchical Stage is terminated while calling REST Service

Hi Team I have created a Server job for calling a REST POST service and capturing the response. This thread is a part of this issue but posting here if someone can help me with this server job. Design: transformer Stg ---> Hierarchical Stage ---> Seq File a) transformer stage - generating a single d...
by atul9806
Wed Dec 21, 2016 2:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve REST service call performance
Replies: 11
Views: 9047

Ernie, I have gone through the Folder stage and develop a server job for my task - Design: Folder --> Hierarchical Stage --> Flat File In Folder stage, I am passing the Source Folder name and regular expression for file but still my job is keep aborting. Warning : Abnormal termination of stage detec...
by atul9806
Mon Dec 12, 2016 12:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve REST service call performance
Replies: 11
Views: 9047

I am splitting the payload file outside the datastage box using a script and then passing the filename in hierarchical stage to read and post the data to web service.
by atul9806
Fri Dec 09, 2016 6:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job with Procedure Hanging
Replies: 12
Views: 11141

Can you try to use ODBC connector and check whether it is also stuck ?
by atul9806
Fri Dec 09, 2016 6:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generate Multiple Files - How to remove the "key"
Replies: 3
Views: 3104

Use a after job subroutine to rename the files, Can you explain your stage configuration?
by atul9806
Fri Dec 09, 2016 6:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve REST service call performance
Replies: 11
Views: 9047

I am splitting payload file into multiple as this is huge to send over webservice and due to business constraints for sending the data this is only the way. That is why I am splitting the payload file into multiple and calling the web service in loop. I have used the same logic for generating the si...
by atul9806
Fri Dec 09, 2016 3:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve REST service call performance
Replies: 11
Views: 9047

Thanks Ernie and qt_ky for your suggestions. Here is what I have done in my Server job - Txf (generating a single dummy row to pass the payload file ) --> Hierarchical Stage --> Output Seq file job is keep aborting after few seconds with warning "Abnormal termination of stage transformer",...
by atul9806
Thu Dec 08, 2016 1:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve REST service call performance
Replies: 11
Views: 9047

Improve REST service call performance

Hi Gurus, I am calling a REST service in Hierarchical stage and using the POST method. Design: (row gen) --> Hierarchical stage --> Flat file (Response) I am passing the payload as fileName and job is running on 2 node configuration. Performance Data: Run1 - start time : 12 sec, prod time : 13 sec R...
by atul9806
Tue Dec 06, 2016 7:26 am
Forum: IBM<sup>®</sup> SOA Editions (Formerly RTI Services)
Topic: Unable to compile Sequencer
Replies: 6
Views: 19699

JRodriguez, My service is invoking a parallel job which has a job controller. This job controller code is calling a sequencer which calls other job After successful completion of sequencer , it will generate a status file, which has been returned by the service on display to invoker. Service --> Par...
by atul9806
Sat Nov 26, 2016 11:16 pm
Forum: IBM<sup>®</sup> SOA Editions (Formerly RTI Services)
Topic: Unable to compile Sequencer
Replies: 6
Views: 19699

Thanks Julio, I'll ask my admin team to execute this script and update with the outcome.

But any idea why my sequncer is getting locked? This sequencer is not being called by the service as design is:
service --> parallel job(job controller) --> this sequencer
by atul9806
Sat Nov 26, 2016 5:49 am
Forum: IBM<sup>®</sup> SOA Editions (Formerly RTI Services)
Topic: Unable to compile Sequencer
Replies: 6
Views: 19699

No, in version 11.5 this script is not available.
by atul9806
Fri Nov 25, 2016 7:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Access remote file from Sequential Stage
Replies: 5
Views: 5899

You can not mount, Only root user can. Ask your Linux Admin team to mount remote drive to datastage server