Search found 39 matches

by moalik
Mon Nov 26, 2018 1:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Stuck DataStage Parallel Job
Replies: 1
Views: 2624

Stuck DataStage Parallel Job

Hi All, One of my DataStage Parallel job got stuck without any progress and when i checked the director there was a warning in the job log: DSD.INTclose unable to open VOC file. As this job is in production, i didn't have much time to go through the log details and restart the batch immediately. I h...
by moalik
Sun Sep 02, 2018 7:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem Extracting Data From Oracle Database
Replies: 9
Views: 4599

Hi All, Thanks for the information. We were able to engage network team to see what exactly is happening on the Server when the job is running for a long time. We could see some of the packets were getting dropped. The Query completed successfully on database side could see the message "SQL*Net...
by moalik
Mon Aug 20, 2018 10:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem Extracting Data From Oracle Database
Replies: 9
Views: 4599

Hi Ray, Sorry for missing the requested information. Here are contents of Configuration file and disk usage: { node "node1" { fastname "XXXXXXX.YYYYYYY.ZZZZZZZ" pools "" resource disk "/opt/IBM/Datasets1" {pools ""} resource disk "/opt/IBM/Datas...
by moalik
Mon Aug 20, 2018 10:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem Extracting Data From Oracle Database
Replies: 9
Views: 4599

Thanks Craig, When ever we face the issue of long running job, the CPU utilization clocks 99% . Now we are considering the timings when the job is getting triggered is causing the problem. Ray, We are using a default.apt configuration file which is indeed pointing to Node01.apt we have 2 Resource Di...
by moalik
Sun Aug 19, 2018 11:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem Extracting Data From Oracle Database
Replies: 9
Views: 4599

Problem Extracting Data From Oracle Database

Hi All, My question is regarding a weird issue we are facing in datastage with respect to extracting data from an oracle table. We are extracting around two hundred and fifty million records from the table and loading it into a dataset. some days the job finishes in 19 minutes with 200k rows/sec and...
by moalik
Tue Jul 18, 2017 8:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Connecting to Apache ActiveMQ from MQConnector
Replies: 5
Views: 3861

I was thinking of something below. Any suggestions would be helpful. 1. Create Java Class to reuqest and response functions by connecting to ActiveMQ. 2. Integrate the code in Java Integration Stage in DataStage to pass the input data to the class and output from the class as response. Have this app...
by moalik
Tue Jul 18, 2017 5:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Connecting to Apache ActiveMQ from MQConnector
Replies: 5
Views: 3861

Thanks for the reply Craig. :)

I was in an assumption that we can connect to any of the Message Queues using thie MQConnector stage,when you integrate the ActiveMQ with IBM Message Broker.

Is there any other way i can connect to the ActiveMQ from Datastage?
by moalik
Tue Jul 18, 2017 5:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Connecting to Apache ActiveMQ from MQConnector
Replies: 5
Views: 3861

Connecting to Apache ActiveMQ from MQConnector

Hi All, I am doing a PoC on Message Queue's in my project. I need to connect to Apache ActiveMQ from my DataStage MQConnector Stage to post a request and read the replies as well. When I am checking the MQ Connector Stage in CLient Mode, it is asking me for Queue Manager Name, User Name and Password...
by moalik
Fri Apr 21, 2017 12:06 am
Forum: General
Topic: How to find when the DataStage Project was last used
Replies: 3
Views: 2600

How to find when the DataStage Project was last used

Hi All, I am performing cleanup activities on our server. I want to know when was last time (anyone logged on to particular DataStage Project) the project was used or did anyone access that project recently? I have been trying the STATUS command it doesn't provides much information. Any help around ...
by moalik
Wed Jun 29, 2016 12:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with Sequential File Stage - No Metadata Rejects
Replies: 3
Views: 2932

Thanks Ray and qt_ky for the prompt replies.
by moalik
Mon Jun 27, 2016 10:04 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem with Sequential File Stage - No Metadata Rejects
Replies: 3
Views: 2932

Problem with Sequential File Stage - No Metadata Rejects

Hi All, I am passing a Comma Separated File as my Input to a sequential file. In the properties, I am enabled the "Reject Property = Output". My Input Data: Col1(Not Nullable), Col2(Not Nullable), Col3 (Nullable) ,a,b ,,c a,b,c a,,c When I am running the job instead of rejecting 3 records,...
by moalik
Thu Jun 23, 2016 10:11 pm
Forum: Information Analyzer (formerly ProfileStage)
Topic: IA Logs
Replies: 3
Views: 5298

Thanks Ray for the quick tip.

Now i have enabled Retain Scripts as part of the project.
by moalik
Wed Jun 22, 2016 6:43 am
Forum: Information Analyzer (formerly ProfileStage)
Topic: IA Logs
Replies: 3
Views: 5298

IA Logs

Hi All, We are carrying out an Data Quality Profiling exercise using Information Analyzer, however facing below issues. 1) IA jobs failed with but nothing in the logs 2) IA jobs completed but no output result. We are trying to find the log details in the below path: IBM\WebSphere\AppServer\profiles\...
by moalik
Tue Nov 03, 2015 4:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Configuring MQ Connector stage in Request/Reply Mode
Replies: 3
Views: 3012

Hi All,

Any solutions please?

Thanks,
Mohsin Khan
by moalik
Wed Oct 28, 2015 5:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Configuring MQ Connector stage in Request/Reply Mode
Replies: 3
Views: 3012

Configuring MQ Connector stage in Request/Reply Mode

Hi All, I am trying to configure MQConnector Stage in Request/Reply Mode. I am trying with the below scenario: Job Design: RowGen -> MQ Connector -> SeqFile I have created the Queue Manager, 2 Queue's one for request and 1 for reply. In the MQ Connector Stage properties, I am configuring the Propert...