Search found 32 matches

by vgupta88
Fri Sep 15, 2017 1:27 am
Forum: General
Topic: Calling job from Java
Replies: 6
Views: 4135

For using dsjob command - can you please reply for my second concern i.e. 2) Can the Unix box connect with cloud based system? Some of my seniors said 'NO' but I just wanted you guys opinion on this.

Thanks!
by vgupta88
Thu Sep 14, 2017 7:11 am
Forum: General
Topic: Calling job from Java
Replies: 6
Views: 4135

Calling job from Java

Hi All, I am not much aware about Java so here is my scenario: 1) We have a new project going and we need to suggest technology stack for the project and primarily the ETL tool. 2) We have Amazon S3 as our file storage system. 3) This is a Gaia cloud based project. We have Gaia Maria DB as our datab...
by vgupta88
Thu Sep 14, 2017 7:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading and writing data into csv files?
Replies: 14
Views: 12392

No inputs from anyone?

Thanks!
by vgupta88
Mon Sep 11, 2017 8:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading and writing data into csv files?
Replies: 14
Views: 12392

It seems like the metadata needs to be same. Otherwise it throws an error - Different number of columns in the sheets <sheet_name>.
by vgupta88
Mon Sep 11, 2017 12:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading and writing data into csv files?
Replies: 14
Views: 12392

Thanks Craig!
Just one more concern, does metadata in different tabs present in excel sheet needs to same in Unstructured Data Stage?

Thanks in advance.
by vgupta88
Thu Sep 07, 2017 7:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading and writing data into csv files?
Replies: 14
Views: 12392

So, any other method to achieve this?
The basic thing that I am looking after is generating new excel spreadsheet. I can manage with basic one single tab also.

Any help would be much appreciated!

Thanks!
by vgupta88
Thu Sep 07, 2017 4:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading and writing data into csv files?
Replies: 14
Views: 12392

My bad.. So to clear out confusion and to explain better - I have excel spreadsheets which are saved as .csv file format. ;-) These spreadsheets have multiple client specific tabs in it. So now, I want to process these spreadsheets data, transform them and create a new excel spreadsheet with similar...
by vgupta88
Wed Sep 06, 2017 11:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading and writing data into csv files?
Replies: 14
Views: 12392

Craig,

I have multiple tabs in the csv file which needs to be processed which I suppose makes it "Unstructured"

Thanks!
by vgupta88
Wed Sep 06, 2017 12:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading and writing data into csv files?
Replies: 14
Views: 12392

Reading and writing data into csv files?

Hi All, I have a requirement where I need to read data from csv file (e.g. file_one.csv), apply some transformations on the data and then load that data into a new csv file (e.g. file_two.csv). I tried using Unstructured Data stage as my Target but it shows me an error that "it doesn't support ...
by vgupta88
Mon Aug 14, 2017 6:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Premature EOF on node XXX Socket operation on non-socket
Replies: 1
Views: 3320

Got the solution in the below link:

viewtopic.php?p=420128


Thanks!
Vaibhav
by vgupta88
Mon Aug 14, 2017 3:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Premature EOF on node XXX Socket operation on non-socket
Replies: 1
Views: 3320

Premature EOF on node XXX Socket operation on non-socket

Hi All, I searched in the forums for my below error but no luck with the solution. Please help asap. I have a below job design where I am doing a range lookup on date columns with below logic: Reference (Effective Start and Effective End dates are pulled) | | | V src (Date)----> LookUp Stg (LookUp F...
by vgupta88
Mon Jul 17, 2017 3:16 am
Forum: General
Topic: Calling the same job multiple times in parallel
Replies: 8
Views: 5900

Yes, my main sequence also runs multiple times.

My job runs for few minutes so I am not sure if adding few seconds sleep would help. Also, if I do that how I am going to achieve parallelism? Your thoughts please. However, I am going to try on your suggestion and will let you know the outcome. Thanks!
by vgupta88
Wed Jul 12, 2017 1:21 am
Forum: General
Topic: Calling the same job multiple times in parallel
Replies: 8
Views: 5900

Hi Craig, Below is my job design. After Job 1 is completed, it calls Job 2 with different Invocation ID's in parallel. All three jobs i.e. Job 1, Job 2 and the main sequencer are Multiple Instance jobs. Job 2 ^ | | Job 1 -------> Job 2 | | v Job 2 Can I achieve this? Appreciate your help! Thanks!
by vgupta88
Tue Jul 11, 2017 12:06 pm
Forum: General
Topic: Calling the same job multiple times in parallel
Replies: 8
Views: 5900

Calling the same job multiple times in parallel

Hi All, I have a sequence that has several number of job activities in it. All these call the same job which was set to run multiple times(check Multiple instance). The invocation id was specified on all the job activities was different. But the sequence was not running parallel, moreover it is fail...
by vgupta88
Tue Jul 11, 2017 9:20 am
Forum: General
Topic: Running the same job multiple times
Replies: 3
Views: 3361

I am also facing the same issue. Job Invocation ID's are passed different. Any thoughts?

Thanks!