Search found 37 matches

by samratisking
Thu Oct 01, 2015 7:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP on ODBC stage - MySQL
Replies: 4
Views: 2817

Hi Ray, Searched around and this could be due to number of issues. According to IBM, could be an issue with using 'CIO' option while mounting the scratch and resource disks. Someone in dsxchange was referring that this could be an issue with compiler version used. Currently we are using Datastage 11...
by samratisking
Thu Oct 01, 2015 5:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP on ODBC stage - MySQL
Replies: 4
Views: 2817

Hi ArndW, These are the messages from the log. "APT_CombinedOperatorController,0: Fatal Error: waitForWriteSignal(): Premature EOF on node xxxx-yyyy-zzzz-360etl-x1 Socket operation on non-socket" "APT_CombinedOperatorController,1: Fatal Error: waitForWriteSignal(): Premature EOF on no...
by samratisking
Thu Oct 01, 2015 2:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP on ODBC stage - MySQL
Replies: 4
Views: 2817

RCP on ODBC stage - MySQL

Hi, My requirement is to extract data from different tables using ODBC stage using MySQL. We have multiple tables with around 50 fields and 40 million records each. My job design is simple: ODBC -> Copy -> Dataset. RCP is enabled and no metadata is defined in any of the stages. But, when I'm executi...
by samratisking
Mon Sep 28, 2015 1:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Split the Input Source into Multiple Datasets
Replies: 2
Views: 2523

Split the Input Source into Multiple Datasets

Hi All, My requirement is to split the data in a table (80 - 100 fields) into multiple datasets at the target. The target datasets should be created dynamically in the following way: Dataset1 - 1 to 30 columns Dataset2 - 31 to 60 columns Dataset3 - 61 to 90 columns Dataset4 - 91 to 100 columns. We a...
by samratisking
Sun Sep 20, 2015 6:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Selecting fields using Schema files
Replies: 7
Views: 4046

Sure. Here you go. To test the schema file, I took a simple job SeqFile--->SeqFile. I defined a simple schema file as below. record {final_delim=end,delim=',',record_delim='\n',quote=none,padchar='#'} ( Col3:string[max=255]; Col1:string[max=255] ) My input file is as follows. Col1,Col2,Col3,Col4 Hi,...
by samratisking
Sun Sep 20, 2015 6:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Selecting fields using Schema files
Replies: 7
Views: 4046

I tried it and could not get the result I was looking for.

The join is being used with a Key that I am bringing out of the Source explicitly and I do not have any concerns about the join.

My only issue is with the Schema file and the way it works.

Any ideas please?

Regards,
Sam
by samratisking
Sat Sep 19, 2015 11:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Selecting fields using Schema files
Replies: 7
Views: 4046

Selecting fields using Schema files

Hi All, I am trying to build a job with SequentialFile-->Transformer-->Join--->Target(SQL Server Table). For this I am trying to use the Schema file to take the table definition in the Sequential file(.csv file), as my source metadata might change frequently and I'm using RCP in my job. My sequentia...
by samratisking
Tue Mar 10, 2015 10:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MDM Connector Stage - Datastage 11.3
Replies: 3
Views: 4097

MDM Connector Stage - Datastage 11.3

Hi All, Our job is a simple design, reading data from an Oracle table and loading that into MDM. We are currently trying to write data into MDM using the built-in MDM Connector stage and getting the following errors. MDM_Connector_95,1: Failed to connect to the server XYZ. MDM_Connector_95,0: Fatal ...
by samratisking
Tue Sep 18, 2012 5:11 am
Forum: General
Topic: main_program: Parameter not resolvable
Replies: 2
Views: 2189

?

Did anyone resolve this issue? I am on the same boat.....
by samratisking
Thu Jun 28, 2012 6:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Null value on the accessor interfacing to field "Column
Replies: 0
Views: 1613

Null value on the accessor interfacing to field "Column

Hi, I am trying to extract data from an object in SalesForce. The column 'Column1' is Large Binary type in SalesForce. So, in DataStage I have used the datatype as LongVarBinary. The job is simple, just a SalesForceConnector ----> Sequential File. I defined the 'Column1' as Nullable. When I execute ...
by samratisking
Thu Sep 02, 2010 6:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Changing the Data format - Columns to Rows
Replies: 9
Views: 5205

Hi,

Can we do all these operations using a pivot stage??
by samratisking
Thu Sep 02, 2010 12:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Changing the Data format - Columns to Rows
Replies: 9
Views: 5205

ray.wurlod wrote:Excellent.

(My server job background came through for a bit, there.) ...
It's the same with me. It's just the necessity that I have to decrease the complexity of the job. I am from server jobs background too. Thanks Ray.
by samratisking
Thu Sep 02, 2010 12:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Changing the Data format - Columns to Rows
Replies: 9
Views: 5205

ravireddy25 wrote:Hi,
No Need Transformer stage ,you can use copy stage ,have two output links and rename the 2nd link column names to first link column names before funneling.
Cool.. That's exactly.. what i had in mind. I mean, the Funnelling wont work if I dint. Thanks..
by samratisking
Wed Sep 01, 2010 11:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Changing the Data format - Columns to Rows
Replies: 9
Views: 5205

Transformer stage with two outputs followed by a Funnel stage. The key goes to both output links. The first three columns go to the first output link, the other three columns go to the second output ... Hi Ray, That's a cool way of doing it. Instead, you think I can use a Copy stage and Funnel stag...
by samratisking
Wed Sep 01, 2010 9:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Changing the Data format - Columns to Rows
Replies: 9
Views: 5205

Changing the Data format - Columns to Rows

Hi, I have data like the following: Col1 ColA ColB ColC ColA1 ColB1 ColC1 -------------------------------------------------------------- 123 abc def ghi jkl mno pqr 456 stu vwx yza bcd efg hij My requirement is that I need the data in the following format: Col1 ColA ColB ColC -----------------------...