DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 151 matches
Author Message
 Topic: BigIntegrate Questions
dsuser_cai

Replies: 1
Views: 401

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Sep 12, 2017 10:47 pm   Subject: BigIntegrate Questions
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Additional info: I have few questions about how BI 11.5 works on hadoop
Hi

We have BI 11.5 on Linux, Hortonworks Data platform. We are building a huge data lake in hadoop. I have few questions about how BI 11.5 works. I couldnt find answers to these in google. So coul ...
 Topic: Loading data from HDFS file into HIVE table using Datastage
dsuser_cai

Replies: 7
Views: 2701

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Sep 12, 2017 10:34 pm   Subject: Loading data from HDFS file into HIVE table using Datastage
We use BigData Stage in a job to load data to HDFS and then use a script to create the HIVE table with correct partitions. We store data in /folder/structure/for_Hive/tableName/yyyy/mm/dd folder forma ...
Resolved
 Topic: Db2 Z loader - Issue
dsuser_cai

Replies: 2
Views: 880

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Apr 17, 2012 5:13 pm   Subject: Db2 Z loader - Issue
Hi

I tried these, and looks like its working fine now.

1) I replaced the z-loader with the DB2 connector stage - this works fine.

2) I deleted the job and re-created the entire load job agai ...
Workaround Reported
 Topic: DB2 stored procedure
dsuser_cai

Replies: 4
Views: 1511

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Apr 17, 2012 1:48 pm   Subject: DB2 stored procedure
Hi

We opened a ticket with IBM to fix this. And here is what we found:
1) the stored proc output had some low values (starting from position 172), so Datastage was truncating everything after tha ...
Resolved
 Topic: Db2 Z loader - Issue
dsuser_cai

Replies: 2
Views: 880

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Apr 17, 2012 1:44 pm   Subject: Db2 Z loader - Issue
DataStage® Release: 8x
Job Type: Parallel
OS: Unix
Additional info: Z loader Job completes, but sequence fails
Hi

I have a job that reads data from a data set (10 fields) and then passes thro transformer (im propagating only 4 fields to output), then i use a Z-loader stage (DB2 Bulk load) to load into the ...
Workaround Reported
 Topic: DB2 stored procedure
dsuser_cai

Replies: 4
Views: 1511

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Mar 05, 2012 8:27 am   Subject: DB2 stored procedure
Hi

Heres the part from copy book where the field is located:

10 DOL-CUST-COVG-DETAIL.
15 DOL-CUST-ACF-COVG-COUNT PIC 9(02).
15 DOL-CUST-ACF-COVG OCCURS ...
Workaround Reported
 Topic: DB2 stored procedure
dsuser_cai

Replies: 4
Views: 1511

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Mar 05, 2012 7:48 am   Subject: DB2 stored procedure
DataStage® Release: 8x
Job Type: Parallel
OS: Unix
Additional info: Values converted into space
Hi

I have a DB2 stored proc, and im passing a parameter (150 char length) and it returns an output of 29500 length. Also the guy who created the stored proc gave me a copy book (output format).
...
 Topic: CFF - Level 88
dsuser_cai

Replies: 2
Views: 898

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sat Mar 03, 2012 7:39 am   Subject: CFF - Level 88
DataStage® Release: 8x
Job Type: Parallel
OS: Unix
Additional info: Does DataStage supports record types of level 88
Hi

I have a DB2 stored procedure that i need to call from DataStage.

It has 2 parameters (1 input - 150 char length and 1output - 29500 length).

I checked the copy book and I see records wit ...
 Topic: Datastage environment audit
dsuser_cai

Replies: 0
Views: 686

PostForum: General   Posted: Tue Feb 14, 2012 12:50 pm   Subject: Datastage environment audit
DataStage® Release: 7x
Job Type: Parallel
OS: Unix
Additional info: datastage audit
Hi

We have multiple projects running in our datastage environment. Also we have both 7.5. & 8.0.1.

We need to implement an audit mechanism to monitor the datastage environment.

We are thi ...
 Topic: Short input record - Sequential file stage
dsuser_cai

Replies: 2
Views: 1006

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Dec 29, 2011 5:59 pm   Subject: Short input record - Sequential file stage
Then i tried to use a column export to have all the fields into 1 field, still not working.

The fields that are missing in the actual file have data type of varchar (not Null). And all the fields h ...
 Topic: Short input record - Sequential file stage
dsuser_cai

Replies: 2
Views: 1006

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Dec 29, 2011 5:56 pm   Subject: Short input record - Sequential file stage
DataStage® Release: 8x
Job Type: Parallel
OS: Unix
Additional info: Short input record
Hi

I have a job that pulls data from s DB2 table and then joins it with a file.

Then we do some transformation, and write it to a sequential file (using a sequential file stage).

The job com ...
 Topic: gethostbyname(dcob04) returned null; node node1 cannot be
dsuser_cai

Replies: 3
Views: 1533

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Aug 20, 2010 6:31 pm   Subject: gethostbyname(dcob04) returned null; node node1 cannot be
Do you have Null handling in place?
Workaround Reported
 Topic: Oracle to Oracle performance
dsuser_cai

Replies: 7
Views: 2223

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Aug 20, 2010 6:25 pm   Subject: Oracle to Oracle performance
How complex is your select query?
Are the two tables in the same database?
Did you check for any locks?

Its always a good practice to have a staging area, before loading into the target (but depe ...
 Topic: ORCHESTRATE
dsuser_cai

Replies: 3
Views: 1199

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Aug 19, 2010 6:07 pm   Subject: ORCHESTRATE
I assueme DB2 as database.
I dont see a "Where" Clause in your statement.
Workaround Reported
 Topic: APT_DecimalNumber::convertToDecimal: the precision is not
dsuser_cai

Replies: 5
Views: 2017

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Aug 19, 2010 5:54 pm   Subject: APT_DecimalNumber::convertToDecimal: the precision is not
Hi

Thanks for the reply.

I was using decimal(38,10) initially, but later on i changed it to decimal(38,38). But this didnt work either. SO i converted the result into varchar(42). Thats when i ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours