DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 32 matches
Author Message
 Topic: How to prevent CHECKSUM stage to re-arrange column names
rohit_mca2003

Replies: 3
Views: 103

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jan 15, 2018 10:10 pm   Subject: How to prevent CHECKSUM stage to re-arrange column names
Thanks Craig.
I need to generate CHECKSUM based on the column order as there is requirement to have keys in specific order.
Existing application is running in production where hash was generated ba ...
 Topic: SORT:Restrict Memory Usage
rohit_mca2003

Replies: 5
Views: 2997

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jan 15, 2018 4:46 am   Subject: SORT:Restrict Memory Usage
Try using variable APT_OLD_BOUNDED_LENGTH and set to 'True'.
 Topic: How to prevent CHECKSUM stage to re-arrange column names
rohit_mca2003

Replies: 3
Views: 103

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jan 15, 2018 4:37 am   Subject: How to prevent CHECKSUM stage to re-arrange column names
DataStage® Release: 9x
Job Type: Parallel
OS: Unix
Additional info: CHECKSUM stage re-arranges the columns while computing hash
Hi Everyone,

I have issue while computing hash value using 'CHECKSUM' stage. It seems that CHECKSUM stage re-arranges the columns as per their names while computing the hash value.

Example:
--- ...
Resolved
 Topic: How to stop default type conversion in MODIFY stage
rohit_mca2003

Replies: 3
Views: 119

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jan 11, 2018 10:31 pm   Subject: How to stop default type conversion in MODIFY stage
This issue is resolved when I defined the conversion as below:

Output_Col:string[max=20]=string_trim[in_col]

If I assigned the value as string[20], is was treating it as CHAR and adding space so ...
Resolved
 Topic: How to stop default type conversion in MODIFY stage
rohit_mca2003

Replies: 3
Views: 119

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jan 11, 2018 10:08 pm   Subject: How to stop default type conversion in MODIFY stage
This option does not restrict the length of output_col. We have used this parameter earlier to restrict the usage of disk and scratch space.
Resolved
 Topic: How to stop default type conversion in MODIFY stage
rohit_mca2003

Replies: 3
Views: 119

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jan 11, 2018 8:15 am   Subject: How to stop default type conversion in MODIFY stage
DataStage® Release: 9x
Job Type: Parallel
OS: Unix
Additional info: Datatype length exceeds while NULL handling and String Trim
Hi,

I have generic job where I am handling NULL and performing TRIM for string type of column.
As output column of these, If I do not assign data length for output then by default it increases the ...
 Topic: How to handle double quote in Column Name (Teradata)
rohit_mca2003

Replies: 1
Views: 440

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Sep 07, 2017 9:41 pm   Subject: How to handle double quote in Column Name (Teradata)
DataStage® Release: 9x
Job Type: Parallel
OS: Unix
Additional info: Teradata column name have double quote
Hi,
I have a requirement to handle double quote in the teradata column name. Since teradata does not accept column which are same as reserved words so it has been created as "TITLE".

I have a RCP ...
 Topic: HASH Partition not working for Checksum values
rohit_mca2003

Replies: 5
Views: 690

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jul 31, 2017 9:01 pm   Subject: HASH Partition not working for Checksum values
When I say join is not happening properly it means if I run the join in sequence or in entire partitions then it is working fine.
but with HASH partition, partition does not seems to be working fine ...
 Topic: HASH Partition not working for Checksum values
rohit_mca2003

Replies: 5
Views: 690

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jul 31, 2017 4:25 am   Subject: HASH Partition not working for Checksum values
DataStage® Release: 9x
Job Type: Parallel
OS: Unix
Additional info: Passing MD5 hash value to HASH Partition
Hi,

I need to join the columns (using join stage) which have MD5 hash values (using Checksum stage for this).

I have same data in source and target so expected to match all the records but join ...
 Topic: Join the columns having HASH values
rohit_mca2003

Replies: 3
Views: 636

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jul 27, 2017 2:38 am   Subject: Join the columns having HASH values
Hi,

I checked the checksum values and it is same what ever is in target. Also if DataStage generates different checksum for same value then it should not be used.

Thanks.
 Topic: Join the columns having HASH values
rohit_mca2003

Replies: 3
Views: 636

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jul 27, 2017 1:36 am   Subject: Join the columns having HASH values
DataStage® Release: 9x
Job Type: Parallel
OS: Unix
Additional info: Join does not work when columns have hash value
Hi,

We have requirement to join the columns having HASH value (these hash values have been computed by checksum).

First I tried by 'hash Partition' and sort on this column (which has hash value) ...
 Topic: Error when generating checksum on vector sub record column
rohit_mca2003

Replies: 0
Views: 342

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Jul 18, 2017 1:36 am   Subject: Error when generating checksum on vector sub record column
DataStage® Release: 9x
Job Type: Parallel
OS: Unix
Hi,
I have a requirement where I have to generate checksum for vector sub record (records get combine based on key column) but while doing so I am getting below error:

"Traceback: Could not obtain ...
Resolved
 Topic: Algorithm used (by default) for Checksum Stage
rohit_mca2003

Replies: 2
Views: 631

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Feb 22, 2017 8:32 pm   Subject: Algorithm used (by default) for Checksum Stage
Thanks Chulett,
I can see output generated by CHECKSUM is 32 character alphanumeric string.
As you suggested, I assume this is Hash MD5.

Thanks.
Resolved
 Topic: Algorithm used (by default) for Checksum Stage
rohit_mca2003

Replies: 2
Views: 631

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Feb 22, 2017 8:28 am   Subject: Algorithm used (by default) for Checksum Stage
DataStage® Release: 9x
Job Type: Parallel
OS: Unix
Hi,
Could you please advise which algorithm gets applied when we use CHECKSUM stage in DataStage 9.1? Is it 'Hash MD5' or anything else?

Thanks,
Workaround Reported
 Topic: Generate multiple Checksum/SK in a generic job
rohit_mca2003

Replies: 5
Views: 852

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Feb 22, 2017 8:23 am   Subject: Generate multiple Checksum/SK in a generic job
Thanks for the replies.
Even we are following similar approach. Putting a maximum number of Checksum.
For each checksum we provide column/s using parameter. This job is RCP.
At the end we Drop unn ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours