DSXchange

Thanks for the suggestion, I'll probably do that and see how it goes. The problem is I can't replicate the issue in test environment which makes it difficult and time taking. Anyways I'll try to divide the job and post my findings.

We have a job which has two DB2 connector stages which run two select queries then the output is fed to funnel stage then it's fed to transformer where the records are separated based on certain conditions and further aggregated on a group of columns. The select query in the DB2 connectors join mult...

Its working now, I kept one column at a time in the aggregation and tested the job. After testing for all columns, I found out that there are two columns which are causing problem when the preserve type is set to true. one has type bigint other has decimal. When I'm setting the preserve type to fals...

I'm sorting the data in the input of aggregator stage, before that it's as it is. In the iput of aggregator stage I've used hash partition and sorting in ascending order. In the input of target dataset I've used same partition to collect the data.

It should work in this way as well right?

The load is the usual what we've been running. Also, the aggregator was set to sort mode only.

I didn't get any other error/warning messages, before the first line. I got the usual messages, see below. Parallel job initiated Parallel job default NLS map UTF-8, default locale OFF main_program: IBM InfoSphere DataStage Enterprise Edition 11.5.0.7555 Copyright (c) 2001, 2005-2015 IBM Corporation...

Hello everyone, I've been struggling with this issue since last couple of days. I've a job which is combining six datasets using funnel stage and the output of funnel stage is given as input to aggregator stage. The aggregator is grouping the different columns based on one id column and writing the ...