Page 1 of 1

Partial records are loaded while joining

Posted: Mon Apr 17, 2017 8:46 pm
by praburaj
Hi All,

I have two dataset in my prod job and doing left outer join based on the column(GL_PROD,GL_ACCT). The key columns datatype is Decimal. After completing the run, out of two records only one record was populated into target datset even though key column values are matched. Due to that,unable to complete the run.

Kindly assist on this how to sort out this issue.

Source dataset-->
---------------------------
GL_PROD GL_ACCT ID_DEPT

100.,54876.,343
100.,54876.,589

Reference dataset
----------------------
GL_PROD GL_ACCT

100.,54876.

Target Dataset:
-----------------
100,54876,343

Posted: Tue Apr 18, 2017 12:43 am
by ray.wurlod
What stage type are you using? For example this (not picking up duplicates) is default behaviour for a Lookup stage.

Are there any warnings in the job log?

Posted: Tue Apr 18, 2017 7:10 am
by Mike
If you are using a join stage, check your link order. Your source dataset should provide the data for the left link and your reference dataset should provide the data for the right link Your results are indicative of having them backwards.

Mike