I have a job design and scenario below.
Code: Select all
Oracle Reference
|
Sort Stage
|
Transformer
|
|
oracle Source-->Transformer--->Lookup---> Tranformer---> Oracle Target
|
|
Oracle(Reject)
2) Oracle Reference Contains Title_ids(lookup column)-- char2(20 char)
3) When i am trying to lookup based on lookup key column(Title_Id) some records from source are getting rejecting into Oracle(Reject) eventhough it has matching records in reference.
4)From both the source and reference i am getting duplicate Title_Ids so I have to take only latest date(registration_date), title_Ids from reference,so i used to sort stage and generated change code key column with desc and got the latest title_ids from Reference.
Oracle Source count(725)
Oracle reference Count(6001471)
After sorting based on date(8803)
Target count (28)
Oracle Reject(703)
I am able to see atleast 200 records which are matching between source and reference but not going into Target.
Below Data will be like this:
Source:char2(70 char) Not Null
Title_Ids
01099393999936473840
01099393999936473840
Reference:char2(20 char) Not Null
Title_Ids Market Value(reference) Registration_date
01099393999936473840(after sorting) 100000 20-Apr-15
Target:char2(70 char) Not Null
Title_Ids Title_Ids Market Value(reference) Registration_date
01099393999936473840 01099393999936473840 100000 20-Apr-15
01099393999936473840 01099393999936473840 100000 20-Apr-15
Could you please let me know what needs to be done for this lookup failure scenario.
Thanks,
Sudheer