Order of stage variables fails a job
Posted: Tue Aug 02, 2016 6:32 pm
Hi all,
We have a parallel job that needs some improvements but is by no means complex. The last transformer in a job is preceeded by lookup stage that drops un-matched records. The transformer writes to dataset with some simple derivations.
The job was running fine in non-prod environments, but started failing on 4 production engine nodes (fifth one dedicated to conductor).
The failure message is "Player 9 terminated unexpectedly" with Player 9 being the transformer.
The stage variables causing this failure are:
svZoneLenId
------
Len(Trim(DecimalToString( To_Xfm.POS_ZONE_ID,"suppress_zero")) )
svZoneId
------
Trim(DecimalToString( To_Xfm.POS_ZONE_ID,"suppress_zero"))
When written as such the Dump Score advises there are 21 datasets.
If however, the order of stage variables is swapped so that svZoneId appears first, the job completes and the Dump Score advises there are 20 datasets instead.
I know these stage variables are not written in the best way but even as they are they should not be causing a failure?
Regards,
Novak
We have a parallel job that needs some improvements but is by no means complex. The last transformer in a job is preceeded by lookup stage that drops un-matched records. The transformer writes to dataset with some simple derivations.
The job was running fine in non-prod environments, but started failing on 4 production engine nodes (fifth one dedicated to conductor).
The failure message is "Player 9 terminated unexpectedly" with Player 9 being the transformer.
The stage variables causing this failure are:
svZoneLenId
------
Len(Trim(DecimalToString( To_Xfm.POS_ZONE_ID,"suppress_zero")) )
svZoneId
------
Trim(DecimalToString( To_Xfm.POS_ZONE_ID,"suppress_zero"))
When written as such the Dump Score advises there are 21 datasets.
If however, the order of stage variables is swapped so that svZoneId appears first, the job completes and the Dump Score advises there are 20 datasets instead.
I know these stage variables are not written in the best way but even as they are they should not be causing a failure?
Regards,
Novak