Parallel job with multiple joined tables not fully optimized
Posted: Wed Jul 18, 2018 8:19 am
Hello,
I am trying to optimize a parallel job that contains 7 teradata connector as input, 1 teradata connector as output. In between a join stage (and a few transfomer stages) that put all input tables together.
see a picture:
The result is a non fully optimized job.
here are some more details:
Optimizer
- release of optimizer release 11.5.0.0B2016.04.14c-201411004
- options: isGenOrdBy,PushProcToSrcs,PushProcToTrgts,PushAllToDB
Job
all input teradata connectors have access method "bulk", the output teradata connector has access method "bulk" + load type "update.
all input teradata connectors have a custom select statement (some with subqueries)
the optimization log displays warnings that say "WARNING: Impossibile generare istruzioni di query combinate per i link link_to_join_anag_cli,link_to_join_segm,link_to_join_rat_int,link_to_join_rat_moodys,link_to_join_rat_stpoor,link_to_join_rat_fitch,link_to_join_rat_dbrs,link_to_trasf. Il pattern viene abbandonato."
Which means more or less "it is not possible to create combined query instructions for the link: [link_names]"
has anyone ever encountered a similar issue? how can it be solved?
thank you,
I am trying to optimize a parallel job that contains 7 teradata connector as input, 1 teradata connector as output. In between a join stage (and a few transfomer stages) that put all input tables together.
see a picture:
The result is a non fully optimized job.
here are some more details:
Optimizer
- release of optimizer release 11.5.0.0B2016.04.14c-201411004
- options: isGenOrdBy,PushProcToSrcs,PushProcToTrgts,PushAllToDB
Job
all input teradata connectors have access method "bulk", the output teradata connector has access method "bulk" + load type "update.
all input teradata connectors have a custom select statement (some with subqueries)
the optimization log displays warnings that say "WARNING: Impossibile generare istruzioni di query combinate per i link link_to_join_anag_cli,link_to_join_segm,link_to_join_rat_int,link_to_join_rat_moodys,link_to_join_rat_stpoor,link_to_join_rat_fitch,link_to_join_rat_dbrs,link_to_trasf. Il pattern viene abbandonato."
Which means more or less "it is not possible to create combined query instructions for the link: [link_names]"
has anyone ever encountered a similar issue? how can it be solved?
thank you,