Number of transformer stages affects performance ?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

kaps
Participant
Posts: 452
Joined: Tue May 10, 2005 12:36 pm

Post by kaps »

Yes. You are missing something. If you look at Ray's last post in this topic you can see missing things. I was just trying to draw conclusion here after performing the tests.

Thanks for pointing me to the Redbook somehow I missed that but filter stage is taken just as an example here and what I was trying to understand is broader than that. Redbook also says do not use Transformer stage for simple copying and use Copy stage but I only see a 1 sec difference between them for the same volume I mentioned earlier.

Thanks for the valuable points made.
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

I'm glad you tested the performance questions yourself.
Choose a job you love, and you will never have to work a day in your life. - Confucius
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Post by priyadarshikunal »

kaps wrote:Yes. You are missing something. If you look at Ray's last post in this topic you can see missing things. I was just trying to draw conclusion here after performing the tests.
I am glad as well that you tested it yourself. Are you sure now that using a transformer is not an issue anymore. You may like to consider the compilation time as well for the tests you are performing, if you want to.
Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Check the date (year) that that Redbook was publlished.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Post by priyadarshikunal »

That would be Sept 2010
Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Post by priyadarshikunal »

However last update happened to the page in Feb 2013.
Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
Post Reply