DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
thompsonp



Group memberships:
Premium Members

Joined: 01 Mar 2005
Posts: 198

Points: 1861

Post Posted: Thu Jan 04, 2018 3:37 am Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Any idea what impact the patches to Linux and Windows to address the Intel cpu flaw will likely have on typical DataStage workloads?

I've been reading that workloads with lots of network and i/o may be worst hit with up to a 30% performance drop.
qt_ky



Group memberships:
Premium Members

Joined: 03 Aug 2011
Posts: 2819
Location: USA
Points: 21356

Post Posted: Thu Jan 04, 2018 8:10 am Reply with quote    Back to top    

I read that yesterday also... in the 18% to 30% overhead range. That is significant!!! I'm glad we run ours on POWER8!

_________________
Choose a job you love, and you will never have to work a day in your life. - Confucius
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42765
Location: Denver, CO
Points: 220367

Post Posted: Thu Jan 04, 2018 8:29 am Reply with quote    Back to top    

Ah... hadn't heard of this yet but was just reading about their "Page Table Isolation" issue in articles like this one and this one. Thankfully, gaming performance doesn't seem to be effected but who games on a Linux box anyway? Wink

There seems to be a lot of "depends" around this, for example from the second link:

Quote:
Performance penalties from single to double digits are expected on patched kernels. The penalty depends upon how much interaction the application/workload deals with the kernel if there's a lot of context switching and other activity. If it's a simple user-space application not doing much, the x86 PTI additions shouldn't cause much of an impact. Newer Intel CPUs with PCID should also help in ensuring less of a performance impact.

_________________
-craig

Research shows that 6 out of 7 dwarves aren't happy
Rate this response:  
Not yet rated
PaulVL



Group memberships:
Premium Members

Joined: 17 Dec 2010
Posts: 1255

Points: 8249

Post Posted: Thu Jan 04, 2018 12:23 pm Reply with quote    Back to top    

I just read about this topic. Nasty


pushing out patches to a raised floor area is never easy or fast. Big companies will most likely lag on this patching for their ETL environments.

But ya... it would be interesting to see the hit on DataStage.

If someone out in the wild is about to patch this... please share your results with us. Select a good meaty job to run. Not a 2 min job.

Do a pre/post patch run of course.
Application restart times logged, etc...
Rate this response:  
Not yet rated
qt_ky



Group memberships:
Premium Members

Joined: 03 Aug 2011
Posts: 2819
Location: USA
Points: 21356

Post Posted: Fri Jan 05, 2018 12:44 pm Reply with quote    Back to top    

Now it sounds like there are two vulnerabilities and one of them is not limited to Intel CPUs as it affects a lot of CPU types including IBM POWER...

https://www.ibm.com/blogs/psirt/potential-impact-processors-power-family/

_________________
Choose a job you love, and you will never have to work a day in your life. - Confucius
Rate this response:  
Not yet rated
UCDI



Group memberships:
Premium Members

Joined: 21 Mar 2016
Posts: 336

Points: 3396

Post Posted: Mon Jan 08, 2018 1:27 pm Reply with quote    Back to top    

we knew it was going to be brutal though. You can't really patch a CPU. The BIOS, but not the actual CPU chip. So they *have* to be jacking in a software solution that bypasses the hardware flaw which *has* to be a ton slower. This is on par with taking the math coprocessor off the chip for us old guys Smile
Rate this response:  
Not yet rated
asorrell
Site Admin

Group memberships:
Premium Members, DSXchange Team, Inner Circle, Server to Parallel Transition Group

Joined: 04 Apr 2003
Posts: 1683
Location: Colleyville, Texas
Points: 22862

Post Posted: Wed Jan 10, 2018 9:27 am Reply with quote    Back to top    

UCDI wrote:
...This is on par with taking the math coprocessor off the chip for us old guys Smile


I prefer "seasoned" or "experienced"... thank you! Smile

...and yes - this is going to be a real pain if your system is already stressed.

One of the major game platforms patched their Linux servers and said they saw a "hit in excess of 20% of performance capacity".

_________________
Andy Sorrell
Certified DataStage Consultant
IBM Analytics Champion 2009 - 2017
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours