DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
This topic has been marked "Resolved."
Author Message
jackson.eyton
Participant



Joined: 26 Oct 2017
Posts: 38

Points: 813

Post Posted: Wed Dec 06, 2017 3:55 pm Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Windows
Hi everyone,
I'm about midway through an advanced DataStage class with existBI and we recently went over job optimization in the lab.

I have a good number of jobs that are essentially just moving data with some basic type conversions from one table to another in the same database. Based on what I have learned from the optimize features there's a good chance I could offload a good portion of that to the SQL server itself, in my case a Netezza.

However, my coworker nor I can use Optimize in our Designer. The icon is missing entirely from the toolbar, and it's greyed out under the File menu. Does anyone have any insight as to why this might be?

_________________
-Me
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42283
Location: Denver, CO
Points: 217108

Post Posted: Wed Dec 06, 2017 5:13 pm Reply with quote    Back to top    

It's a paid option...

_________________
-craig

Watch out where the huskies go and don't you eat that yellow snow
Rate this response:  
Not yet rated
priyadarshikunal



Group memberships:
Premium Members

Joined: 01 Mar 2007
Posts: 1735
Location: Troy, MI
Points: 9315

Post Posted: Thu Dec 07, 2017 5:45 am Reply with quote    Back to top    

With such "basic transformation" you could optimize it yourself. Few years back that option wasn't there in datastage at all.

_________________
Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. Wink
Rate this response:  
Not yet rated
jackson.eyton
Participant



Joined: 26 Oct 2017
Posts: 38

Points: 813

Post Posted: Thu Dec 07, 2017 8:11 am Reply with quote    Back to top    

Yea, pretty sure we paid for it but I will have to double check. I will have to check into the self optimization further, netezza uses some SQL functions that I am not familiar with and omits some that I am more familiar with. I was quite curious to see how DataStage wrote the code for some of the optimizations from a reverse engineering standpoint. :-p

_________________
-Me
Rate this response:  
Not yet rated
qt_ky



Group memberships:
Premium Members

Joined: 03 Aug 2011
Posts: 2668
Location: USA
Points: 19836

Post Posted: Thu Dec 07, 2017 8:25 am Reply with quote    Back to top    

DataStage Balanced Optimization used to be an additional cost option before version 11.5.

Here is a quote from the "What’s new in InfoSphere Information Server V11.5?" PDF (IMS14481USEN).

Additional features at no extra cost: Your organization can
use additional features such as access to popular enterprise
applications, including:
– Salesforce.com
– Hyperion Essbase
– Siebel
– JD Edwards Enterprise One
– PeopleSoft Enterprise
– Oracle applications

You can also take advantage of push-down optimization
through IBM DataStage Balanced Optimization features.
These features allow you to fully harness available capacity and
computing power in your relational databases and in InfoSphere
DataStage.

_________________
Choose a job you love, and you will never have to work a day in your life. - Confucius
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42283
Location: Denver, CO
Points: 217108

Post Posted: Thu Dec 07, 2017 10:31 am Reply with quote    Back to top    

Cool

_________________
-craig

Watch out where the huskies go and don't you eat that yellow snow
Rate this response:  
Not yet rated
jackson.eyton
Participant



Joined: 26 Oct 2017
Posts: 38

Points: 813

Post Posted: Thu Dec 07, 2017 11:40 am Reply with quote    Back to top    

Thanks QT_KY,
We are indeed 11.5 here, it sounds like this is something that our server administrators may not have setup when they installed InfoSphere?

_________________
-Me
Rate this response:  
Not yet rated
qt_ky



Group memberships:
Premium Members

Joined: 03 Aug 2011
Posts: 2668
Location: USA
Points: 19836

Post Posted: Thu Dec 07, 2017 1:01 pm Reply with quote    Back to top    

That is entirely possible. We did not install that option either. At the time of our install, it was not known to us to be a no extra cost option in 11.5.

This can be verified on the server. Go to the install directory where the Version.xml file is:

$ grep -i bal response.txt
DataStage.BalOp=false

_________________
Choose a job you love, and you will never have to work a day in your life. - Confucius
Rate this response:  
Not yet rated
asorrell
Site Admin

Group memberships:
Premium Members, DSXchange Team, Inner Circle, Server to Parallel Transition Group

Joined: 04 Apr 2003
Posts: 1637
Location: Colleyville, Texas
Points: 22256

Post Posted: Mon Dec 11, 2017 9:10 pm Reply with quote    Back to top    

Though it is no longer chargeable, it is definitely still an optional installation step. Many administrators don't realize that it was included in the base license at 11.5, and still don't install it.

Be aware that there are a number of restrictions placed on when Balanced Optimization will automatically push SQL down to the database.

https://www.ibm.com/support/knowledgecenter/en/SSZJPZ_11.5.0/com.ibm.swg.im.iis.ds.parjob.dev.doc/topics/limitations.html

_________________
Andy Sorrell
Certified DataStage Consultant
IBM Analytics Champion 2009 - 2017
Rate this response:  
Not yet rated
jackson.eyton
Participant



Joined: 26 Oct 2017
Posts: 38

Points: 813

Post Posted: Tue Dec 12, 2017 8:41 am Reply with quote    Back to top    

Yea it turns out we started with 11.3 and upgraded to 11.5. The individual who did the upgrade was not aware that this was now a non-charged inclusion and just used the same response file he used before. Working to have him get it installed. Thanks for that list of limitations! Looks like most of what I am looking to do is supported so I'm still quite curious to give it a shot on some of my jobs.

_________________
-Me
Rate this response:  
Not yet rated
rkashyap



Group memberships:
Premium Members

Joined: 02 Dec 2011
Posts: 500
Location: Richmond VA
Points: 4534

Post Posted: Thu Dec 14, 2017 4:30 pm Reply with quote    Back to top    

Post initial installation, Balanced optimization can be turned on/off thru iisAdmin.

Command to switch it ON:
Code:
<IS_install_path>/ASBServer/iisAdmin.sh -set -key com.ibm.iis.datastage.license.feature.BAL_OPT -value 1
Rate this response:  
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42283
Location: Denver, CO
Points: 217108

Post Posted: Thu Dec 14, 2017 7:12 pm Reply with quote    Back to top    

If it's installed. Wink

_________________
-craig

Watch out where the huskies go and don't you eat that yellow snow
Rate this response:  
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours