DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
hal_ds
Participant



Joined: 12 Feb 2018
Posts: 4

Points: 26

Post Posted: Mon Feb 12, 2018 10:40 pm Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hello,

Can you someone tell me what are the verification steps to perform in Datastage once Datastage Parallel edition 11.x installed on new Unix server. Like running the jobs, Checking the database connectivity, reading the file...is there any steps I can find to verify post installation.

Thanks in Advance!!

Regards
Hal
qt_ky



Group memberships:
Premium Members

Joined: 03 Aug 2011
Posts: 2746
Location: USA
Points: 20577

Post Posted: Tue Feb 13, 2018 6:35 am Reply with quote    Back to top    

Run the ISA Lite Health Check first.

Then make sure a parallel job with Transformer stage compiles, runs, and gives correct results on 2 nodes. In the past, I have detected compiler version mismatch issues from doing that sort of test.

Then run a variety of DataStage jobs and test your Connector stages.

Setup and schedule any administrative server start/stop scripts and maintenance/backup scripts and test those out.

If all that is good then start migrating projects and developers onto the system.

_________________
Choose a job you love, and you will never have to work a day in your life. - Confucius
Rate this response:  
Not yet rated
PaulVL



Group memberships:
Premium Members

Joined: 17 Dec 2010
Posts: 1232

Points: 8099

Post Posted: Tue Feb 13, 2018 9:16 am Reply with quote    Back to top    

Is this a brand new setup or are you going to migrate jobs from an existing setup into your new one?

Validate your scratch disks, TMPDIR (don't leave it blank), APT file, etc...


Hints:

Permissions on Project paths (sticky bit helps).
Sticky bit on a path under the DSODB directory.

If you have a Head Node + Compute Node setup, start writing validation scripts to ensure all is well across the systems.

Mounts on HN = Mounts on CNs.
NPROCS is a sane value on the hosts.
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42530
Location: Denver, CO
Points: 218857

Post Posted: Tue Feb 13, 2018 12:05 pm Reply with quote    Back to top    

PaulVL wrote:
NPROCS is a sane value on the hosts.

Serious question... how does one measure the sanity of this value?

_________________
-craig

I know I don't say this enough, but I like when you talk to me. It's much better than when nobody talks to me. Or when people that I don't like will not stop talking to me.
Rate this response:  
Not yet rated
PaulVL



Group memberships:
Premium Members

Joined: 17 Dec 2010
Posts: 1232

Points: 8099

Post Posted: Tue Feb 13, 2018 1:29 pm Reply with quote    Back to top    

well, standard data center build default is 1024. That is in NO WAY close to what is needed for an ETL host. I typically bump it up a digit to 10240, and see what happens after that.

Haven't seen a need yet for more, but then again, all my installs are mostly Linux grid with multiple batch ids, so the butter is spread out a little.
Rate this response:  
Not yet rated
hal_ds
Participant



Joined: 12 Feb 2018
Posts: 4

Points: 26

Post Posted: Thu Feb 15, 2018 6:38 am Reply with quote    Back to top    

Paul,

We are migrating the parallel edition from 9.x to 11.x and we need to test the jobs once new version is installed on unix server
Rate this response:  
Not yet rated
hal_ds
Participant



Joined: 12 Feb 2018
Posts: 4

Points: 26

Post Posted: Thu Feb 15, 2018 6:39 am Reply with quote    Back to top    

qt_ky,

Sorry, Can you elaborate what do you mean by Run the ISA Lite Health Check first?
Rate this response:  
Not yet rated
qt_ky



Group memberships:
Premium Members

Joined: 03 Aug 2011
Posts: 2746
Location: USA
Points: 20577

Post Posted: Thu Feb 15, 2018 8:04 am Reply with quote    Back to top    

https://www.ibm.com/support/knowledgecenter/SSZJPZ_11.7.0/com.ibm.swg.im.iis.productization.iisinfsv.install.doc/topics/wsisinst_install_verif_troublshtng.html

_________________
Choose a job you love, and you will never have to work a day in your life. - Confucius
Rate this response:  
Not yet rated
PaulVL



Group memberships:
Premium Members

Joined: 17 Dec 2010
Posts: 1232

Points: 8099

Post Posted: Thu Feb 15, 2018 1:42 pm Reply with quote    Back to top    

Are you moving to a NEW host, or reusing the existing one?

Honestly, just test some jobs.

Connect to each database type out there (Oracle, Teradata, DB2, etc...) whatever you use in your shop. Do a "select count(*) where 1 = 2" just to test your connectivity.

Run a transformer, run a sort, get as many different fancy jobs as you use in your regular flow and add the kitchen sink to it.
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54198
Location: Sydney, Australia
Points: 293951

Post Posted: Mon Feb 19, 2018 3:48 am Reply with quote    Back to top    

Our site does not seem to have a component called kitchen sink. Can you please advise whether this is in some patch or Fix Pack?

Very Happy

_________________
RXP Services Ltd
Melbourne | Canberra | Sydney | Hong Kong | Hobart | Brisbane
currently hiring: Canberra, Sydney and Melbourne
Rate this response:  
Not yet rated
hal_ds
Participant



Joined: 12 Feb 2018
Posts: 4

Points: 26

Post Posted: Tue Feb 20, 2018 10:14 pm Reply with quote    Back to top    

Thanku, Moving to New Host and suggested will test the all the stages used in the project.
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours