Datastage job hangs for no reason

SURA · Post by **SURA** » Tue Mar 18, 2014 3:52 pm

Hello All

I have already raised couple of post about Datastage job hanging issue and this is also about the same. I was chasing this issue with IBM from Datastage 8.1 - 8.7 and yesterday, finally i managed to talk with IBM Engineering dept and get the conclusion!

Issue: As mentioned in the subject, PROD Datastage PX jobs are hanging in random and we don't know what is the cause? Few days before a job was hanging (which was doing upsert -550 records. It inserted 350 records successfully and there after no response!!) for few days and i allowed it to trace the root cause.

After a good number of communications with IBM i managed to install necessary STACK trace, relevant ENV variable, prior to this issue!!.

Code: Select all

I have provided all the necessary logs to IBM and they came back to me, saying it is bug in the product and especially in Windows OS .

At this stage they dont know why it is causing this issue, but they suspect  it could be because of tsort (internal) / sort stage !! IBM is blaming MKS Toolkit and they are working to rid out of  MKS. I thing Ray was saying from 9.1 there is no MKS Tool kit. IBM too confirmed in 9.1 they have taken it out from the CLIENT and not in the SERVER!!!

They do provided the workaround too!

Code: Select all

The workaround is to disable the parallelism for tsort alone!!

I haven't tried that option and i am not sure whether i will try that option or not!!

So end of the story is, a bug in the product and it took years for me to make them agree!

IBM Analytics Champion 2009 - 2020 · Post by **asorrell** » Tue Mar 18, 2014 4:01 pm

Glad you persisted and got it answered. Yet another reason I don't support clients on Windows servers anymore.

chulett · Post by **chulett** » Tue Mar 18, 2014 5:04 pm

I think you've used up your allotment of exclamation points for the rest of the month.

priyadarshikunal · Post by **priyadarshikunal** » Wed Mar 19, 2014 5:56 am

Can I buy additional exclamations? exclamation pack?

chulett · Post by **chulett** » Wed Mar 19, 2014 6:53 am

abc123 · Post by **abc123** » Tue Apr 01, 2014 5:43 pm

Just curious. If there is no MKS Toolkit from 9.1, what does the job of MKS Toolkit?

ray.wurlod · Post by **ray.wurlod** » Tue Apr 01, 2014 8:02 pm

MKS Toolkit is still provided, but DataStage itself no longer uses it. Instead, all code in DataStage engine that used to call UNIX functions now calls equivalent native Windows functions, when on a Windows platform.