Hierarchical stage failing in higher environment

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
midmaxds
Premium Member
Premium Member
Posts: 71
Joined: Mon Oct 26, 2015 11:44 am

Hierarchical stage failing in higher environment

Post by midmaxds »

Hi,

We are testing a datastage job with Hierarchical stage in it which generates an XML.
In the Dev regions, we never faced the below error. But it is happening in higher environments. Tested with same data in both regions.
Can some patches help? Kindly advise.


Message: hd_cust_reg_loc_loctp,0: Fatal Error: 2016-09-30 03:46:53,356 Fatal [com.ibm.e2.applications.runner.E2AssemblyRunner] [] caught fatal exception
com.ibm.e2.core.exceptions.OperatorException: OperatorTransitionFailedAtRuntime operator = 'UserRuntimeOperatorFrame:Op-RT-9[XML_Composer]', cause = 'java.lang.NullPointerException'
at com.ibm.e2.core.exceptions.OperatorException$FactoryImpl.operatorTransitionFailedAtRuntime(OperatorException$FactoryImpl.java:115)
at com.ibm.e2.core.framework.runtime.OperatorController.runOperatorStep(OperatorController.java:72)
at com.ibm.e2.core.framework.runtime.scheduler.OperatorTask.runFrame(OperatorTask.java:86)
at com.ibm.e2.core.framework.runtime.scheduler.OperatorTask.execute(OperatorTask.java:40)
at com.ibm.e2.core.framework.runtime.scheduler.AbstractTask.run(AbstractTask.java:29)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1176)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
at java.lang.Thread.run(Thread.java:853)
Caused by:
java.lang.NullPointerException
at org.apache.xml.serialize.Printer.printText(Unknown Source)
at org.apache.xml.serialize.XMLSerializer.endElementIO(Unknown Source)
at org.apache.xml.serialize.XMLSerializer.endElement(Unknown Source)
at com.ibm.e2.xml.writer.E2XMLSerializer.endElement(E2XMLSerializer.java:247)
at com.ibm.e2.xml.writer.E2ToSAXNonChoiceChildHandler.writeEndElementEvent(E2ToSAXNonChoiceChildHandler.java:2443)
at com.ibm.e2.xml.writer.E2ToSAXNonChoiceChildHandler.writeNonSyntheticItemEnd(E2ToSAXNonChoiceChildHandler.java:2704)
at com.ibm.e2.xml.writer.E2ToSAXNonChoiceChildHandler.handleNonSyntheticItemEnd(E2ToSAXNonChoiceChildHandler.java:2729)
at com.ibm.e2.xml.writer.E2ToSAXNonChoiceChildHandler.itemEnd(E2ToSAXNonChoiceChildHandler.java:2657)
at com.ibm.e2.core.framework.runtime.generic.traversers.AbstractTraverser.handleEventForHandler(AbstractTraverser.java:663)
at com.ibm.e2.core.framework.runtime.generic.traversers.AbstractTraverser.handleEvent(AbstractTraverser.java:534)
at com.ibm.e2.core.framework.runtime.generic.traversers.ItemTraverser.handleCurrentState(ItemTraverser.java:91)
at com.ibm.e2.core.framework.runtime.generic.traversers.AbstractTraverser.continueTraversal(AbstractTraverser.java:475)
at com.ibm.e2.core.framework.runtime.generic.traversers.AbstractTraverser.startTraversal(AbstractTraverser.java:463)
at com.ibm.e2.core.framework.runtime.generic.traversers.ItemTraverser.itemBegin(ItemTraverser.java:122)
at com.ibm.e2.core.framework.runtime.generic.traversers.AbstractTraverser.handleEventForHandler(AbstractTraverser.java:668)
at com.ibm.e2.core.framework.runtime.generic.traversers.AbstractTraverser.handleEvent(AbstractTraverser.java:534)
at com.ibm.e2.core.framework.runtime.generic.traversers.VectorTraverser.handleCurrentState(VectorTraverser.java:133)
at com.ibm.e2.core.framework.runtime.generic.traversers.AbstractTraverser.continueTraversal(AbstractTraverser.java:475)
at com.ibm.e2.core.framework.runtime.generic.traversers.AbstractTraverser.startTraversal(AbstractTraverser.java:463)
at com.ibm.e2.core.framework.frames.AbstractRuntimeFrame.runTraverser(AbstractRuntimeFrame.java:1454)
at com.ibm.e2.core.framework.frames.AbstractRuntimeFrame.runTraverser(AbstractRuntimeFrame.java:1437)
at com.ibm.e2.core.framework.frames.UserRuntimeOperatorAdapter.runTraverser(UserRuntimeOperatorAdapter.java:138)
at com.ibm.e2.core.api.operator.AbstractRuntimeOperator.runTraverser(AbstractRuntimeOperator.java:199)
at com.ibm.e2.providers.xml.AbstractXMLProviderRuntime.process(AbstractXMLProviderRuntime.java:282)
at com.ibm.e2.core.framework.frames.UserRuntimeOperatorFrame.process(UserRuntimeOperatorFrame.java:93)
at com.ibm.e2.core.framework.runtime.OperatorController.callOperatorProcess(OperatorController.java:341)
at com.ibm.e2.core.framework.runtime.OperatorController.runOperator(OperatorController.java:273)
at com.ibm.e2.core.framework.runtime.OperatorController.doReadyToExecute(OperatorController.java:177)
at com.ibm.e2.core.framework.runtime.OperatorController.runDataStateTransistion(OperatorController.java:132)
at com.ibm.e2.core.framework.runtime.OperatorController.runTransitions(OperatorController.java:88)
at com.ibm.e2.core.framework.runtime.OperatorController.runOperatorStep(OperatorController.java:66)
... 6 more
Midhun
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

A null pointer exception? Involve support.
-craig

"You can never have too many knives" -- Logan Nine Fingers
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

...but also look at the data that you are feeding it. In production, is it possible that you have a different source? or different rows? At least as a test, use "the same" input as you do in dev, to eliminate any possibility that something in the data is throwing off your assembly logic or impacting a particular node/element, etc. in the xml that is being crafted. There are many things that could impact your regroups or other assembly logic that could be thrown off by data values that you weren't prepared for.

Ernie
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
midmaxds
Premium Member
Premium Member
Posts: 71
Joined: Mon Oct 26, 2015 11:44 am

Post by midmaxds »

Thanks, Ernie. We have involved support now.

Meanwhile, we pointed to the PROD source from non-prod region and triggered the job. It ran fine without any issues. This makes us think that there is something missing in the PROD IIS server.Your thoughts too, please.
Midhun
Post Reply