Hierarchical Stage is terminated while calling REST Service

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
atul9806
Participant
Posts: 96
Joined: Tue Mar 06, 2012 6:12 am
Location: Pune
Contact:

Hierarchical Stage is terminated while calling REST Service

Post by atul9806 »

Hi Team
I have created a Server job for calling a REST POST service and capturing the response.

This thread is a part of this issue but posting here if someone can help me with this server job.


Design:
transformer Stg ---> Hierarchical Stage ---> Seq File

a) transformer stage - generating a single dummy record to passing the payload file name into Hierarchical Stage

b) Hierachical Stage - ( Input Step, REST Step and Output Step)

i - Input Step - Reading the single row passed by transformer stage which have payload file name

ii- REST step - HTTP method - POST
URL - Service URL
Security -- None
Request - A file whole path is set in Mappings as bodyFilePath
Response - A text node named body in the Output Schema
Mappings - Mapped the input fileName (payload) to bodyFilePath

iii- Output Step - Mapped the Service response to output columns

c) Seq File - Load the response into file


When I am running this job, my job is aborting with below error -
Abnormal termination of stage jobName..xfm detected

DataStage is indicating that error is in transformer stage but it is working fine if I removed the HIerarchical Stage.

Help me to debug this server job as I am new to this Oldest job :)

Thanks for your time !!
~Atul Singh
<a href=http://www.datagenx.net>DataGenX</a> | <a href=https://www.linkedin.com/in/atulsinghds>LinkedIn</a>
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Server jobs always point at a transformer when they abort as they are the active stage in the job. The first thing you need to do to help debug this is Reset the job and then check the log for a new entry saying "From previous run...". If that appears, post the contents.
-craig

"You can never have too many knives" -- Logan Nine Fingers
atul9806
Participant
Posts: 96
Joined: Tue Mar 06, 2012 6:12 am
Location: Pune
Contact:

Post by atul9806 »

Thanks craig for your inputs

FYI - My input json file is only having 7 records and size is 22kb.

Please find the job log when reset the job -

Code: Select all

From previous run 
DataStage Job 208 Phantom 20225
Abnormal termination of DataStage.
Fault type is 11.  Layer type is BASIC run machine.
Fault occurred in BASIC program DSP.ActiveRun at address 7a.

Resetting Job srvrJob1.

Resetting stage srvrJob1..xfm.

Resetting stage srvrJob1..Hierarchical.
~Atul Singh
<a href=http://www.datagenx.net>DataGenX</a> | <a href=https://www.linkedin.com/in/atulsinghds>LinkedIn</a>
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

Very difficult, unfortunately, to debug one like this... some thoughts for you would be:

a) do you have the REST call and payload working PERFECTLY from some other environment testing tool, such as (one that I like) HttpRequester, a plugin for Firefox.

b) try an EE Job. With a single link, the Server Job should be fine, but you never know --- you might get more useful errors with one Job Type or the other......

Ernie
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Yeah, as noted that's not a fun one. If you want to try to track it down, do an exact search here for "Fault type is 11" and you'll find 70 posts that mention that, including some from me back in the day I'll wager. See if any of them help. Loop in support as well.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply