The REST step found a large input data item

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sandhya.budhi
Premium Member
Premium Member
Posts: 18
Joined: Wed Nov 15, 2017 10:50 am

The REST step found a large input data item

Post by sandhya.budhi »

I have a similar issue to this post when I am trying to make a REST call with 7k records. The data don't have any key and I have to process in the same order received from the source.

The REST call is failing with the error

CDIER0410E: Error in step=REST, cause=com.ibm.e2.provider.ws.exceptions.RESTWSRequestException: CDIER0905E: The REST step found a large input data item whose size 23415819 exceeds the supported size limit 10485760

I tried the options provided in the linked post but it is not working. Increased the heap size and still getting the same error.

I am trying to use the option Split data into batches in the Heirarchical Stage. But I am not having any key data so not sure how to proceed with this.

Please suggest how to proceed with this
Thanks,
Sandhya
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Moderator: split you out to your own topic and linked back to the original.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply