DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
Naren12345babu



Group memberships:
Premium Members, Heartland Usergroup

Joined: 06 Jan 2016
Posts: 76
Location: Bangalore
Points: 902

Post Posted: Wed May 08, 2019 7:49 pm Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Unix
ETL job is using ODBC stage to extract .DBF file.

I am getting below error

Throwing exception: APT_BadAlloc: Heap allocation failed.

I tried checking other threads , but did not get much help

Please help here.

_________________
Thanks
Naren Babu Ch
mouthou
Participant



Joined: 04 Jul 2004
Posts: 208

Points: 1991

Post Posted: Mon May 13, 2019 12:03 pm Reply with quote    Back to top    

Heap allocation is a generic error related to buffering and memory allocation. Not much direct answer for this error as the job needs to be completely checked. But to begin with, are you getting this issue when using ODBC stage only? Can you try replacing it with some other stage as source and check for now? It helps to isolate the insufficient DB settings interrupting with DS operations.

Since you seem to be extracting a database file, volume of records fetched is also in question. Can you give a simple pic of job design to see how big the job is?
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54537
Location: Sydney, Australia
Points: 295725

Post Posted: Tue May 14, 2019 2:58 pm Reply with quote    Back to top    

How wide are the rows? There are default maxima that can be overridden with parameters MAXFETCHBUFF and MAXFETCHCOLS in the uvodbc.config file.

_________________
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Rate this response:  
Not yet rated
Naren12345babu



Group memberships:
Premium Members, Heartland Usergroup

Joined: 06 Jan 2016
Posts: 76
Location: Bangalore
Points: 902

Post Posted: Tue Jun 18, 2019 2:05 am Reply with quote    Back to top    

What are the other stages I can use to extract data from DBT files.
Also, I checked for number of bytes per block size, and i got "ODBC_Connector_0,0: Current heap size: 6071520 bytes in 19603 blocks".

Hope this is help ful.

Any idea how to move furhter? what are the other stages that can be used to extract DBT files.

_________________
Thanks
Naren Babu Ch
Rate this response:  
Not yet rated
Naren12345babu



Group memberships:
Premium Members, Heartland Usergroup

Joined: 06 Jan 2016
Posts: 76
Location: Bangalore
Points: 902

Post Posted: Tue Jun 18, 2019 7:01 am Reply with quote    Back to top    

Ray, I cannot use uvodbc.config as the configuration seems to be very different where I am working , all values from uvodbc are not present in odbc. Infact when I check uvodbc file, I see only one ODBC connection. but could not get an update.

I also see that columns with ntext are causing this issue.

are there any environment variables that can be used here.

_________________
Thanks
Naren Babu Ch
Rate this response:  
Not yet rated
Naren12345babu



Group memberships:
Premium Members, Heartland Usergroup

Joined: 06 Jan 2016
Posts: 76
Location: Bangalore
Points: 902

Post Posted: Thu Jun 20, 2019 6:10 am Reply with quote    Back to top    

Ray, can you provide me syntax of using these paramters in uvodbc.config

_________________
Thanks
Naren Babu Ch
Rate this response:  
Not yet rated
Naren12345babu



Group memberships:
Premium Members, Heartland Usergroup

Joined: 06 Jan 2016
Posts: 76
Location: Bangalore
Points: 902

Post Posted: Thu Jun 20, 2019 6:47 am Reply with quote    Back to top    

the datatypes is ntext

_________________
Thanks
Naren Babu Ch
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 43026
Location: Denver, CO
Points: 222086

Post Posted: Thu Jun 20, 2019 10:04 am Reply with quote    Back to top    

You're not the first person here wondering about things like that.

Suggestion: take one of those values like MAXFETCHBUFF and use it in an exact search here, then go through the results. Right now that one finds 37 other posts that include it. I would start with the resolved ones first but people don't always mark their topics so don't restrict yourself to just those.

_________________
-craig

Peaches come from a can, they were put there by a man
If I had my little way, I'd eat peaches every day
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours