DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
This topic has been marked "Resolved."
Author Message
TNZL_BI



Group memberships:
Premium Members

Joined: 20 Aug 2012
Posts: 24
Location: NZ
Points: 243

Post Posted: Fri Apr 07, 2017 3:30 pm Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi All,

We have recently connected to the Hive database from DataStage using the ODBC Connector Stage. However we are having issues when we are trying to use the Hive Connector stage. I am not exactly sure as to how to set up the isjdbc.config file . I have read the documentation however I am still not clear as to what do I need to put in the File Class and File Path. Do I need to install any hive related Jar files on the DSEngine Linux server ??

Any information here will be really appreciated . Many Thanks
TNZL_BI



Group memberships:
Premium Members

Joined: 20 Aug 2012
Posts: 24
Location: NZ
Points: 243

Post Posted: Sun Apr 09, 2017 8:13 pm Reply with quote    Back to top    

Hi All ,

I have finally managed to connect using the hive connector . I managed to locate the jar file for Hive which was the ISHive.jar file under the ASBNode/lib directory in datastage.

The contents of the config file is as follows :-

-bash-4.2$ cat isjdbc.config
CLASSPATH=/opt/IBM/InformationServer/ASBNode/lib/java/IShive.jar
CLASS_NAMES=org.apache.hadoop.hive.jdbc.HiveDriver

Reading data is working fine however when I write data into Hive I am getting the following error

FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

Any ideas as to what might be the reason for this
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42215
Location: Denver, CO
Points: 216749

Post Posted: Mon Apr 10, 2017 7:43 am Reply with quote    Back to top    

Have you contacted support for any of this?

_________________
-craig

Watch out where the huskies go and don't you eat that yellow snow
Rate this response:  
Not yet rated
TNZL_BI



Group memberships:
Premium Members

Joined: 20 Aug 2012
Posts: 24
Location: NZ
Points: 243

Post Posted: Sun Apr 23, 2017 5:02 am Reply with quote    Back to top    

Hi Chulett

Thanks for your response. This issue is now fixed . I contacted the Hadoop administration team and realized there was some patching activity because of which this issue was cropping.

The new problem now is that the performance of the Hive connector stage is pathetic. Opened a case with IBM.. will give all the details if I hear anything positive
Rate this response:  
Not yet rated
rkashyap



Group memberships:
Premium Members

Joined: 02 Dec 2011
Posts: 498
Location: Richmond VA
Points: 4518

Post Posted: Wed Aug 09, 2017 8:39 am Reply with quote    Back to top    

TNZL_BI wrote:
The new problem now is that the performance of the Hive connector stage is pathetic. Opened a case with IBM.. will give all the details if I hear anything positive

What did IBM suggest? Did it help?
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours