DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
This topic has been marked "Resolved."
Author Message
rkashyap



Group memberships:
Premium Members

Joined: 02 Dec 2011
Posts: 498
Location: Richmond VA
Points: 4518

Post Posted: Sat Aug 12, 2017 3:17 pm Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Additional info: IIS 11.5 fp1 on RHEL 7; XMETA DB2; LDAP authentication
DataStage 11.501; Patches applied: Datadirect JDBC Driver for Hive(JR56156) and Hive Connector(JR56097).

We are trying to use File Connector stage for connecting to Cloudera Hadoop server. Connection parameters are:
Code:
 FileSystem: HttpFS
 Use Custom URL: No
 Use SSL: Yes
 Use Ketab: Yes
 Use Kerberos: Yes
 Host: <Cloudera Server>
 PortNo: 14000
 Service principal:
 User name: <username@domain>
 Keytab:<Path to keytab file>

Cloudera server is setup with an edge node and we are connecting with edge node as host. As per Hadoop admin's recommendation "HttpFS with SSL" is being used. Truststore has been setup. Keytab is provided by Hadoop Admin and we have installed Kerberos on DS server with krb5.conf file copied from Hadoop server to DataStage server.

File connector job fails with "File_Connector_1: com.ascential.e2.common.CC_Exception: java.lang.Exception: java.lang.RuntimeException: java.lang.RuntimeException: javax.security.auth.login.LoginException: Login Failure: all modules ignored at com.ibm.iis.cc.filesystem.FileSystem.initialize(FileSystem.java:540) ... .

Appreciate if someone can advise on what could be the issue.
Timato
Participant



Joined: 30 Sep 2014
Posts: 23

Points: 143

Post Posted: Mon Aug 14, 2017 8:58 pm Reply with quote    Back to top    

The 'Login Error' seems to point more or less to your authentication parameters (be it the keytab or username or something different altogether).
Have you tried perhaps putting in your FQDN for your domain?
Test out the connectivity via command line on your engine?
Confirm that you can connect via WebHDFS to rule out any networking issues?
Rate this response:  
Not yet rated
rkashyap



Group memberships:
Premium Members

Joined: 02 Dec 2011
Posts: 498
Location: Richmond VA
Points: 4518

Post Posted: Tue Aug 29, 2017 10:50 am Reply with quote    Back to top    

Thank you. Failure was due to convergence of two issues:
1. Bad Keytab. Cloudera admin recreated the keytab file for this.

2. Kerberos ticket was generated using knit from "/usr/sbin/". Ticket had to be regenerated using kinit from IBM's JDK:
Code:
$ kdestroy
$ /opt/IBM/InformationServer/jdk/jre/bin/kinit -k -t <keytab_filename> <principal>
We have also updated the "path" to keep IBM's JDK library above the ones from RHEL.
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54034
Location: Sydney, Australia
Points: 293130

Post Posted: Sun Sep 03, 2017 10:44 pm Reply with quote    Back to top    

Thank you for posting the solution.

_________________
RXP Services Ltd
Melbourne | Canberra | Sydney | Hong Kong | Hobart | Brisbane
currently hiring: Canberra, Sydney and Melbourne
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours