DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message

Group memberships:
Premium Members

Joined: 02 Dec 2011
Posts: 490
Location: Richmond VA
Points: 4374

Post Posted: Sat Aug 12, 2017 3:17 pm Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Additional info: IIS 11.5 fp1 on RHEL 7; XMETA DB2; LDAP authentication
DataStage 11.501; Patches applied: Datadirect JDBC Driver for Hive(JR56156) and Hive Connector(JR56097).

We are trying to use File Connector stage for connecting to Cloudera Hadoop server. Connection parameters are:
 FileSystem: HttpFS
 Use Custom URL: No
 Use SSL: Yes
 Use Ketab: Yes
 Use Kerberos: Yes
 Host: <Cloudera Server>
 PortNo: 14000
 Service principal:
 User name: <username@domain>
 Keytab:<Path to keytab file>

Cloudera server is setup with an edge node and we are connecting with edge node as host. As per Hadoop admin's recommendation "HttpFS with SSL" is being used. Truststore has been setup. Keytab is provided by Hadoop Admin and we have installed Kerberos on DS server with krb5.conf file copied from Hadoop server to DataStage server.

File connector job fails with "File_Connector_1: com.ascential.e2.common.CC_Exception: java.lang.Exception: java.lang.RuntimeException: java.lang.RuntimeException: javax.security.auth.login.LoginException: Login Failure: all modules ignored at com.ibm.iis.cc.filesystem.FileSystem.initialize(FileSystem.java:540) ... .

Appreciate if someone can advise on what could be the issue.

Joined: 30 Sep 2014
Posts: 21

Points: 128

Post Posted: Mon Aug 14, 2017 8:58 pm Reply with quote    Back to top    

The 'Login Error' seems to point more or less to your authentication parameters (be it the keytab or username or something different altogether).
Have you tried perhaps putting in your FQDN for your domain?
Test out the connectivity via command line on your engine?
Confirm that you can connect via WebHDFS to rule out any networking issues?
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum

Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours