Need to publish message to Kafka Cluster

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
rohit_mca2003
Participant
Posts: 41
Joined: Wed Oct 08, 2008 9:19 am

Need to publish message to Kafka Cluster

Post by rohit_mca2003 »

Hi,

I am using DataStage v11.5.

I have to publish message to Kafka cluster using Kafka connector (SSL authentication) but I am not sure what are the configuration and user access is required.

Could you please help if you know how to setup the secure connection (SSL) and any other configuration required at both end (InformationServer and Kafka Cluster).

Thanks,
Rohit
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Anything here help?
-craig

"You can never have too many knives" -- Logan Nine Fingers
JRodriguez
Premium Member
Premium Member
Posts: 425
Joined: Sat Nov 19, 2005 9:26 am
Location: New York City
Contact:

Post by JRodriguez »

Julio Rodriguez
ETL Developer by choice

"Sure we have lots of reasons for being rude - But no excuses
rkashyap
Premium Member
Premium Member
Posts: 532
Joined: Fri Dec 02, 2011 12:02 pm
Location: Richmond VA

Post by rkashyap »

We were also not able to connect to Kafka cluster via SSL on DataStage 11.5.

IBM's response was that
Kafka connector doesn't support environment variables. It only works if it is hardcoded in Datastage as in 11.7 IIS Version.

In 11.7 under properties of Kafka connector there are several protocols/authentications to choose. We compared the base code of both version and SSL is only supported in 11.7 version.
Post Reply