Page 1 of 1
RabbitMQ Connection from DataStage
Posted: Mon Aug 06, 2018 1:54 pm
by nadesansiva
Hello,
I am looking for options to connect to RabbitMQ from DataStage, Can you please help with options\suggestions ?
The team is thinking to create java calls since Java has RabbitMQ client.
Posted: Mon Aug 06, 2018 8:25 pm
by ray.wurlod
Welcome aboard. Yes, Java is one possibility. There is a REST API for RabbitMQ, so you could go that route too. Search internet for "Rabbit MQ interfaces" to find other possibilities.
Posted: Wed Aug 08, 2018 4:42 am
by eostic
The nice thing about using java is that the java integration stage provides you with a lot of flexibility for interfacing with the ds engine and it is likely that rabbbitMQ provides strong support of JMS and we provide a very nice JMS example on devWorks for the java integration stage.
Ernie
Posted: Thu Sep 27, 2018 4:22 pm
by entechlog
Thank you for the RESTful API suggestion.
Short Term Solution:
We are using the RESTful API with Hierarchical stage for now.
Long Term Solution:
Java team is working on creating a generic Java module which will monitor the queue and will write the data into a event log table for DataStage to process to consume.
Reason for not using RESTful API as long term solution
Team is worried RESTful API won't be able to handle huge queue volumes.