DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
admin
Site Admin



Joined: 12 Jan 2003
Posts: 8720

Points: 10

Post Posted: Wed Mar 17, 2004 12:05 pm Reply with quote    Back to top    

We are using DataStage 7 on a Solaris 8 platform, and we would like to have
a Java application execute a DataStage job directly through an API, passing
necessary parameters. I have not seen anything in the DataStage
documentation, other than the C/C++ APIs. Does anyone have any experience
with executing DS Jobs from a Java application, could it be accomplished
possible using the CLI?

Any assistance would be greatly appreciated.

Thanks

_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users

_________________
PLEASE READ
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
admin
Site Admin



Joined: 12 Jan 2003
Posts: 8720

Points: 10

Post Posted: Wed Mar 17, 2004 12:33 pm Reply with quote    Back to top    

Hi John....

The best way for this to be accomplished is by using the RTI (Real Time
Integration) capabilities that we added in 7.x. This allows you to fully
expose a DataStage job as a service, to be then invoked via several
different mechanisms, depending on your needs....

.....the job can be exposed as a classic web service, using SOAP over
HTTP...we generate and publish the WSDL for this within RTI...

....the job can be exposed via our EJB binding and called appropriately

....the job can be exposed for contact via JMS, and either passed a text
message or SOAP envelope....

Not only can you simply pass job parameters via this architecture, you can
actually have the entire transformation job itself (columns on the ultimate
input and output links) passed and returned to your calling client.

Additionally, the entire job control API, which you may already be familiar
with in its API or command line implementations, has been exposed as a set
of methods available via Web Services.

Ernie



-----Original Message-----
From: Reedy, John [mailto:john.reedy@eds.com]
Sent: Wednesday, March 17, 2004 1:06 PM
To: 'datastage-users@oliver.com'
Subject: Java API

We are using DataStage 7 on a Solaris 8 platform, and we would like to have
a Java application execute a DataStage job directly through an API, passing
necessary parameters. I have not seen anything in the DataStage
documentation, other than the C/C++ APIs. Does anyone have any experience
with executing DS Jobs from a Java application, could it be accomplished
possible using the CLI?

Any assistance would be greatly appreciated.

Thanks

_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users

_________________
PLEASE READ
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
Rate this response:  
Not yet rated
admin
Site Admin



Joined: 12 Jan 2003
Posts: 8720

Points: 10

Post Posted: Wed Mar 17, 2004 2:58 pm Reply with quote    Back to top    

Unfortunately our customer did not buy the RTI component. Anything I can do
without it?

-----Original Message-----
From: datastage-users-bounces@oliver.com
[mailto:datastage-users-bounces@oliver.com] On Behalf Of
ernie.ostic@ascentialsoftware.com
Sent: Wednesday, March 17, 2004 1:34 PM
To: datastage-users@oliver.com
Subject: RE: Java API


Hi John....

The best way for this to be accomplished is by using the RTI (Real Time
Integration) capabilities that we added in 7.x. This allows you to fully
expose a DataStage job as a service, to be then invoked via several
different mechanisms, depending on your needs....

.....the job can be exposed as a classic web service, using SOAP over
HTTP...we generate and publish the WSDL for this within RTI...

....the job can be exposed via our EJB binding and called appropriately

....the job can be exposed for contact via JMS, and either passed a text
message or SOAP envelope....

Not only can you simply pass job parameters via this architecture, you can
actually have the entire transformation job itself (columns on the ultimate
input and output links) passed and returned to your calling client.

Additionally, the entire job control API, which you may already be familiar
with in its API or command line implementations, has been exposed as a set
of methods available via Web Services.

Ernie



-----Original Message-----
From: Reedy, John [mailto:john.reedy@eds.com]
Sent: Wednesday, March 17, 2004 1:06 PM
To: 'datastage-users@oliver.com'
Subject: Java API

We are using DataStage 7 on a Solaris 8 platform, and we would like to have
a Java application execute a DataStage job directly through an API, passing
necessary parameters. I have not seen anything in the DataStage
documentation, other than the C/C++ APIs. Does anyone have any experience
with executing DS Jobs from a Java application, could it be accomplished
possible using the CLI?

Any assistance would be greatly appreciated.

Thanks

_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users

_________________
PLEASE READ
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
Rate this response:  
Not yet rated
admin
Site Admin



Joined: 12 Jan 2003
Posts: 8720

Points: 10

Post Posted: Wed Mar 17, 2004 3:45 pm Reply with quote    Back to top    

John,

Any reason you can't have the JAVA app execute the 'dsjob' command (with appropriate arguments)?

Tony

"Reedy, John" wrote:
Unfortunately our customer did not buy the RTI component. Anything I can do
without it?

-----Original Message-----
From: datastage-users-bounces@oliver.com
[mailto:datastage-users-bounces@oliver.com] On Behalf Of
ernie.ostic@ascentialsoftware.com
Sent: Wednesday, March 17, 2004 1:34 PM
To: datastage-users@oliver.com
Subject: RE: Java API


Hi John....

The best way for this to be accomplished is by using the RTI (Real Time
Integration) capabilities that we added in 7.x. This allows you to fully
expose a DataStage job as a service, to be then invoked via several
different mechanisms, depending on your needs....

.....the job can be exposed as a classic web service, using SOAP over
HTTP...we generate and publish the WSDL for this within RTI...

....the job can be exposed via our EJB binding and called appropriately

....the job can be exposed for contact via JMS, and either passed a text
message or SOAP envelope....

Not only can you simply pass job parameters via this architecture, you can
actually have the entire transformation job itself (columns on the ultimate
input and output links) passed and returned to your calling client.

Additionally, the entire job control API, which you may already be familiar
with in its API or command line implementations, has been exposed as a set
of methods available via Web Services.

Ernie



-----Original Message-----
From: Reedy, John [mailto:john.reedy@eds.com]
Sent: Wednesday, March 17, 2004 1:06 PM
To: 'datastage-users@oliver.com'
Subject: Java API

We are using DataStage 7 on a Solaris 8 platform, and we would like to have
a Java application execute a DataStage job directly through an API, passing
necessary parameters. I have not seen anything in the DataStage
documentation, other than the C/C++ APIs. Does anyone have any experience
with executing DS Jobs from a Java application, could it be accomplished
possible using the CLI?

Any assistance would be greatly appreciated.

Thanks

_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
Do you Yahoo!?
Yahoo! Mail - More reliable, more storage, less spam
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users

_________________
PLEASE READ
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
Rate this response:  
Not yet rated
admin
Site Admin



Joined: 12 Jan 2003
Posts: 8720

Points: 10

Post Posted: Wed Mar 17, 2004 4:07 pm Reply with quote    Back to top    

We are trying to investigate this, but I am not a Java developer. Can Java
build a command and execute it, similar to what you can do with a VB shell
command?

-----Original Message-----
From: datastage-users-bounces@oliver.com
[mailto:datastage-users-bounces@oliver.com] On Behalf Of Tony Stark
Sent: Wednesday, March 17, 2004 4:45 PM
To: DataStage Users Discussion List
Subject: RE: Java API


John,

Any reason you can't have the JAVA app execute the 'dsjob' command (with
appropriate arguments)?

Tony

"Reedy, John" wrote:
Unfortunately our customer did not buy the RTI component. Anything I can do
without it?

-----Original Message-----
From: datastage-users-bounces@oliver.com
[mailto:datastage-users-bounces@oliver.com] On Behalf Of
ernie.ostic@ascentialsoftware.com
Sent: Wednesday, March 17, 2004 1:34 PM
To: datastage-users@oliver.com
Subject: RE: Java API


Hi John....

The best way for this to be accomplished is by using the RTI (Real Time
Integration) capabilities that we added in 7.x. This allows you to fully
expose a DataStage job as a service, to be then invoked via several
different mechanisms, depending on your needs....

.....the job can be exposed as a classic web service, using SOAP over
HTTP...we generate and publish the WSDL for this within RTI...

....the job can be exposed via our EJB binding and called appropriately

....the job can be exposed for contact via JMS, and either passed a text
message or SOAP envelope....

Not only can you simply pass job parameters via this architecture, you can
actually have the entire transformation job itself (columns on the ultimate
input and output links) passed and returned to your calling client.

Additionally, the entire job control API, which you may already be familiar
with in its API or command line implementations, has been exposed as a set
of methods available via Web Services.

Ernie



-----Original Message-----
From: Reedy, John [mailto:john.reedy@eds.com]
Sent: Wednesday, March 17, 2004 1:06 PM
To: 'datastage-users@oliver.com'
Subject: Java API

We are using DataStage 7 on a Solaris 8 platform, and we would like to have
a Java application execute a DataStage job directly through an API, passing
necessary parameters. I have not seen anything in the DataStage
documentation, other than the C/C++ APIs. Does anyone have any experience
with executing DS Jobs from a Java application, could it be accomplished
possible using the CLI?

Any assistance would be greatly appreciated.

Thanks

_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
Do you Yahoo!?
Yahoo! Mail - More reliable, more storage, less spam
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users

_________________
PLEASE READ
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
Rate this response:  
Not yet rated
admin
Site Admin



Joined: 12 Jan 2003
Posts: 8720

Points: 10

Post Posted: Thu Mar 18, 2004 8:01 am Reply with quote    Back to top    

I've been told that this is possible, John.

Good Luck!

Tony

"Reedy, John" wrote:
We are trying to investigate this, but I am not a Java developer. Can Java
build a command and execute it, similar to what you can do with a VB shell
command?

-----Original Message-----
From: datastage-users-bounces@oliver.com
[mailto:datastage-users-bounces@oliver.com] On Behalf Of Tony Stark
Sent: Wednesday, March 17, 2004 4:45 PM
To: DataStage Users Discussion List
Subject: RE: Java API


John,

Any reason you can't have the JAVA app execute the 'dsjob' command (with
appropriate arguments)?

Tony

"Reedy, John" wrote:
Unfortunately our customer did not buy the RTI component. Anything I can do
without it?

-----Original Message-----
From: datastage-users-bounces@oliver.com
[mailto:datastage-users-bounces@oliver.com] On Behalf Of
ernie.ostic@ascentialsoftware.com
Sent: Wednesday, March 17, 2004 1:34 PM
To: datastage-users@oliver.com
Subject: RE: Java API


Hi John....

The best way for this to be accomplished is by using the RTI (Real Time
Integration) capabilities that we added in 7.x. This allows you to fully
expose a DataStage job as a service, to be then invoked via several
different mechanisms, depending on your needs....

.....the job can be exposed as a classic web service, using SOAP over
HTTP...we generate and publish the WSDL for this within RTI...

....the job can be exposed via our EJB binding and called appropriately

....the job can be exposed for contact via JMS, and either passed a text
message or SOAP envelope....

Not only can you simply pass job parameters via this architecture, you can
actually have the entire transformation job itself (columns on the ultimate
input and output links) passed and returned to your calling client.

Additionally, the entire job control API, which you may already be familiar
with in its API or command line implementations, has been exposed as a set
of methods available via Web Services.

Ernie



-----Original Message-----
From: Reedy, John [mailto:john.reedy@eds.com]
Sent: Wednesday, March 17, 2004 1:06 PM
To: 'datastage-users@oliver.com'
Subject: Java API

We are using DataStage 7 on a Solaris 8 platform, and we would like to have
a Java application execute a DataStage job directly through an API, passing
necessary parameters. I have not seen anything in the DataStage
documentation, other than the C/C++ APIs. Does anyone have any experience
with executing DS Jobs from a Java application, could it be accomplished
possible using the CLI?

Any assistance would be greatly appreciated.

Thanks

_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
Do you Yahoo!?
Yahoo! Mail - More reliable, more storage, less spam
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
Do you Yahoo!?
Yahoo! Mail - More reliable, more storage, less spam
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users

_________________
PLEASE READ
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
Rate this response:  
Not yet rated
admin
Site Admin



Joined: 12 Jan 2003
Posts: 8720

Points: 10

Post Posted: Fri Mar 19, 2004 9:38 am Reply with quote    Back to top    

John,

Here is the snippet of code, we use to call dsjob from JAVA program

Dinesh

Process p = Runtime.getRuntime().exec( MProperties.DS_EXE_PATH + "/dsjob -run -wait -param lowDate=" +
lowDate + " -param highDate=" +
highDatePlusOne + " -param dsOutDir=" + MProperties.DS_OUT_DIR +
" -param IDB_user=" + MProperties.IDB_USER + " -param IDB_pass=" +
MProperties.IDB_PASS + " " + MProperties.DS_PROJECT + " " + MProperties.DS_JOB);
p.waitFor();
return p.exitValue() == 0;

-----Original Message-----
From: datastage-users-bounces@oliver.com
[mailto:datastage-users-bounces@oliver.com]On Behalf Of Reedy, John
Sent: Wednesday, March 17, 2004 5:08 PM
To: 'DataStage Users Discussion List'
Subject: RE: Java API


We are trying to investigate this, but I am not a Java developer. Can Java
build a command and execute it, similar to what you can do with a VB shell
command?

-----Original Message-----
From: datastage-users-bounces@oliver.com
[mailto:datastage-users-bounces@oliver.com] On Behalf Of Tony Stark
Sent: Wednesday, March 17, 2004 4:45 PM
To: DataStage Users Discussion List
Subject: RE: Java API


John,

Any reason you can't have the JAVA app execute the 'dsjob' command (with
appropriate arguments)?

Tony

"Reedy, John" wrote:
Unfortunately our customer did not buy the RTI component. Anything I can do
without it?

-----Original Message-----
From: datastage-users-bounces@oliver.com
[mailto:datastage-users-bounces@oliver.com] On Behalf Of
ernie.ostic@ascentialsoftware.com
Sent: Wednesday, March 17, 2004 1:34 PM
To: datastage-users@oliver.com
Subject: RE: Java API


Hi John....

The best way for this to be accomplished is by using the RTI (Real Time
Integration) capabilities that we added in 7.x. This allows you to fully
expose a DataStage job as a service, to be then invoked via several
different mechanisms, depending on your needs....

.....the job can be exposed as a classic web service, using SOAP over
HTTP...we generate and publish the WSDL for this within RTI...

....the job can be exposed via our EJB binding and called appropriately

....the job can be exposed for contact via JMS, and either passed a text
message or SOAP envelope....

Not only can you simply pass job parameters via this architecture, you can
actually have the entire transformation job itself (columns on the ultimate
input and output links) passed and returned to your calling client.

Additionally, the entire job control API, which you may already be familiar
with in its API or command line implementations, has been exposed as a set
of methods available via Web Services.

Ernie



-----Original Message-----
From: Reedy, John [mailto:john.reedy@eds.com]
Sent: Wednesday, March 17, 2004 1:06 PM
To: 'datastage-users@oliver.com'
Subject: Java API

We are using DataStage 7 on a Solaris 8 platform, and we would like to have
a Java application execute a DataStage job directly through an API, passing
necessary parameters. I have not seen anything in the DataStage
documentation, other than the C/C++ APIs. Does anyone have any experience
with executing DS Jobs from a Java application, could it be accomplished
possible using the CLI?

Any assistance would be greatly appreciated.

Thanks

_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
Do you Yahoo!?
Yahoo! Mail - More reliable, more storage, less spam
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users
_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users


==============================================================================
The contents of this message, together with any attachments, are intended only for the use of the person(s) to which they are addressed and may contain confidential and/or privileged information. Further, any medical information herein is confidential and protected by law. It is unlawful for unauthorized persons to use, review, copy, disclose, or disseminate confidential medical information. If you are not the intended recipient, immediately advise the sender and delete this message and any attachments. Any distribution, or copying of this message, or any attachment, is prohibited.
==============================================================================

_______________________________________________
datastage-users mailing list
datastage-users@oliver.com
http://www.oliver.com/mailman/listinfo/datastage-users

_________________
PLEASE READ
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours