DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
Ashish
Participant



Joined: 31 Jan 2006
Posts: 57

Points: 487

Post Posted: Thu Oct 16, 2008 1:06 am Reply with quote    Back to top    

DataStage® Release: 7x
Job Type: Parallel
OS: Unix
Hi,

I would like to integrate around 30 inbound feeds coming from 10 source systems through datastage, The file types are excel, csv , text and rdbms, can anyone suggest the best way to integrate such diversed feeds through DataStage without any manual intervention and also suggest the dynamic method i can implement in datastage (If feeds increased in future minimal change is required).

Thnks
Aisi
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54072
Location: Sydney, Australia
Points: 293282

Post Posted: Thu Oct 16, 2008 1:27 am Reply with quote    Back to top    

How do you know when one of these feeds is ready? That is, what would trigger DataStage processing?

_________________
RXP Services Ltd
Melbourne | Canberra | Sydney | Hong Kong | Hobart | Brisbane
currently hiring: Canberra, Sydney and Melbourne
Rate this response:  
Not yet rated
Ashish
Participant



Joined: 31 Jan 2006
Posts: 57

Points: 487

Post Posted: Mon Oct 20, 2008 6:47 am Reply with quote    Back to top    

ray.wurlod wrote:
How do you know when one of these feeds is ready? That is, what would trigger DataStage processing? ...



There is one Trigger file called X.X ones it appear in the directory, DataStage Jobs kick off.

Let me know if you need more information.
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54072
Location: Sydney, Australia
Points: 293282

Post Posted: Mon Oct 20, 2008 2:36 pm Reply with quote    Back to top    

No, that's sufficient. Use a Wait For File activity in a job sequence that waits for the trigger file to appear, then whatever else you need is downstream of that in the job sequence.

_________________
RXP Services Ltd
Melbourne | Canberra | Sydney | Hong Kong | Hobart | Brisbane
currently hiring: Canberra, Sydney and Melbourne
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours