DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
Cherukuri
Participant



Joined: 25 Jul 2007
Posts: 46
Location: India
Points: 598

Post Posted: Thu Feb 09, 2012 8:37 am Reply with quote    Back to top    

DataStage® Release: 8x
Job Type: Parallel
OS: Windows
Additional info: DS 8.5
Hi,

I have a requirment as explained below:

Question : Daily files are placed in '/tmp/ds/sources/' the files are in .csv formate

I have to dev a Datastage job (and load to the path '/tmp/ds/target/') in such a way the job should run daily and should pick the present date file, if i did not get a file on the perticular day it should NOT pick the old file and more over the job should not run on that day (because no file exists on that day).

for example the source files are :

source_mrc_06_02_2012.csv
source_mrc_07_02_2012.csv
source_mrc_08_02_2012.csv
'
'
'
'

Please could expertise explan me how to approach this requirement.

Thanks in advance.

cheru.

_________________
Cheru
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42671
Location: Denver, CO
Points: 219762

Post Posted: Thu Feb 09, 2012 9:12 am Reply with quote    Back to top    

Again, start by posting in the correct forum - the FAQ Discussion forum is not it.

_________________
-craig

And I'm hovering like a fly, waiting for the windshield on the freeway...
Rate this response:  
Not yet rated
pandeesh



Group memberships:
Premium Members, Heartland Usergroup

Joined: 24 Oct 2010
Posts: 1399
Location: CHENNAI, TAMIL NADU
Points: 9855

Post Posted: Thu Feb 09, 2012 9:14 am Reply with quote    Back to top    

I think it's better to handle this in sequence. Write a script and call this in execute command activity. Setup the trigger conditions accordingly.

_________________
pandeeswaran
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42671
Location: Denver, CO
Points: 219762

Post Posted: Thu Feb 09, 2012 10:13 am Reply with quote    Back to top    

Something has to run to check the files, so yes a Sequence job would be appropriate and it could trigger the processing job only if a file is found.

_________________
-craig

And I'm hovering like a fly, waiting for the windshield on the freeway...
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42671
Location: Denver, CO
Points: 219762

Post Posted: Thu Feb 09, 2012 10:17 am Reply with quote    Back to top    

I would argue against a "current date" file check but would implement an "unprocessed" file check. Move/archive the files elsewhere after processing so that anything found in that directory needs to b ...

_________________
-craig

And I'm hovering like a fly, waiting for the windshield on the freeway...
Rate this response:  
Not yet rated
Cherukuri
Participant



Joined: 25 Jul 2007
Posts: 46
Location: India
Points: 598

Post Posted: Fri Feb 10, 2012 6:27 am Reply with quote    Back to top    

Hi,

Please revert me with the solution for the requirement above.

Regards,
Cheru.

_________________
Cheru
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42671
Location: Denver, CO
Points: 219762

Post Posted: Fri Feb 10, 2012 8:15 am Reply with quote    Back to top    

It's been "reverted"... do you have any specific questions?

_________________
-craig

And I'm hovering like a fly, waiting for the windshield on the freeway...
Rate this response:  
Not yet rated
Cherukuri
Participant



Joined: 25 Jul 2007
Posts: 46
Location: India
Points: 598

Post Posted: Tue Feb 14, 2012 6:29 am Reply with quote    Back to top    

Hi,

Please also help in creating a script as suggesed by Pandeesh.

Regards,
Cheru.

_________________
Cheru
Rate this response:  
Not yet rated
pandeesh



Group memberships:
Premium Members, Heartland Usergroup

Joined: 24 Oct 2010
Posts: 1399
Location: CHENNAI, TAMIL NADU
Points: 9855

Post Posted: Tue Feb 14, 2012 6:50 am Reply with quote    Back to top    

What help you require in creating a script?
You can try it yourself and if you struggle ,please post here.

_________________
pandeeswaran
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54287
Location: Sydney, Australia
Points: 294450

Post Posted: Tue Feb 14, 2012 3:27 pm Reply with quote    Back to top    

That is, we're more here to help you to learn than to provide solutions. That's called "consulting" and comes at a price.

_________________
RXP Services Ltd
Melbourne | Canberra | Sydney | Hong Kong | Hobart | Brisbane
currently hiring: Canberra, Sydney and Melbourne
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours