Page 1 of 1

Data File Compression stage

Posted: Wed Jun 13, 2007 10:39 am
by VCInDSX
Hi,
In our existing applications we generate different flavors of files (Text, XML) and compress them to Zip, GZ et al and then upload these to FTP sites.
Current workaround is to execute the compression scripts (ExecuteSH et al) and then come back to Datastage and continue the job.
If we need to interrogate the failures or status of this external operation that happened outside datastage's control, extra effort is required.
Would be great to have this as a stage and be able to integrate within the workflow....

Same is true if we have to uncompress a downloaded file and extract it to work with its contents....

Just a wish...

Thanks,

Posted: Wed Jun 13, 2007 3:22 pm
by ray.wurlod
You have these in parallel jobs (Compress and Expand stages). You have this indirectly in job sequences, via the Execute Command activity. I don't believe this request will get very far.

Posted: Wed Jun 13, 2007 4:51 pm
by VCInDSX
ray.wurlod wrote:You have these in parallel jobs (Compress and Expand stages). You have this indirectly in job sequences, via the Execute Command activity. I don't believe this request will get very far.
Hi Ray,

Thanks for the quick followup. Appreciate it much.
I didn't realize that the Compress and Expand stages could be used for compressing text/xml files. I will try this route, in a parallel job.
What would the column and format definitions be for compressed file, Ray?

In my server job, I am using ExecuteCommand for compressing a file, in an AfterJob routine. Trying to plug the error handling part for that now.

Thanks again,