Unable to Attach large Files (20 MB) and above

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
uppalapati2003
Participant
Posts: 70
Joined: Thu Nov 09, 2006 2:14 am

Unable to Attach large Files (20 MB) and above

Post by uppalapati2003 »

Hi ,

We have a job(Server 7.5) that generates a report in a comma separated format (CSV), and automatically send it across to the desired recipients through the Notification Stage. As the report size is growing day by day the notification stage is unable to mail the file from couple of weeks. As the file size is close to 20 MB.
we have tried with zipping as well,but it may not be appropriate as the files size is keep on growing every day.
Thought of FTP the file but business request this in the mail as an attachment.
Can you please advise your thoughts on how to achieve/overcome this problem?

Thanks
Srini
Srini
MarkB
Premium Member
Premium Member
Posts: 95
Joined: Fri Oct 27, 2006 9:13 am

Post by MarkB »

I guess the first thought is - why is the file size so huge? Any way to pare down the size? Other than that, a .csv file is just text, and zipping it should drastically reduce the size of it. I can't see it being an issue.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

There is a definite limit on email sizes, that's why file sharing sites exist. Something that size you'll need to upload or ftp, either that or break it up and send it in multiple (separate) pieces.
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Note that this limit is imposed by your mail client, not by DataStage.

Can you write the file to a shared drive and send a link to it?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

ray.wurlod wrote:Note that this limit is imposed by your mail client, not by DataStage.
Which is exactly what I meant, should have been a teensy bit more specific it would seem. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
SURA
Premium Member
Premium Member
Posts: 1229
Joined: Sat Jul 14, 2007 5:16 am
Location: Sydney

Re: Unable to Attach large Files (20 MB) and above

Post by SURA »

Change the approach.

In the After subroutine call shell script which can SCP to move the data to some specific server and then send the status email.

DS User
Post Reply