Write a delimted file to S3

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
pavankvk
Participant
Posts: 202
Joined: Thu Dec 04, 2003 7:54 am

Write a delimted file to S3

Post by pavankvk »

Hi

I need to write about ~100 files to S3. I have different schema for each file and instead of having few 100 jobs, planning to use RCP.

The job design is something like this:

sequential file --> copy --> s3

No columns are defined and the sequential file uses a schema file.

The schema file the columns are defined as ustring. It is a supported data type, but s3 fails saying it is unsupported.

When I have the same file written to a SQL Server table to a nvarchar field, I am able to read properly from the table and load to S3. Should we have ustring mapped to nvarchar for loading to s3?

Can't we have a job writing file to s3 using ustring data type?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Re: Write a delimted file to S3

Post by ray.wurlod »

pavankvk wrote:can't we have a job writing file to s3 using ustring data type?
One might think so, but it would require that the S3 instance supports Unicode. Not all do.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply