Multiple Cobol Copy Books

neeraj · Participant Joined: 24 May 2005 Posts: 107 Points: 1462

Hello,

I have 50 Cobol copy books(EBCDIC Format) that need to be populated into Teradata with minimal Transformation. The Job design would be

CFF ----> Modify/Transformer--->TD

One option is to create the 50 Datastage Jobs(read and load).

But I am looking for some generic option Like create Multiinstance jobs. But I believe CFF does't support schema files at run time.

Incase anyone is aware about any generic solution, please let me know.

Regards
neeraj

chulett · Posted: Mon Apr 29, 2013 7:24 am

Define "minimal transformation" for us, please.

nikhil_bhasin · Participant Joined: 19 Jan 2010 Posts: 50 Points: 393

Maybe you can write a script to convert ebcdic files into ascii and then use the files in your job

vmcburney · Posted: Tue Apr 30, 2013 5:33 pm

This is very hard to do as the Complex Flat File stage does not support column propagation and dynamic ETL. Cobol mainframe files each have a copybook that describes them and this tends to be unique for each file. You will need at least 50 DataStage jobs - one per unique copybook. You may be populating more than 50 target tables - those copybooks that have multiple arrays and different record types can have many types of outputs.

You are going from complex data to flattened data - the flattening process may mean you have many more than 50 target tables.

Minimum transformation can also be tricky when it comes to handling blanks or nulls or empty fields, sometimes the CFF stage needs to convert these to a default value which is a type of transformation.

I have found that if the copybooks are accurate you can load a copybook to Teradata in under an hour but if there are formatting and consistency and data type problems in those copybooks it could take several days to debug a single file.

Lucas97 · Participant Joined: 24 Oct 2020 Posts: 1 Points: 6

This topic has some technical stuff being shared here with those who are up for this and want to know what it was all about. I cannot say much becuase maybe you will find a bit more about papers writers so you need to do some research in this manner sooner.

ray.wurlod · Posted: Tue Oct 27, 2020 5:43 am

[Moderator: please remove spam message]

bruh · Participant Joined: 09 Jan 2021 Posts: 3 Points: 17

Data storaging is a good way to keep in mind everything that was made. I know that my mates working at the top resume writing services also using this storage method. I think it is quite suitable for such organizations. So, also thank you for your post pal.

ray.wurlod · Posted: Fri Feb 12, 2021 3:15 am

[Moderator: please remove spam message]