Search found 11 matches

by chitrangadsingh
Mon Feb 26, 2007 2:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generic job for tranforming multiple files
Replies: 7
Views: 4041

Thanks all for your time and suggestions. Novneet: Metadata will differ. Files are fixed-length, no quote char. Let's assume char field will have only char data and numeric only number. Let me know if you have any suggestions on this. Thanks. [quote="DSguru2B"]I would opt for sed/awk scrip...
by chitrangadsingh
Fri Feb 23, 2007 4:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generic job for tranforming multiple files
Replies: 7
Views: 4041

Thanx Ray for the prompt response as always.. but guess m unlucky not to have a premium membership till yet! Anyways, watever i cud gather from ur visible reply is: i should build separate jobs for each file and add transformations and col names as n when requirement comes? Isn't there a workaround ...
by chitrangadsingh
Fri Feb 23, 2007 2:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generic job for tranforming multiple files
Replies: 7
Views: 4041

Generic job for tranforming multiple files

Hi all, We have a requirement wherein 17 files each with different metadata are to be read and some generic transformations/ data cleansing is to be done. These majorly include stripping white spaces from char fields and removing leading/trailing zeroes from decimal fields. The idea is to design a g...
by chitrangadsingh
Wed Feb 22, 2006 11:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Mapping multiple rows to a single row
Replies: 6
Views: 3283

Thanx for replying Kumar...i've already implemented this logic. But i was just wondering if we have any spcific stage to do the job.(tried exploring combine rows etc but cudnt make much headway) Think of a scenario when u have a large no. of combinations for CDE1...CDE4 values. The transformer deriv...
by chitrangadsingh
Wed Feb 22, 2006 5:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Mapping multiple rows to a single row
Replies: 6
Views: 3283

Output is direct mapping of AMT and CNT fields to the respective fields in o/p depending upon the values in CDE1...CDE4 cols. There r no calculations involved. Lets say, if CDE1='DM' and CDE4='BT' then AMT will map to a field called DM_AMT_BT...and so on.Similarly for CNT field. Hope this clears the...
by chitrangadsingh
Wed Feb 22, 2006 3:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Mapping multiple rows to a single row
Replies: 6
Views: 3283

Mapping multiple rows to a single row

Hi all, Here's the requirement that i'm facing: Can a Datastage process be designed for doing the following: Input file CHAIN CDE1 CDE2 CDE3 CDE4 AMT CNT 100, DM, N, N, BT, 300, 2 100, DM, N, N, AC, 200, 1 100, EM, N, N, BT, 100, 3 200, DM, N, N, BT, 300, 2 200, DM, N, N, AC, 200, 3 200, EM, N, N, B...
by chitrangadsingh
Thu Aug 04, 2005 3:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to use Transformer with a Schema file
Replies: 5
Views: 2852

How to use Transformer with a Schema file

Hi, Posting the query as a separate thread. While using a schema file, if one has to do some transformations/calculations then how this can be done? I'm using run time col propagation and now there wont be any columns visible in the transformer (since the basic purpose of using schema file is to avo...
by chitrangadsingh
Thu Aug 04, 2005 12:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help on Schema file
Replies: 4
Views: 2654

Re: Help on Schema file

Thanx Rajiv, It worked. But now i have another related query. In this scenario, if one has to do some transformations/calculations then how this can be done? coz now there wont be any columns visible in the transformer. I actually tried putting in a transformer in b/w two seq file stages. The job ra...
by chitrangadsingh
Tue Aug 02, 2005 1:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help on Schema file
Replies: 4
Views: 2654

Help on Schema file

Hi all, I'm using a schema file to read/write into a sequential file. But when i delete the metadata in the stage, the job doesn't compile nor i'm able to view data. My understanding is, schema files are used where metadata is not static and keeps on changing. Thus the metadata has to be changed onl...
by chitrangadsingh
Mon Jul 18, 2005 5:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Frequency of a record in a sequential file
Replies: 4
Views: 1736

Hey thanx for the warm welcome and the soln.

Any idea regd any docs freely available on net for Datastage??

(i'm kinda on leave and thus dont have access to any docs)
by chitrangadsingh
Mon Jul 18, 2005 4:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Frequency of a record in a sequential file
Replies: 4
Views: 1736

Frequency of a record in a sequential file

Hi, I have to read a sequential file with some fields and the output should contain the frequency of occurence of values in one of the fields. For eg. lets assume file has 3 fields A,B and C. the sample data is A B C e t g e w p r u g s t p Now the output file should have : C Count g 2 p 2 How this ...