Search found 19 matches

by karumudi7
Thu May 30, 2019 12:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Horizontal Pivoting with Header
Replies: 1
Views: 2366

Horizontal Pivoting with Header

Hello, I am receiving a file(s) like below, with header as Keys. So I need to transpose the data to (Key, Value) pairs dynamically. I am able to convert using the Pivot Enterprise stage with Horizontal Pivot, but how to capture the Header and generate the column as shown in desired output? File1: UI...
by karumudi7
Sat Mar 03, 2018 9:56 am
Forum: General
Topic: dsjob -wait is not waiting till the job completes
Replies: 2
Views: 1997

dsjob -wait is not waiting till the job completes

Hello, I have a datastage sequencer which will wait till it finds the file and once the file is available, it process the rest. The sequencer is working fine without any issues for years through DS scheduler. We have a new requirement and now I have to trigger this from a Unix script instead of DS s...
by karumudi7
Fri Oct 04, 2013 4:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading pipe delimited; but some columns missing
Replies: 6
Views: 5277

ArndW wrote:I experimented a bit and while there is no equivalent to the server "missing columns" mode, you can put in the following filter condition:

Code: Select all

awk 'BEGIN {FS = OFS = "|"}  ...[/quote]

Unable to read, Premium content.  :(
by karumudi7
Fri Oct 04, 2013 2:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading pipe delimited; but some columns missing
Replies: 6
Views: 5277

Reading pipe delimited; but some columns missing

Hi, I have a pipe delimited file with 3 columns. But for some records at the end there are some missing fields and pipes (delimiter) is also not availble. How can I read that file without losing any records! Sample File: Name|Email|Country ABC|abc@gmail.com|USA DEF| GHXY||INDIA Here the problem is w...
by karumudi7
Mon Sep 30, 2013 12:48 pm
Forum: General
Topic: Handling Job Exit status in Sequencer
Replies: 1
Views: 2431

Handling Job Exit status in Sequencer

Hi, I am creating some sequencers and after each Parallel job activity I am sending an email with parallel job exit status in the subject by using the [ #ACTVY.$JobStatus# ] #ACTVY.$JobName# Problem is I don't want exit codes instead I need Description. like Run with Warnings (instead of 2) etc; Are...
by karumudi7
Thu Jul 18, 2013 4:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Validation with reference tables
Replies: 4
Views: 2607

Yes all the tables are in same Database.
by karumudi7
Thu Jul 18, 2013 4:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Data Validation with reference tables
Replies: 4
Views: 2607

Data Validation with reference tables

Hello All, I have a source table with 6 columns, 1 is Key and other 5 are data. Each of these 5 columns have their own reference tables. So I have to validate each record's data column against their reference tables whether that purticular value is valid or not. If not present in refrence table, hav...
by karumudi7
Mon Jun 24, 2013 1:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Compare two tables and setting the flag
Replies: 1
Views: 1441

Compare two tables and setting the flag

Hi, I have two tables, Tab1 and Tab2. Both the tables have a common column. Tab1 columns: ID. EXIST_FLAG Tab2 columns : ID If a value is present in both the tables then FLAG should be set to "1" else "0". What I thought is using a LOOKUP TAB1----- Lookup---- TX ------ TAB1 (Looku...
by karumudi7
Tue Apr 30, 2013 1:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading XML content dynamically
Replies: 1
Views: 1719

Reading XML content dynamically

Hi, How can we read a XML file dynamically and create a Flat file. I can create a flat file, if the XML have constant tags. But in this case the codes may vary in day-to-day file. Say, I have a xml code as: <data> <answers> <Q1 ans="01" </Q1> <Q2 ans="02" </Q2> <Q3 anstxt="0...
by karumudi7
Mon Jan 21, 2013 10:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String Match & Extract
Replies: 3
Views: 2217

Actually, here we don't know which one will come among those patterns I gave.

If we get "APA" in that filed, we have to extract APA or if we get "APC" we have to extract "APC" etc;

But we will get only one pattern among these.
by karumudi7
Mon Jan 21, 2013 9:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String Match & Extract
Replies: 3
Views: 2217

String Match & Extract

Hi, I have a column in a file with the data like below: CLESCLJSCSHSCSMSCSNSCSRSCUDSCUFSCU7SCV1SCWPSCXGPDBACAPA0DHDPDMESED6 SBR4PCBFPCDRSCSCG3SCHEBSCKNSCKPSCLLSCMCZXTNPCVFPCV6P4KL0DMDSDSASEWG I have a group of fixed patterns which can occur in this strings & only one among the following will com...
by karumudi7
Wed Nov 21, 2012 1:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Bulk delete from table using db2 connector?
Replies: 3
Views: 5608

The statement generated is ALTER TABLE TABLE_NAME ACTIVATE NOT LOGGED INITIALLY WITH EMPTY TABLE.

The ALTER TABLE statement failed, most likely due to insufficient user privileges. A DELETE statement will be executed instead.

Due to delete query execution I am getting DB Tx log full.
by karumudi7
Wed Nov 21, 2012 1:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Bulk delete from table using db2 connector?
Replies: 3
Views: 5608

Bulk delete from table using db2 connector?

Hi, I have one table with 70 Million recs. I need to make fresh load into the table using a file have 72 Million recs. So I created a job; Seq_file--->Transformer--->db2_connector In db2_connector I tried with: Write Mode- Insert & Table Action-Truncate - This caused by DB transaction log full w...
by karumudi7
Sun Nov 04, 2012 11:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Junk characters in Sequential file
Replies: 8
Views: 6879

There are almost never genuinely junk characters. I believe that the first two bytes of your file are a byte-order mark. Set the property of the Sequential File stage to tell the stage to ignore t ... My DataStage Director log is also showing a warning as: Export schema contains at least one non-st...
by karumudi7
Sat Nov 03, 2012 11:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Junk characters in Sequential file
Replies: 8
Views: 6879

I am not using any special oprions. In format, I am using Final Delimiter : End, Delimiter | , quote : none.

In properties as also all are default.

Not tried with peek.