Search found 19 matches
- Thu May 30, 2019 12:03 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Horizontal Pivoting with Header
- Replies: 1
- Views: 2366
Horizontal Pivoting with Header
Hello, I am receiving a file(s) like below, with header as Keys. So I need to transpose the data to (Key, Value) pairs dynamically. I am able to convert using the Pivot Enterprise stage with Horizontal Pivot, but how to capture the Header and generate the column as shown in desired output? File1: UI...
- Sat Mar 03, 2018 9:56 am
- Forum: General
- Topic: dsjob -wait is not waiting till the job completes
- Replies: 2
- Views: 1997
dsjob -wait is not waiting till the job completes
Hello, I have a datastage sequencer which will wait till it finds the file and once the file is available, it process the rest. The sequencer is working fine without any issues for years through DS scheduler. We have a new requirement and now I have to trigger this from a Unix script instead of DS s...
- Fri Oct 04, 2013 4:05 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reading pipe delimited; but some columns missing
- Replies: 6
- Views: 5277
ArndW wrote:I experimented a bit and while there is no equivalent to the server "missing columns" mode, you can put in the following filter condition:
Code: Select all
awk 'BEGIN {FS = OFS = "|"} ...[/quote] Unable to read, Premium content. :(
- Fri Oct 04, 2013 2:57 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reading pipe delimited; but some columns missing
- Replies: 6
- Views: 5277
Reading pipe delimited; but some columns missing
Hi, I have a pipe delimited file with 3 columns. But for some records at the end there are some missing fields and pipes (delimiter) is also not availble. How can I read that file without losing any records! Sample File: Name|Email|Country ABC|abc@gmail.com|USA DEF| GHXY||INDIA Here the problem is w...
- Mon Sep 30, 2013 12:48 pm
- Forum: General
- Topic: Handling Job Exit status in Sequencer
- Replies: 1
- Views: 2431
Handling Job Exit status in Sequencer
Hi, I am creating some sequencers and after each Parallel job activity I am sending an email with parallel job exit status in the subject by using the [ #ACTVY.$JobStatus# ] #ACTVY.$JobName# Problem is I don't want exit codes instead I need Description. like Run with Warnings (instead of 2) etc; Are...
- Thu Jul 18, 2013 4:57 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Data Validation with reference tables
- Replies: 4
- Views: 2607
- Thu Jul 18, 2013 4:42 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Data Validation with reference tables
- Replies: 4
- Views: 2607
Data Validation with reference tables
Hello All, I have a source table with 6 columns, 1 is Key and other 5 are data. Each of these 5 columns have their own reference tables. So I have to validate each record's data column against their reference tables whether that purticular value is valid or not. If not present in refrence table, hav...
- Mon Jun 24, 2013 1:17 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Compare two tables and setting the flag
- Replies: 1
- Views: 1441
Compare two tables and setting the flag
Hi, I have two tables, Tab1 and Tab2. Both the tables have a common column. Tab1 columns: ID. EXIST_FLAG Tab2 columns : ID If a value is present in both the tables then FLAG should be set to "1" else "0". What I thought is using a LOOKUP TAB1----- Lookup---- TX ------ TAB1 (Looku...
- Tue Apr 30, 2013 1:03 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reading XML content dynamically
- Replies: 1
- Views: 1719
Reading XML content dynamically
Hi, How can we read a XML file dynamically and create a Flat file. I can create a flat file, if the XML have constant tags. But in this case the codes may vary in day-to-day file. Say, I have a xml code as: <data> <answers> <Q1 ans="01" </Q1> <Q2 ans="02" </Q2> <Q3 anstxt="0...
- Mon Jan 21, 2013 10:11 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: String Match & Extract
- Replies: 3
- Views: 2217
- Mon Jan 21, 2013 9:17 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: String Match & Extract
- Replies: 3
- Views: 2217
String Match & Extract
Hi, I have a column in a file with the data like below: CLESCLJSCSHSCSMSCSNSCSRSCUDSCUFSCU7SCV1SCWPSCXGPDBACAPA0DHDPDMESED6 SBR4PCBFPCDRSCSCG3SCHEBSCKNSCKPSCLLSCMCZXTNPCVFPCV6P4KL0DMDSDSASEWG I have a group of fixed patterns which can occur in this strings & only one among the following will com...
- Wed Nov 21, 2012 1:40 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Bulk delete from table using db2 connector?
- Replies: 3
- Views: 5608
- Wed Nov 21, 2012 1:07 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Bulk delete from table using db2 connector?
- Replies: 3
- Views: 5608
Bulk delete from table using db2 connector?
Hi, I have one table with 70 Million recs. I need to make fresh load into the table using a file have 72 Million recs. So I created a job; Seq_file--->Transformer--->db2_connector In db2_connector I tried with: Write Mode- Insert & Table Action-Truncate - This caused by DB transaction log full w...
- Sun Nov 04, 2012 11:51 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Junk characters in Sequential file
- Replies: 8
- Views: 6879
There are almost never genuinely junk characters. I believe that the first two bytes of your file are a byte-order mark. Set the property of the Sequential File stage to tell the stage to ignore t ... My DataStage Director log is also showing a warning as: Export schema contains at least one non-st...
- Sat Nov 03, 2012 11:15 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Junk characters in Sequential file
- Replies: 8
- Views: 6879