Search found 52 matches
- Thu Feb 06, 2020 10:54 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Routines to do EReplace Function
- Replies: 7
- Views: 7739
- Tue Feb 04, 2020 7:42 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Routines to do EReplace Function
- Replies: 7
- Views: 7739
Unfortunately, after a second look, Routines might not be the option we are looking for at this point in time. From what I understand, if we take Parallel Routine path, we should make some changes in administrator to compile C++ code which would require a lot of approvals. And we also don't have a p...
- Tue Feb 04, 2020 4:31 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Routines to do EReplace Function
- Replies: 7
- Views: 7739
Routines to do EReplace Function
Hi, I have a requirement to convert all alphabets in a field to convert to symbols. Right now, I am using EReplace to do this in a transformer. But this requirement is getting extended to multiple fields. I was wondering if I can write this code in a Routine and call it from each field so that we do...
- Wed Oct 09, 2019 11:50 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to Convert Formulas to Values in XLSX and CSV file
- Replies: 3
- Views: 4442
Hi Chulett, thank you for the response. Yes, it is not XSV, it is CSV. Sorry about that. I am not converting spreadsheet to csv. My source is a DB. I am manually writing formulas in transformer. But when I output those Formulas either to CSV or XLSX spreadsheet, they look like formulas when we open ...
- Tue Oct 08, 2019 7:46 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to Convert Formulas to Values in XLSX and CSV file
- Replies: 3
- Views: 4442
How to Convert Formulas to Values in XLSX and CSV file
Hi, I have a scenario where I need to perform some estimations by picking data from different rows in a file. For example, I have 100 rows. I have to use data from rows 1 to 10 to determine value in row 20. But then I have to use that data in 20 to determine value from 11 to 19. So instead of calcul...
- Tue May 21, 2019 9:31 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Remove Carriage Return in Sequential Stage Filter
- Replies: 10
- Views: 7402
The reason why we didn't run unix commands in sequence job is sometimes, we will be asked to process just a single file and running the sequence will trigger multiple jobs. So, we decided to keep the whole logic in the parallel job itself. Honestly, I didn't think of using routines in parallel job. ...
- Mon May 13, 2019 1:15 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to connect and read a SAS dataset in Datastage
- Replies: 1
- Views: 3078
How to connect and read a SAS dataset in Datastage
Hi, So far we were downloading SAS datasets manually and using them as input in Datastage jobs. Going forward we have to connect to SAS server and pull data from Datasets directly. There is very limited information available on this online. Can you of you provide your thoughts on this? I have my ser...
- Mon May 13, 2019 1:05 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Remove Carriage Return in Sequential Stage Filter
- Replies: 10
- Views: 7402
Thank you everyone for the responses. I am getting extra CRs in file that we get from third party source. We figured it would be easy to fix it from our end. I used TR in before job sub routineto remove CRs and then used sed in seq stage filter to remove header and footer. I was trying to accomplish...
- Wed May 08, 2019 10:46 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Remove Carriage Return in Sequential Stage Filter
- Replies: 10
- Views: 7402
Remove Carriage Return in Sequential Stage Filter
Hi,
I am already using sed '1d;$d' to remove first and last line of the file. Now I have to remove carriage return from the file too. I have commands that can do both tasks separately. But I'm trying to find a command that can do all tasks in one filter.
Any help is appreciated.
Thanks.
I am already using sed '1d;$d' to remove first and last line of the file. Now I have to remove carriage return from the file too. I have commands that can do both tasks separately. But I'm trying to find a command that can do all tasks in one filter.
Any help is appreciated.
Thanks.
- Tue Apr 23, 2019 2:47 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to Read a SAS file in Datastage
- Replies: 4
- Views: 4371
- Wed Apr 17, 2019 8:28 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to Read a SAS file in Datastage
- Replies: 4
- Views: 4371
I do have SAS Stage and SAS Parellel Dataset stage. Though, Looks like Parellel Dataset stage accepts only .ds files. I downloaded the SAS file and placed it on Datastage server and copied the code from here and tried to read the file using SAS stage. I got an error. My code: sas -source 'libname /o...
- Wed Apr 17, 2019 8:36 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to Read a SAS file in Datastage
- Replies: 4
- Views: 4371
How to Read a SAS file in Datastage
Hi, I have never worked on SAS and now we have a requirement to read data from SAS dataset. There is not much online that could help. I got access to SAS datasets using the SAS Enterprise Guide. Here are the details I have. When I logged into SAS Enterprise Guide, it asked me to create profile. I ga...
- Thu Jan 03, 2019 5:11 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Write to excel using Unstructured Data stage
- Replies: 1
- Views: 3065
Write to excel using Unstructured Data stage
I came across a page in IBM KC website which explains how to write data to Excel files and these are the first three steps mentioned. 1. Double-click Unstructured Data stage to open the stage properties. 2. From the Stage tab, select Excel from the Document type list. 3. From the Write mode list, se...
- Fri May 04, 2018 6:37 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to generate warnings when rows rejected
- Replies: 4
- Views: 3464
- Thu May 03, 2018 2:00 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to generate warnings when rows rejected
- Replies: 4
- Views: 3464
How to generate warnings when rows rejected
Hi all, I have a sequential file capturing rejects from a db2 connector. I do not want to fail the job because I want to capture all rejects in file for analysis. But I want to abort the sequence. To achieve that, I want db2 connector to generate warnings when the rows get rejected into the sequenti...