Search found 7 matches

by wpakkala
Fri Aug 11, 2017 12:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataStage MD5 Implementation
Replies: 12
Views: 10710

DataStage MD5 Implementation

Does anyone have an MD5 "Stage" for DataStage 11.5 or tips of how to create one?

Also, it would need to match the perl digest::md5 results?
by wpakkala
Fri Jul 21, 2017 2:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Combining record columns into single multiple records
Replies: 5
Views: 4267

Combing records solved

I have solved the issue: Using a Transformer Stage, I created a Stage Variable to concatenate the columns I want together. This is based on the ClusterChangeKey set up by a sort stage just previous. The other key point was to use a LastRowInGroup() as a constraint on the output so that I only get 1 ...
by wpakkala
Wed Jul 19, 2017 1:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Combining record columns into single multiple records
Replies: 5
Views: 4267

Activities so far

I have tried using a sort/transformer but then realized that this will only create a single record.....I am interested in multiple records.....[also, I did not get the results I wanted but this is my error]
by wpakkala
Tue Jul 18, 2017 5:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Combining record columns into single multiple records
Replies: 5
Views: 4267

Combining record columns into single multiple records

Here is my data
key seq field
1 1 f1
1 2 f2
1 3 f3
2 1 ff1
2 2 ff2

I want to get the following output

key field
1 f1,f2,f3
2 ff1,ff2

Looking for some assistance as to how to perform this in DataStage 11.5
by wpakkala
Fri Oct 21, 2016 1:54 pm
Forum: IBM QualityStage
Topic: Installation question --> directory
Replies: 1
Views: 12869

Installation question --> directory

I am attempting to install the QualityStage AVI component and I am confused by the instructions which state... Download and extract the reference data packages by following the instructions in the Downloading the product section of the download document. Then, copy the reference data packages to the...
by wpakkala
Mon Oct 03, 2016 8:13 am
Forum: General
Topic: Datastage BDFS access to a hadoop environment (HDP v2.5)
Replies: 2
Views: 4326

Re: Datastage BDFS access to a hadoop environment (HDP v2.5)

To all I have resolved the problem. Turns out there are numerous libraries and files to be copied to the IIS server (as per the documentation) for configuring IIS to support hadoop. Having re-done that work, I can connect to the files...The name I was using was also incorrect. Now, I have file proce...
by wpakkala
Wed Sep 28, 2016 2:55 pm
Forum: General
Topic: Datastage BDFS access to a hadoop environment (HDP v2.5)
Replies: 2
Views: 4326

Datastage BDFS access to a hadoop environment (HDP v2.5)

I am trying to connect my Datastage environment (job) to a Horton Works sandbox v2.5 (runs on Centos 7). I have both IIS 11.5 operating properly and the HDP environment is running fine. I have followed the installation instructions for setting up hadoop in IIS ... /etc/hosts is configured, copied li...