Search found 72 matches

by SettValleyConsulting
Wed Dec 14, 2016 2:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical Regroup - Multiple children-on the right track?
Replies: 5
Views: 8039

Thanks, Ernie. Yes, Claim and Conviction are independent children of Driver, and they are joined upstream. As I said, I am a Hierarchical stage newbie, and HJoin was on my list of the next things to try. But surely this should be achievable using Regroup? I have to observe, however that the I am fin...
by SettValleyConsulting
Wed Dec 14, 2016 6:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical Regroup - Multiple children-on the right track?
Replies: 5
Views: 8039

Update: So I've tried that method, however when trying to map the claim and conviction children I am getting the dreaded CDIUI2820E 'The mapping is not applicable due to an invalid type conversion or difference in the source and target list dimensions.'

Back to the drawing board?
by SettValleyConsulting
Wed Dec 14, 2016 5:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical Regroup - Multiple children-on the right track?
Replies: 5
Views: 8039

Hierarchical Regroup - Multiple children-on the right track?

Hierarchical Regroup - Multiple children - Am I on the right track? Problem: I have a flat record coming in, representing a motor insurance quote. The quote may have multiple drivers, and each driver may have multiple claims and multiple convictions. So a tree structure with quote at the top, then d...
by SettValleyConsulting
Tue Dec 04, 2012 4:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP In remove duplicates and to pass the keys as param
Replies: 3
Views: 4970

This is something I've been musing on for some time - there are numerous occasions where I'd like to be able to use RCP and identify key column names as parameters, for sorting, de-duping, change capture etc. The ideal solution would be a reusable component - probably a shared container - with the f...
by SettValleyConsulting
Tue Dec 04, 2012 4:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Equivalent of Translate fn which can be used on Modify Stage
Replies: 4
Views: 2606

The Modify Stage is basically a wrapper round the Modify Operator (See the Orchestrate documentation or The Datastage Advanced Parallel Developers Guide under Operators). You're limited to the conversion functions built into this operator and the type of string translation you want is not one of the...
by SettValleyConsulting
Mon Dec 03, 2012 8:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP and performing a database update
Replies: 7
Views: 10830

Just came across this and thought I'd post an alternative:- If your target is Oracle, you can retrieve the column list from the metadata table all_tab_columns. It's not pretty, but here is some working code, this generates a SQL statement which is written to a file used as the SQL file in the update...
by SettValleyConsulting
Wed Nov 28, 2012 4:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: What am I doing wrong?
Replies: 3
Views: 2437

What am I doing wrong?

So I have a sequential file with dates in the form 2012-11-25. On the format tab of the sequential file I set the format string for dates to be %yyyy-%mm-%dd. The help text for this property is 'The string format of a date. By default, the format of the date string is %yyyy-%mm-%dd. reinforced by th...
by SettValleyConsulting
Tue Aug 07, 2012 9:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String to Decimal Validation
Replies: 6
Views: 3052

Thank, Arnd. I'd pretty much come to the same conclusion, just wondering if there was some obscure option to switch on strong typing .....
by SettValleyConsulting
Tue Aug 07, 2012 8:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String to Decimal Validation
Replies: 6
Views: 3052

String to Decimal Validation

In a transformer, fitted with a reject link, I am mapping a string to a decimal type. What I want to happen:- If the incoming data is not a numeric string, e.g. 'aaaa' I want the row to be shunted into the reject link. What actually happens (to my surprise) The value is defaulted to zero, a warning ...
by SettValleyConsulting
Fri Oct 28, 2011 9:49 am
Forum: General
Topic: Detect if a job is multi-instance?
Replies: 1
Views: 1360

Detect if a job is multi-instance?

Is it possible to detect if a job is multi-instance in code? I have a shared container and it generates a string based on the Job Name and Invocation ID. But when embedded in a single-instance job the call to the DSInvocationID macro throws a warning. We have a zero-tolerance policy towards warnings...
by SettValleyConsulting
Wed Mar 16, 2011 4:00 am
Forum: General
Topic: Capturing Job run stats
Replies: 2
Views: 4002

Thanks Kim. I grabbed ETLStats and had a look last night. Very nice. It gets me a long way towards where I want to go. I think using my self-imposed rules of no undocumented access to Datastage internals and 'Keep It Simple' I am going to end up with something that compromises on my 'ideal world' so...
by SettValleyConsulting
Tue Mar 15, 2011 10:23 am
Forum: General
Topic: Capturing Job run stats
Replies: 2
Views: 4002

Capturing Job run stats

Quick question for all ETLStats/joblogging gurus... I have been tasked with developing/upgrading a 'framework' into which production sequences/jobs can be inserted. The framework will provide various common functions, one of which is capturing job runtimes, statuses, row counts, parameters to Oracle...
by SettValleyConsulting
Tue Feb 15, 2011 5:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Complex Flat File and multple, conditional record types.
Replies: 6
Views: 5191

Try reading the file as single column. process the records sequentially. using stage variables you can combine the transaction and addenda record. Yep. I am reading, using a sequential file stage, the whole record into a single column RECORD, type char, substringing column 1 to get the record type,...
by SettValleyConsulting
Tue Feb 15, 2011 3:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Complex Flat File and multple, conditional record types.
Replies: 6
Views: 5191

Thanks for the suggestions - Ray - Can't you send 6 and 5 along separate links into a Funnel? Well, yes I could but (a) they have different metadata and (b) how would I guarantee sort order? Maybe I did not express the requirement sufficiently clearly - A Type 5 record may or may not be immediately ...
by SettValleyConsulting
Mon Feb 14, 2011 10:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Complex Flat File and multple, conditional record types.
Replies: 6
Views: 5191

Doh!

Well that's not gonna work is it? :roll: The CFF only permits you to interrogate a single Record Id column and send all rows of that record type down the same link. I need to send Types 5 AND 6 down the same link, and as the sequence is the only thing that connects them, to preserve the sort order. ...