Search found 146 matches

by gsbrown
Wed Apr 02, 2014 10:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Composer Multiple Nested List Elements
Replies: 4
Views: 4882

XML Composer Multiple Nested List Elements

I'm trying to build this XML format where I have multiple repeated elements nested under <Customer> for each unique Customer Number. <Customer> <Customer Number='123456'> <Name> <Name Location="First">Greg</Name> <Name Location="Middle">S</Name> <Name Location="Last">Br...
by gsbrown
Thu Mar 20, 2014 9:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Composer Step Mapping
Replies: 3
Views: 2798

Got a bit further, turns out my XSD needed the "unbounded" clause at the top hierarchy level to expose it as a selectable element, then all elements underneath became available column mappings <xs:sequence> <xs:element name="Customer" maxOccurs='unbounded'> <xs:complexType>
by gsbrown
Thu Mar 20, 2014 8:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Composer Step Mapping
Replies: 3
Views: 2798

XML Composer Step Mapping

I'm attempting a simple XML mapping to learn the new XML stage. I've selected "top" to get all incoming rows combined into one single XML output, but when I do that I don't get any column mappings available. If I select "More.." and try to manually choose the column mappings I ge...
by gsbrown
Wed Mar 19, 2014 2:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generate Multiple Files without outputting key column value
Replies: 6
Views: 12130

Was this ever resolved? I'm now running into the same issue. I need "File Name" as one of the output columns to use in the file name generation, but I don't want it as a column in my output file.
by gsbrown
Fri May 24, 2013 2:07 pm
Forum: IBM<sup>®</sup> SOA Editions (Formerly RTI Services)
Topic: Deployment Runtime Settings
Replies: 0
Views: 5139

Deployment Runtime Settings

I want to make sure I'm setting up a particular service runtime scenario properly. I have a web service that I only want running if there's a submitted request. Then, from that point leave the instance running for any immediate subsequent requests, but if one hasn't come through within 5min then shu...
by gsbrown
Thu Aug 23, 2012 12:33 pm
Forum: General
Topic: Server Job Control GOTO command label variable?
Replies: 1
Views: 1118

Server Job Control GOTO command label variable?

Is it possible to use a variable label name in a [GOTO <label>] statement? I've tried different things and it won't compile, so I'm wondering if there's a BASIC trick to doing this. Basically, I want my label to be a job parameter that is assigned at runtime and the GOTO statement goes to that label...
by gsbrown
Thu Aug 02, 2012 12:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: No field specified for reducer
Replies: 3
Views: 3516

Thanks for pointing me in the direction of the Aggregator! Still trying to transition from Server to Parallel and just discovered the RowCount() functionality in Parallel Aggregator which is now working with no warnings.

Thanks for your quick response!
by gsbrown
Thu Aug 02, 2012 11:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: No field specified for reducer
Replies: 3
Views: 3516

The aggregator is basically just serving as a row count. There's one field for "GroupColumn" and another for "CountColumn" where both are hardcoded to one. Then in the aggregator stage it's grouped on the "GroupColumn" field then summing the "CountColumn" fiel...
by gsbrown
Thu Aug 02, 2012 10:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: No field specified for reducer
Replies: 3
Views: 3516

No field specified for reducer

Have a job with an ODBC Connector input, Netezza bulk load output, then all rows going through an aggregator stage into another ODBC Connector output. The job runs fine, but always logs this one warning "main_program: No field specified for reducer, statistics will be calculated for all fields....
by gsbrown
Thu Jul 05, 2012 12:12 pm
Forum: General
Topic: Datastage 8.5 Authentication Issues
Replies: 1
Views: 2527

We had a similar situation and it turned out that our distinguished names we set inside WAS security settings weren't the exact same upper/lower case as how it appeared in Active Directory. Once we fixed that, it worked! Review your settings again and be sure you're not also victim to case sensitivi...
by gsbrown
Fri Apr 20, 2012 1:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Best Parallel Job Design for Non-Exist Inserts Only
Replies: 8
Views: 3286

Thanks for the tips! After toying with it quite a bit, I'm getting the best results using 2 ODBC Connector stages (DB A & DB B) into a Join stage then a transform to drop the records that already exist. It takes about 30-45min to get through all 18,000,000 records and I'll continue to learn and ...
by gsbrown
Fri Apr 20, 2012 1:52 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Director Log Database SQL Response
Replies: 2
Views: 1644

Director Log Database SQL Response

I have a job with an ODBC stage that is submitting a user-defined INSERT INTO...SELECT FROM statement. Is there a way to capture the response from the database and write it to the DataStage job log? For example, "17,000 Row(s) affected"
by gsbrown
Wed Apr 18, 2012 3:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Best Parallel Job Design for Non-Exist Inserts Only
Replies: 8
Views: 3286

You're right, I don't need all the unnessary updates and #2 approach is better. I've got a job design created using the Join Stage where I'm reading in database A and left joining to the key field from database B then have a IsNull() transform contraint. It's working, but takes approx 45min to run t...
by gsbrown
Wed Apr 18, 2012 2:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Best Parallel Job Design for Non-Exist Inserts Only
Replies: 8
Views: 3286

Best Parallel Job Design for Non-Exist Inserts Only

New to parallel design...

I'm sourcing database A and targeting database B. How would I best design a job that only writes records from A that don't already exist in B? It's a fairly large dataset (18 million records) with one unique ID key field.
by gsbrown
Wed Dec 21, 2011 4:02 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML Parsing Question
Replies: 3
Views: 2428

Unfortunately, I tried the XML importer and it setup the columns where my example would come through as 3 rows. /Individual/Name/@Location /Individual/Name/Name/text() produces 3 rows... First Bob Middle Alan Last Smith Wasn't sure if there was a sneakier way to code it so that I got one row Bob Ala...