Search found 3835 matches

by eostic
Mon Dec 03, 2018 12:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchy stage <element/> tags
Replies: 4
Views: 4189

The two are equivalent, assuming you mean <element> </element>
by eostic
Tue Nov 27, 2018 5:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: COBOL file without copybook
Replies: 98
Views: 43995

Reviewing this thread. A truly frustrating situation when the mainframe folks aren't communicating. It has probably been said in earlier parts of this thread, but be ABSOLUTELY CERTAIN you are working with a quality editor that allows you optionally to see every row in its full HEX format. That's cr...
by eostic
Fri Nov 16, 2018 11:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parse JSON using a Schema
Replies: 4
Views: 5347

That's the best approach due to the fact that there is no formal standard for JSON schemas. Note --- Be careful when completing your document to fully represent your arrays...meaning...if you have a truly repeating subnode, then put more than one value in that node array. I haven't checked carefully...
by eostic
Thu Nov 15, 2018 1:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parse JSON using a Schema
Replies: 4
Views: 5347

JSON Schema has seen some success, but is not widespread --- not like xml schema and its formality. The Hierarchical Stage uses a formal JSON document --- best suggestion is to find a "complete" one that has at least one instance of each element, and preferably, two or more instances of an...
by eostic
Tue Oct 30, 2018 4:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: xml output stage vs hierarchy stage
Replies: 1
Views: 2911

Wow. Missed this one. Sorry! For validation, even though it may be overkill in this case, I would still choose the Hierarchical Stage, if only because it provides a LOT more options for control of the validation of your schema.....it's also faster, and can more easily (if and when you need it in the...
by eostic
Thu Oct 25, 2018 4:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Use of Hierarchical Data XML Stage
Replies: 7
Views: 19725

"The moment it is defined as list, it needs a separate output link even though it is a child for company." Not true. You can go "as many nested lists deep" on a single link as you want. ...meaning that "Company" and "Department" elements and attribute values c...
by eostic
Wed Oct 24, 2018 12:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Use of Hierarchical Data XML Stage
Replies: 7
Views: 19725

The Hierarchical Stage is many times faster as it uses a different methodology to more intelligently parse the xml. Multiple output links? ...that's simply the nature of a hierarchy if you are putting the data into relational tables. Of course, if you are just doing this to back up "chunks"...
by eostic
Tue Oct 23, 2018 4:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Use of Hierarchical Data XML Stage
Replies: 7
Views: 19725

...misread your original email...I see you are "reading" the xml. ...and yes, you would aim for a single output link for each complete "path". ...and 100 output links? Perhaps...but that is normal....especially because typical "normalization" of such a hierarchy would m...
by eostic
Mon Oct 22, 2018 3:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Use of Hierarchical Data XML Stage
Replies: 7
Views: 19725

You dont necessarily need one link for every list (actually, it is generally one link per complete "path", where a path might have many nested lists) but it is the most typical.....because those independent paths are frequently coming from many different sources, such as multiple relationa...
by eostic
Thu Oct 18, 2018 7:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating XML files Dynamic XSDs
Replies: 4
Views: 3614

yeah.. a lot of it depends though, on "how dynamic"? For example, if it can be one of (say) 8 xsds...then just have 8 instances of the xmlOutput Stage or the Hierarchical Stage (actually, you could probably do it in one big hierarchical stage instance, but I would prefer multiples, just fo...
by eostic
Wed Oct 17, 2018 5:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating XML files Dynamic XSDs
Replies: 4
Views: 3614

Not really possible, because an xsd could mean structure change, different groupings, different hierarchy, multiple leafs, etc. It's not like a "schema" change in a relational environment. ....and the Stages take that into account and their metadata isnt dynamic on the links or in the asse...
by eostic
Wed Sep 26, 2018 4:22 am
Forum: Information Analyzer (formerly ProfileStage)
Topic: Asset metadata search failed
Replies: 4
Views: 13091

Indeed...they are used extensively for many functions and operations, especially now with the IA thin client. I am not an expert on IA, but I suspect that the issue you are having may be due to some latency in the index. This might not be the exact issues, but the re-indexing process may offer you s...
by eostic
Thu Sep 20, 2018 7:51 am
Forum:
Topic: automated external glossary publishing (with flare)
Replies: 6
Views: 4348

I happen to like XML, so I would probably research doing this via a stylesheet. I've only touched stylesheets lightly, but found it very easy to create attractive displays of xml content without too much difficulty or having to dive really deep (it is a very attractive way, for example, for those wh...
by eostic
Thu Aug 30, 2018 1:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical stage: Calling RESTful service with BASIC auth
Replies: 2
Views: 2822

...that output looks like a trace of some kind. Please describe what you are doing inside the REST Step, the options you chose, etc.

Ernie
by eostic
Thu Aug 16, 2018 4:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change of namespace in xml
Replies: 2
Views: 2614

Depending on the size of the document, one thought is to just pre-process it....put the entire xml document into a single longvarchar, and then pass it thru a Transformer and hit it with something like ereplace(), and zap all of the x123: namespace prefixes to q999: or similar scenario. ...basically...