DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 3709 matches
Author Message
Resolved
 Topic: Datastage XML input stage question
eostic

Replies: 4
Views: 92

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Oct 19, 2017 11:25 am   Subject: Datastage XML input stage question
As Andy notes, the Hierarchical stage can do some nice things.....but beware! It cannot handle parents with no children, when both are on the same link.
xmlInput handles this fine, with unchecking ...
 Topic: Increase IGC Term Short Description limit
eostic

Replies: 3
Views: 124

PostForum: MetaData and IBM MetaData Workbench   Posted: Tue Oct 10, 2017 10:31 am   Subject: Increase IGC Term Short Description limit
No. The 255 for short description is a fixed length.

Ernie
Resolved
 Topic: Sentbox vs Outbox?
eostic

Replies: 1
Views: 73

PostForum: Site/Forum   Posted: Fri Oct 06, 2017 4:16 am   Subject: Sentbox vs Outbox?
Does anyone know the difference between these two things in the "messages" area of the site? I don't use it often, but noticed that there are bunches of messages in the Outbox....... (which haven't b ...
Resolved
 Topic: XML Error Handling on incomplete file
eostic

Replies: 11
Views: 394

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 02, 2017 3:56 pm   Subject: XML Error Handling on incomplete file
Yeah...it's actually a pretty cool feature. You don't even need to bother with an xsd or formal validation....not-well-formed will kick out most of the time. I like to choose the reject option, and ...
Resolved
 Topic: XML Error Handling on incomplete file
eostic

Replies: 11
Views: 394

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 02, 2017 11:26 am   Subject: XML Error Handling on incomplete file
I am surprised that xmlInput isn't able to capture a missing end tag....it may depend on your particular document and location of the tag.....?

Ernie
Resolved
 Topic: XML Error Handling on incomplete file
eostic

Replies: 11
Views: 394

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 02, 2017 4:12 am   Subject: XML Error Handling on incomplete file
In my experience, the xmlInput Stage will check for well-formed-ness successfully with its various options for validation and and reject...including missing end tags and such. It may depend on the ...
 Topic: XML generation Issue
eostic

Replies: 12
Views: 465

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Sep 28, 2017 10:05 pm   Subject: XML generation Issue
Build it like this:

Oracle.....Transformer (if needed for any kind of tranform).....xmlOutput......Sequential

On the input link of xmlOutout, out your xml specificatuons in the description prope ...
 Topic: XML generation Issue
eostic

Replies: 12
Views: 465

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Sep 27, 2017 2:10 pm   Subject: XML generation Issue
Craig is correct, regarding xmlOutput.......but there is a different problem.....

You might choose Oracle Connector...to xml (hoerarchical if in a newer release)...

OR.....

Oracle to xmlOutpu ...
 Topic: XML or JSON Data as input
eostic

Replies: 4
Views: 237

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Sep 26, 2017 3:55 am   Subject: XML or JSON Data as input
Just ask them directly.... JSON or XML, in the end, is just "text" data...a chunk of it in a purposely formatted structure that makes it easy for the software to process or for humans to read.

It m ...
Resolved
 Topic: IGC Run DataLineage Automatically
eostic

Replies: 4
Views: 324

PostForum: MetaData and IBM MetaData Workbench   Posted: Wed Sep 20, 2017 3:59 am   Subject: IGC Run DataLineage Automatically
Hi.

I haven't had a chance to work with this call using curl. I'm not "exactly" sure whether it is possible, but I don't know all the options and details that curl provides. I suspect that th ...
 Topic: IA data rule to check for valid XML
eostic

Replies: 6
Views: 229

PostForum: Information Analyzer (formerly ProfileStage)   Posted: Tue Sep 19, 2017 6:20 am   Subject: IA data rule to check for valid XML
One very important key here is to know in advance what you are looking for in terms of validation?

You mentioned that there is no xsd..... formal xml "validation" means determining if a document m ...
 Topic: IA data rule to check for valid XML
eostic

Replies: 6
Views: 229

PostForum: Information Analyzer (formerly ProfileStage)   Posted: Mon Sep 18, 2017 3:26 pm   Subject: IA data rule to check for valid XML
I would also prefer not to use java if I can avoid it.

You may be successful with the xmlInput stage. It doesnt need an xsd, and performs a well formed xerces based check when getting started. ...
 Topic: IA data rule to check for valid XML
eostic

Replies: 6
Views: 229

PostForum: Information Analyzer (formerly ProfileStage)   Posted: Sat Sep 16, 2017 11:03 am   Subject: IA data rule to check for valid XML
Theoretically.....in java? Assuming you can invoke either a well formed checker or a schema validator.

....or else use a ds job itself with an exceptions stage downstream from a hierarchical s ...
 Topic: Calling job from Java
eostic

Replies: 6
Views: 270

PostForum: General   Posted: Thu Sep 14, 2017 11:29 am   Subject: Calling job from Java
Adding to Paul's thoughts, using ISD is a super elegant way to do it.......but requires ISD, as you noted.......dsjob command line is a no brainer too, if your java folks are ok with calling out to th ...
 Topic: Datastage vs. Alteryx: Comparative Pros & Cons
eostic

Replies: 8
Views: 370

PostForum: General   Posted: Thu Sep 07, 2017 11:15 am   Subject: Datastage vs. Alteryx: Comparative Pros & Cons
...or an ability to be deployed as a web service?
...parse and write XML?
...parse and write JSON?
...perform partitioning for massive data volumes?
...run directly on hadoop, under full control o ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours