DSXchange

If I have an N element loop = say N =14, has anyone tried running 4 loop iterations at a time simultaneously by explicitly coding ( designing ) the Loop activities that way ? If one of the 4 instances breaks- say file not found, will restarting the job sequence kick off all 4 simultaneous iterations...

What was the operating system you compiled on ? Linux ? Otherwise g++ is NOT the optimizing compiler for your platform for datastage parallel transformer. what is the default value of APT_COMPILER on your environment? for HP-UX -> use aC++ compiler for IBM-AIX -> use xlC/C++ compiler for Solaris -> ...

Can you select one column at a time in a union all statement , along with the tables current rowid and an integer representing column position ? Thenc sort them by rowid and column position? Could be faster than using any datastage operator.

I think reading such a file in Datastage must be easier than creating it. But we have generated pretty complex DTCC PVF File and IFT File using a pure datastage approach by designing a tricky sort algorithm, and we may be set out to do the even more complex FAR file for DTCC - all using server jobs....

Are you trying to use it as a source or transform ? Are you using teh stored proc stage to process dat aon an input link and forward row data to an output link ? Just curious.

Can you try external Source stage- I think thats the best bet ? Did you try Decode stage - Although i think it woks on decoding compressed datasets, not sure about files.

Example syntax for orchdbutil in case you need it orchdbutil show owner.table_name -dbtype oracle -server Oracledb -dboptions {user=usr,password=***} This will give you an orchestrate schema, which is handy ( actually its a parallel job table def ) Which version of datastage are you on ? IBM is alre...

write to /dev/null and in the filter command use sh -c "your big unix com mand" . Im assuming you write to a server job seq file stage. By the way did you escape the date command in backquote character ` ` ? If you are using a filter stage in a parallel job , the moderator has to move your...

External source stage, call: grep -c ^D #srcfile# This shoudl give zero if zero detail records Similarly grep -c ^H and grep -c^T for your file, these will give you counts of headers and trailers into your jobs data stream - use a funnel to combine these streams ( There could be a creative way in un...

Have you imported the copy book Successfully ? Then open table def , and go to layout , select the parallel radio button , and see what datatype it defines to that column. Use this in your schema file or in the sequential file's columns tab . so that you dont have to write a transfomer derivation un...

very obvious error. Where is the object file stored for your custom px routine ? Is it part of the PATH env variable seen in the environment settings message of the job log?

Im new to JSON , but does transmitting simple payloads over JSON save bandwidth & 'space' compared XML carrying the same info ? A cursory look suggests that. JSON outwardly seems eerily familiar with orchestrate subrecords and vectors [ probably the tagged type]

Maybe force all surrogate key generators to use user picked , and have an environment variable to set this property - requires 'discipline' though

Is this possible using Websphere TX ? There is another group that has license for WTX ? Do Type trees allow defining such aa structure. The WTX pack for acord would have ready type trees for these files.

I understand that WTX can write to xml , but what about such hierarchical flat files?

Thanks . Although we implemented a simpler version of this format in Datastage by combining record types and sorting by policy number, recordType+internalLoopKey[ artificially created ina transformer stage var] and some stable sorts, it seems way too much of a PITA to do in DS Server edition . We ha...