DSXchange

As part of my recent development work with version 8.1 , I found following issues in Datastage: 1. The XML stages (Input, Output) does not understand the date 0001-01-01(yyyy-mm-dd). If the elements in the XSD for XML are defined as date and the data type for the corresponding elements in the stages...

Try this:

If NullToEmpty(DSLink18.copysno)='' Then 1 Else DSLink18.copysno

This should work.

You can use a external source stage as specified by Ernie in his blog or do the same thing using a wrapper stage (custom stage) and do a 'ls' to get the xml file and in the input tab of XMLInput stage select the source as 'URL/Path'. If the name of file remains same then you can also have a transfor...

You can use performance analysis function in the job. It creates the reports with memory and cpu utilization for all the stages involved in the job. You can also include environment variables 'APT_PM_PLAYER_TIMING' and 'APT_PM_PLAYER_MEMORY' in your job and view the log to debug the operators/stages.

Thanks Craig. Yes, it works when it is created non-formatted. But since it creates the XML in a single line how do we format it after validation. Earlier in a batch job i used xmlint -format or xmlint -recover to expand the XML as formatted but since this is a online job can we use a c++ routine tha...

Hi, I am working on a job that creates XML output which will be sent to a web service. The XML is a complex structure with many repeating elements, so i used multiple XML output stages to first create the Repeating element chunks and then combine then together through a join to create my Response XM...

If there are multiple files with same metadata and similar name format, use 'file pattern' as reading method.

As it is a CSV file the delimiter should be ','. Please check if the double quotes you mentioned are only for text fields, if they bare then the property for this should be selected. Please make sure to add Record or Final delimiters properly. The files in general can sometimes have a Unix or Dos fo...

Be more specific with your question. What database it is? Which stage are you using? What table are you loading to i.e what constraints and indexes does it have? what method are you using to load i.e bulk load or other etc...

In v.8.1 XML validation is done at XML input stage. We can specify it as strict validation which means it will look for all enumeration values for fields, as well as any unknown elements. The XSD's location should be specified in the XML header as well as in the 'Namespace declaration' tab in XML in...

Is the element a repeating one? If not it can be easily done in transformer stage. All you have to do is use index function to get the positions start and end of tags and use sub string function to remove that from XML. But remember to define the updated filed as XML.

If my input is from a database , where i have to convert multiple rows to columns i can extract all of then in a single row by a sql query and use a transformer with substring or a column import with a schema file defined.

Because the number of records written are high i would use two different stages to do insert and update. Instead of insert you can aslo do bulk load which will save some time. Also how are you dealing with indexes on the table?

Denormalize the paramete sets, for example we use one set for all unix paths, one for oracle connections, one for the tables etc.. It is easier to maintain, and as you might have known that when the parameter set gets updated the jobs that use it have to be recompiled, it beomes easier to maintain w...

Use the transformer stage and stage variables with the help of substring function to do it.