DSXchange

One more note, i am hash partitioning on 'transactionId' and sorting on 'designation'

Fixed the problem with getting a field named 'transaction Id' which is common across both and doing a hash partition with this field. This filed was there in the input but was not getting propagated before.

Hi, I am doing some validation using transformer stage. At any point of time i will only have only two records. For example i am comparing gender from first and second record and have to check if they are same. I am using stage variables and doing a link sort on designation (which tells us if it is ...

In the sequential file stage you have to define text fileds enclosed in double/single quotes. As Ray pointed out there is some inconsistency in the data you provided. Once defined properly the ',' inside the quotes will not be an issue.

PD

Hi, I am creating a job to read and write xml through webservice and i need some suggestions regarding its design. 1. I recive a request from a web service with two records 'Primary' and 'Secondary' in XML format. 2. The Primary and Secondary have similar XML structure and same metadata, but there a...

you have to read the element 'customer' in the output and define it as the key along with the text fields from the element. It has worked for me. The input as you mentioned should be a 'FilePath' and read as single column.

Remember to give Xpath expressions correctly.

I resolved it by calling 'telexList' as input in step 5 and having output as ' telex' (also the key) element and other text fileds inside the telex element as text extracts.

Hi, I am working on an real-time (Online) job where i will recieve a XML file with some simple and some repeating elements. When the repeating elements are to be extracted using XML inputs i am not finding any output from this stage. For example here is my sample XML file: <Message xmlns:xsi="h...

Hi, I am devoloping a job that is run relaltime using Information service director which calls a datasatge job and has XML as input and output. In the job there is validation done on to the information i get through the XML stages, and i have to capture all the exceptions for the data validations in...

The partioning done on the input link of copy stage sorts the data on KEY 1 for each partitioning and i think when you say the data is sorted, I expect the sorted KEY1 data per partition. So affectively the sort order in dataset will be differnt from your source file.

Join the dataset with the table with which you have the referential integrity and drop/reject the records and send only the ones that satisfy the constraints. You can use three stages: 1. Join - You can do a inner join and drop the records or do a left outer join and capture the records in the Trans...

What you are doing is rght, define the last field as varchar and put the null value as ''. Also do not forget to define the record delimiter (Unix/Dos format) and final delimiter in the format.

Hi, As part of my prjoect i was to extract jobs from a dimensional model (oracle) and extract it as XML. Recently one of the jobs failed because a descriptive field encountered a substitute character. In the ASCII and Unicode character sets, this character is encoded by the number 26 (hex 1A). Now t...

The opening and closing of tags should be defined properly in XML path expressions that we state with each column in the XMLOutput stage. How did you define them?

Are you using a transformer to manually create the tags?

The transformer shoould be after join and as mentioned earlier in this post the fileds should be non nullable as the outer join substitutes the value it does not find with a null. After the join, in transformer use the NullToValue() function to substitute it as desired and update the fileds to Non-N...