DSXchange

Hi, I have attributes phone number which will have multiple values stored. I need to run the job in AttrComp mode using MDM connector to upsert all the values coming from the source. However, for each value value is passed by the connector in a single interaction and only one value is getting update...

Hi,

I am trying to match a key between 2 source systems but I do not want the key to be matched within same source system. Is there a direct method of implementing this? The version I am using is 11.0

Hi All, I was looking for persistent sequence number generation algorithm. meaning, when a character value is passed a corresponding number sequence needs to be generated and it should always return the same value for the same text string and different values for different characters. I could use su...

Hi All, does any one know how to identify all the parameters used across multiple jobs and parameters? one way I can think of is to export the jobs in a dsx and extract the parameters using a script. but not sure how to identify the parameters that have been used within the jobs not just defined in ...

Thanks Ray!!

Any advice to handle the data restructuring points like rows spreading out of transformer, aggreation's or pivots?

Hi, I was looking for an existing script or a job that would back track and find out which job has dropped the record. it gets bit too laborious as there are far too many jobs to be verified manually. what we have to check is the number of rows read, and the number of rows written to the output shou...

Indeed, db's do have very significant roles in the performances. it could be either when reading the data or writing the data. you could check the indexes and constraints to see how it is performing with or without them. Also, you could try writing the data to a dataset and verify if that improves a...

is the table indexed on ITEM_TYPE AND ITEM_NO ? What type of index is defined? have you tried other options like merge query which will be executed completely on DB. something like this MERGE INTO LA.ITEM_T LAT USING DUAL ON ( ITEM_TYPE=:ITEM_TYPE AND ITEM_NO=:ITEM_NO ) WHEN MATCHED THEN UPDATE SET ...

if it is wrong partition then lookup would also fail as both the input links are explicitly partitioned. which is not the case. So, I think its better to raise PMR to ask this question.

Anyway, thank you all for your responses

the quickest way would be to use datastage to do this task. However, there is option like dd to convert the ebcidic file to ascii, this does not convert compressed or comp fields. so, the best way is to write a c or cobol program that converts byte by byte. alternatively, if you have perl and know h...

All, I can think of is the resouces faltering. not sure what is causing this though.

I have done that through orchadmin. the number of records displayed while writing to ds and reading from one of the job is tallying and another job is reading fewer records than the total counts

Yes, James I am aware of all the 3 possibilities. strangely when I replace the join with lookup it works fine. and second thing in that environment is when I try to read the dataset from one job it reads fewer records than the dataset actually holding. and with another job it reads the right number ...

Well, when I am running in single node config it's still producing the same results. I have verified the data byte to byte and it is matching. one more issue I could see when I am reading a dataset from the same job it reads around 4 million records only when I remove the other stages and just try t...

This is happening due to the oracle connector stage that I am using. when I join the data from oracle connector & dataset it fails for most of the records as I have described earlier. when I do the same with a dataset in both the input links it works fine. so, not sure what is not right with ora...