DSXchange

I had also faced same issue . The design was seq file ---->transformer ---> join---> dataset. | Seq File . After some time of investing, we found that the data was getting leaked or truncated. A decimal (10) was mapped to decimal (6), resulting in a leak and leading to job hanging at join stage. we ...

Datastage works within nodes. Hence your surrogate key generator logic would work if either it is run one instance or the rows are equally distributed accross all the partitions. To generate , unique consecutive values in datastage a> we used to use transformer ( with partition number and number of ...

I would like to see following enhancements ( Not sure if they are already in place). a> Like in informatica, if we add some columns or change the existing the metadata in the preceding stages of the jobs. There should be option given to propagate the same changes in the subsequent stages. So that wh...

Are you using CFF stage or source/target schema with level numbers. If yes, then check the level numbers of the fields. They must be same. As indicated in the error, there seems a difference in the level number of columns lnk_ppsubject_history_to_join.HIST_ACTION_IN lnk_ppsubject_history_to_join.HIS...

I have been reading this forum for 4 years now. I am amazed by the depth of knowledge and enthusiasm of Ray. The dsxchange should be re-named as rayxchange.

I had faced the same issue some time back. Goto the director and in job meanu ,uncheck the log refresh rate ( normally this would be set to every 5 secs).

In our job we have source, join on 2 inputs and target. This job ran for 1 million records, but wen we tried for 5 million, it failed giving 'tsort --unable to write to the file....'. As a solution we inserted explicit sort stages before the input links to the join and re-executed the job. The job r...

I am not trying to prove or establish here( I have been working datastage for 4+years and I love it) . But these are some of the weird behaviours i cam across. Just need to know whether the implementation can be changed or the tool settings.

Hi , I have been observing some weird behaviors, can someone explain these for me. 1> I have 2 jobs a and b. In the job a 2 datasets are created partitioned on key x and sorted on key x and key y. (The relation between key x and Y is one to many and between Y and X is one to many. e.g branch and acc...

We have a requirement to write the data into 64 target files. The data is written into one of the 64 files based on value of a column. The target file is an ebcidic file. Same is the design for 6 of the jobs. These leads to bottleneck with most of the execution time involved in write operations. The...

Hi I am trying to capture the rejected records from the cff stage. The output of reject link is a sequential file. It is giving below warning record type = implicit cannot save rejected records. I have tried to use record type = implicit as well as the normal with quotes etc. But I am getting the sa...

Hi, I am generating a unique identifcation number (UID) in a transfomer. The job design like Dataset---->Sort ---> Transformer---> Target. I am sorting on columns A,B and generating keychange indicator. In the transformer,When the keychange indicator is 1 , the UID s incremented else the previous va...

Hi, We are reading the EBCDIC data thru the CFF stage. Following are the meta data definitions. 1> single fixed array. 2> Multiple fixed array with no ODO ( on depending columns clause) 3> Multiple fixed array with ODO ( on depending columns clause). We would like to generate a ouput which gives the...

We tried using the split vector. But its give compiatio error saying that the stage we cannot convert variable vector to fixed vector.

The orignal vecto was created by using make_subrecord stage.

Hi, Just want to understand the partitining concepts in PX. Ex. I have configuration files with 2 nodes . The source file is partitioned on custno. e,g custno are 1,2,3,4. So , datawise there are 4 partitions but only 2 logical nodes. 1> How will the data be allocated to the 2 logical nodes. 2> Also...