DSXchange

Ok. So what you mean is - Archival is not in our control. So let us say job runs after 10 days, it is possible that some files would be in InputDir and some in ArchDir. Right? Also is the ArchDir a plain directory or it has date wise folders? The answers to these question would decide what logic we ...

Are you sure you have selected the lookup type as sparse? Because sparse lookup (I think) needs a condition in the where clause. As you said your SQL is: SELECT 1 as ID1, NEXTVAL FOR SEQ_NAME as NEXTVALUE FROM sysibm.sysdummy1 But then where is the SQL clause? And what is the key column used - ID1? ...

Assuming this is coming from a sequential file and " " (space) is delimiter between Id and the | delimited string, we can use the following script. cat FileName.txt | awk -F "|" ' { FirstCol=substr($1,1,index($1, " ")-1); print $1; for(i=2;i<=NF;i++) printf("%s %s\...

Can you tell us the query written in the Sparse and is the job generating any warning?

I may be wrong, but something like below might work. The message receiving service needs to call a DS WebService (RTI) job and send these jobs this message. In the DS job using ETL which could do lookups, extract data etc. This extracted data can be sent to calling job and it can be forwarded to mob...

You can do the following: 1. Using ls command on that directory create FileList.lst. This would tell you the files considered. 2. Then from this file list using xargs and cat, concatenate the files. 3. In the DS job read the concatenated file and process it. 4. Once whole processing is done, using t...

It might be the issue with relative directory. When running the comman, from which directory do you run it.

When calling from the DS, are you sending directory name along with the pattern? Add pwd command in the script and see what directory it prints.

I think you would have to use Len function in addition to normal validate function. We had same issue and we ended up adding len function as well.

Finally after trying a log of things I was able to get proper results and here are the things I did to fix it. I was able to make it work for both Curr_Ind and Expiry Date wise Type 2. The issue was the keys defined. Earlier I was matching eno, ename and address of Dimension table to the data from i...

Are you able to set the variable for combination and regenerate the error? If so, try adding Dump score to the logs by setting APT_DUMP_SCORE = true.

Then check the dump score and see which stages are causing this issue. I have seen this error when mapping column with nulls to stage vars.

Did you check the DS record count? Try using the $ORCHADMIN ll and check it. Also how was the DS created - using a job or $ORCHADMIN cp. Once I had used $ORCHADMIN cp and the newly created DS has a similar issue i.e. records read were less without any warning. There was some issue with char encoding...

Few years back we had a subset of this requirement and we ended up using the recursive stored procedure for that. What we did is created a chain of linked records. Step1: Actual data in a table called as "ChainRels" containing OldID, NewID Loop: Insert in the ChainRels outfrom query (selec...

What is the value for APT_STRING_PADCHAR in the env vairables?

I am writing to a dataset. And in that I do not see the row to be closed. I tried adding current indicator in addition to the ExpDate. But seems SCD stage allows only one of them to be used at a time.

Fast path1: Link for output is FactLink. Fast path2: Lookup page with keys as below: SurrKey (SurrogateKey) - with empty Key expression ENo (Buss Key) - Matched with Eno from SeqFile Ename (Non Key - Type 2) - Matched with Ename from SeqFile Address(Non Key - Type2) - Matched with Address from SeqFi...