DSXchange

Never mind -- I answered my own question .. it's because I was reading from file pattern and not a single file.

I need to change the job, because we are reading a single file, not multiple

Hi, I have a job that reads from a sequential file, and then links to a transformer and does several other things after that. This job was written by someone else, and I am trying to tune it. The job reads from a fixed width file - about 130 GB in size. I am trying to see if I can improve performanc...

Can you be more specific, please? Post the error and let us know when you get it - editing the design, when you compile it, at runtime? I get the error when editing the design in the transformer stage - i.e. the transformation is "red", which in this case, means it does not recognize the ...

OK .. thank you for responding.

Does it need to be enabled at the project or the job level?

If project, then I will check with the admins to see whether this is enabled.
I tried researching ways to figure this out myself, but did not find any information.

Thank you

I get an error when I try to use the UniChar function in the transformer. Is there some additional component that I need to install?

how do I post code? I don't see an option to attach a dsx file, or for adding screenshots. I can upload a sample job with sample input and output files.

What "code below"? If it's something from the linked topic, I'd suggest you include your actual code here instead. Hi Craig .. thank you for responding. I meant the "link below" http://www.dsxchange.com/viewtopic.php?p=464130 I will try the uchar suggestion and update this post ...

Hi all, I am trying to remove the NEL character (Next Line - U+0085) from an input data set. I have successfully implemented the code below to remove other non-printable etc. characters from my input data. However, this does not address NEL, which remains on the output file. Does anyone know how to ...

Thank you for all the excellent answers - we are pretty far gone down our development path, so hard to turn back and add another job to the flow.

For now, I think the filter is our best option.

But the other options are good to know for future reference

Thank you for your response, Thomas. Yes, we are using an awk filter at this time as a work-around. sed would work just as well. The trouble is that awk drops some of our records because of non-printable characters, which we would much rather handle further upstream. This is why I was looking for so...

Thank you, Craig .. yes, we will reach out to IBM to see what they say. In the mean time, we are using a filter.

Hi, We have a job that reads a flat file, and loads it to a target using RCP. The sequential file stage reads a schema file to determine the layout. Some files may have headers, some may not. I do not seen an option to set this at run time in the sequential file stage. The value setting for "Fi...