DSXchange

Hi All,

I have below requirement.Please help me how to resolve?

Picking the columns dynamically from sequential file and masking the data.

Example:

File contains 20 columns out of these 20 columns i need to mask the data for the columns 4,7,13,19. Next run same file contains 50 columns out of these 50 columns i need to mask the data 22,31,44.

Thanks for your advanced help :D

What have you tried so far? Where are you getting stuck?

Who comes up with systems like this?

"Let's send them a file where the columns can change daily and ask them to 'dynamically' mask a subset of those columns." <snickers>

"Brilliant!"

Out of curiosity, do you have the toolset you need to do the "masking"?

You can dynamically read the file using a Schema File and Runtime Column Propagation.

The dynamic masking is rather trickier. For starters, what you do you actually mean by "masking"? Essentially I'd try splitting the data stream into two, one containing just the columns to be masked and the other containing the other columns. Possibly use parameterised Modify stages for this logic. Then all you are left with is to figure out how to mask all the columns in the first stream, before re-uniting them with a Funnel stage.

I put the word masking in quotes for basically the same reason, wondering what exactly it meant here. We've had several conversations over the years here when people were mixing it up with other techniques like redaction and even encryption at times.