Reuse data rule definition in Datastage jobs

This forum contains ProfileStage posts and now focuses at newer versions Infosphere Information Analyzer.

Moderators: chulett, rschirm

Post Reply
antpetre
Participant
Posts: 2
Joined: Mon Oct 17, 2016 11:20 am

Reuse data rule definition in Datastage jobs

Post by antpetre »

Hi,

I would like to know if there is a way to link a published "Data Rule Definition" in a "Data Rule Stage" dynamically.

My use case is that we have few rule definitions that are reused across various jobs and data rule stages, it would be useful if changes to the definition would be reflected across the different jobs.

Alternatively it would be ok to use a Data Rule defintion inside another one.

thank you very much,
Antonio
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

I don't think that the Data Rules Stage or the Exceptions Stage in DataStage can be configured to be dynamic - they cannot make use of column propagation or automation of rules based on the metadata of what is fed in. Both stages need design time import and definition of column metadata.

There is a level of automation via Information Analyzer and Data Classes where data profiling gives you automated data quality metrics of data against Data Classes. You can set up Data Classes to have valid value lists or Regular Expression checks. When you open up the dataset in IA thin client you will see how well it conforms to Data Classes and can spot non-compliant data.
truenorth
Participant
Posts: 139
Joined: Mon Jan 18, 2010 4:59 pm
Location: San Antonio

Post by truenorth »

Rule definitions are dynamic only within IA. Published definitions that you use in DataStage are not.
Todd Ramirez
Sr Consultant, Data Quality
San Antonio TX
Post Reply