DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
antpetre
Participant



Joined: 17 Oct 2016
Posts: 2

Points: 19

Post Posted: Mon Oct 17, 2016 11:27 am Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi,

I would like to know if there is a way to link a published "Data Rule Definition" in a "Data Rule Stage" dynamically.

My use case is that we have few rule definitions that are reused across various jobs and data rule stages, it would be useful if changes to the definition would be reflected across the different jobs.

Alternatively it would be ok to use a Data Rule defintion inside another one.

thank you very much,
Antonio
vmcburney

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup

Joined: 23 Jan 2003
Posts: 3586
Location: Australia, Melbourne
Points: 28048

Post Posted: Mon Oct 17, 2016 8:32 pm Reply with quote    Back to top    

I don't think that the Data Rules Stage or the Exceptions Stage in DataStage can be configured to be dynamic - they cannot make use of column propagation or automation of rules based on the metadata of what is fed in. Both stages need design time import and definition of column metadata.

There is a level of automation via Information Analyzer and Data Classes where data profiling gives you automated data quality metrics of data against Data Classes. You can set up Data Classes to have valid value lists or Regular Expression checks. When you open up the dataset in IA thin client you will see how well it conforms to Data Classes and can spot non-compliant data.

_________________
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn: Vincent McBurney LinkedIn
Rate this response:  
truenorth
Participant



Joined: 18 Jan 2010
Posts: 121
Location: San Antonio
Points: 819

Post Posted: Fri Jul 21, 2017 1:57 pm Reply with quote    Back to top    

Rule definitions are dynamic only within IA. Published definitions that you use in DataStage are not.

_________________
Todd Ramirez
Sr Consultant, Data Quality
San Antonio TX
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours