Does data need to be re-imported every time it changes?

This forum contains ProfileStage posts and now focuses at newer versions Infosphere Information Analyzer.

Moderators: chulett, rschirm

Post Reply
truenorth
Participant
Posts: 139
Joined: Mon Jan 18, 2010 4:59 pm
Location: San Antonio

Does data need to be re-imported every time it changes?

Post by truenorth »

I'm confused about how/when data is available to IA.

Initially data is imported into IA. Is that just a snapshot? When data changes at source, i.e., where it was imported from, does it have to be re-imported? Or is data always live after the initial import?

Thanks in advance.
Todd Ramirez
Sr Consultant, Data Quality
San Antonio TX
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

Initially metadata is imported into IA. After that you can run column analysis or other types of analysis on the actual data. The analysis results are stored and available for further review, like a snapshot.

If the source metadata (table structure) changes, my experience has been to import the new metadata and lose the previous analysis results. I'm sure someone knows of a better way.

As the source data itself changes, you may want to periodically submit IA tasks to run various types of analysis again, to measure if your data quality or anomaly issues are improving over time.
Choose a job you love, and you will never have to work a day in your life. - Confucius
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Data are never imported into IA. Only metadata.

Analysis results are stored in tables in the IA database (frequency distributions and the like) and in the metadata repository (XMETA), but never source data.

Analysis results typically would change given changed source data.

You can set baseline and checkpoints to monitor these changes over time, but it does involve running additional analyses.

If the data are coming from a different source, then your IA project may need to have that new source configured (as a Data Connection or as an ODBC data source).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
truenorth
Participant
Posts: 139
Joined: Mon Jan 18, 2010 4:59 pm
Location: San Antonio

Post by truenorth »

Thank you, all!
Todd Ramirez
Sr Consultant, Data Quality
San Antonio TX
Post Reply