Can profileStage help for this
-
- Premium Member
- Posts: 103
- Joined: Tue Oct 14, 2003 4:07 am
Can profileStage help for this
Can profilestage do following activities:
Extract Metadata from database
Create DDLs for the metadata sothat it can be created on other database
Profile source tables
Develop Extraction Queries
Anonimize data
Sramble data
Unscramble Data
Extract data from database
Load data into database
Thanks
Mukund
Extract Metadata from database
Create DDLs for the metadata sothat it can be created on other database
Profile source tables
Develop Extraction Queries
Anonimize data
Sramble data
Unscramble Data
Extract data from database
Load data into database
Thanks
Mukund
-
- Participant
- Posts: 30
- Joined: Mon May 29, 2006 11:19 pm
how to handle mainframe data landing in to unix
Hello
Any one can please tell me that how to handle mainframe data which is going to be landed on the unix
Any best practices ?
Thanks in Advance
Arshad
Any one can please tell me that how to handle mainframe data which is going to be landed on the unix
Any best practices ?
Thanks in Advance
Arshad
Mukund - How about doing a first stab at this yourself through looking at the IBM WebSpere ProfileStage pages and then post any remaining questions here? Most people will hesitate to answer such an encompassing list of questions at one go.
Arshad - Welcome to DSXchange. If you were to post your question in the correct forum and specify exactly what sort of mainframe data you wish to handle in DataStage you will certainly get some quick and informative responses; at least more than by posting the question to an unrelated thread in a forum which has a very different purpose.
Arshad - Welcome to DSXchange. If you were to post your question in the correct forum and specify exactly what sort of mainframe data you wish to handle in DataStage you will certainly get some quick and informative responses; at least more than by posting the question to an unrelated thread in a forum which has a very different purpose.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
Re: Can profileStage help for this
Hi,
ProfileStage (PS) can:
Profile your source tables.
Provide a normalized scheme for a target DB based on the table/column analisys you run.
Prepare DS export files you can load to DS (DataStage) that will transfer your data from the old sources to the new ones (even with some transformation in it).
IHTH,
ProfileStage (PS) can:
Profile your source tables.
Provide a normalized scheme for a target DB based on the table/column analisys you run.
Prepare DS export files you can load to DS (DataStage) that will transfer your data from the old sources to the new ones (even with some transformation in it).
IHTH,
MukundShastri wrote:Can profilestage do following activities:
Extract Metadata from database
Create DDLs for the metadata sothat it can be created on other database
Profile source tables
Develop Extraction Queries
Anonimize data
Sramble data
Unscramble Data
Extract data from database
Load data into database
Thanks
Mukund
Roy R.
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
-
- Premium Member
- Posts: 103
- Joined: Tue Oct 14, 2003 4:07 am
-
- Premium Member
- Posts: 103
- Joined: Tue Oct 14, 2003 4:07 am
PS is not an ETL tool.
It simply does what I mentioned.
The whole point of the jobs is loading the entire data.
Bare in mind that PS will only generate a dsx file which you need to import into a DS project and run it on a DS (DataStage) server if you have one.
So any runs that uses the limit option of n rows would load partial data.
IHTH,
It simply does what I mentioned.
The whole point of the jobs is loading the entire data.
Bare in mind that PS will only generate a dsx file which you need to import into a DS project and run it on a DS (DataStage) server if you have one.
So any runs that uses the limit option of n rows would load partial data.
IHTH,
Roy R.
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
-
- Premium Member
- Posts: 103
- Joined: Tue Oct 14, 2003 4:07 am
As I understand from one of the tutorials on profileStage - "it analyzes the source data and provides recommendations for the target database such as primary keys , foreign keys "
When it can understand which are primary key and forein key tables , why can't it provide a layout of order in which the ETL jobs are to be run by providing the sequencer.
Pl keep in mind I am referring to .dsx file only produced by profilestage. I understand that the .dsx produced by profileStage will be run by DataStage and not by ProfileStage.
When it can understand which are primary key and forein key tables , why can't it provide a layout of order in which the ETL jobs are to be run by providing the sequencer.
Pl keep in mind I am referring to .dsx file only produced by profilestage. I understand that the .dsx produced by profileStage will be run by DataStage and not by ProfileStage.
I don't recall if it supports sequence jobs at this time, if not you can always log an enhancement request.
Roy R.
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
ProfileStage is about telling you what's there (profiling), not what to do with it.
You go through a systematic series of analyses:
Based on the results of these analyses a more efficient layout for the original data may be possible. ProfileStage can generate a migration specification (source-to-target mapping). Based on that it can generate DDL for creating the objects in that new database design and ETL jobs (in DSX format) for moving from the old layout to the new. There are no constraints in the ETL jobs, but you could add them in after importing them into DataStage.
It also produces reports of its analyses and specifications, using Crystal Reports.
But that's all that ProfileStage does.
You go through a systematic series of analyses:
- column analysis to determine the type and nature of data in each individual column (for example domain of values, proportion of nulls, etc) using the entire table (a sample can be extracted for later analyses)
table analysis to determine whether there are any relationships between columns within the same table (that is has 2NF or 3NF been achieved?)
cross table analysis to look for FK relationships whether defined or not
Based on the results of these analyses a more efficient layout for the original data may be possible. ProfileStage can generate a migration specification (source-to-target mapping). Based on that it can generate DDL for creating the objects in that new database design and ETL jobs (in DSX format) for moving from the old layout to the new. There are no constraints in the ETL jobs, but you could add them in after importing them into DataStage.
It also produces reports of its analyses and specifications, using Crystal Reports.
But that's all that ProfileStage does.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.