Search found 199 matches
- Sun Jun 03, 2018 4:43 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How can we call xmetaAdmin.bat from a datastage job
- Replies: 1
- Views: 2420
How can we call xmetaAdmin.bat from a datastage job
I need to write a maintenance job to clean up operational metadata, but the cleanup script is on the services tier, while the jobs are running from engine tier. This is a windows installation, so the xmetaAdmin.bat script is the one I want to call. When i write a job to execute the command \\#Servic...
- Fri May 11, 2018 11:57 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Array Size, Record Count, Commit Frequency, Bulk Insert
- Replies: 8
- Views: 10542
- Wed May 09, 2018 12:07 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Array Size, Record Count, Commit Frequency, Bulk Insert
- Replies: 8
- Views: 10542
- Wed May 09, 2018 11:54 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Array Size, Record Count, Commit Frequency, Bulk Insert
- Replies: 8
- Views: 10542
Array Size, Record Count, Commit Frequency, Bulk Insert
Looking for some guidance on how we can set/use the transaction handling options in ODBC Connector (or other SQL Server stages) to get the best performance when inserting/updating data to SQL Server Database. For a job that inserts 50K rows for example, I have set the Array Size and Record Count as ...
- Fri Mar 02, 2018 10:22 am
- Forum: General
- Topic: Monitoring ETL Loads
- Replies: 11
- Views: 4535
- Thu Mar 01, 2018 3:40 pm
- Forum: General
- Topic: Monitoring ETL Loads
- Replies: 11
- Views: 4535
yes, being able to text would be the perfect solution, then it is more efficient as we can only look when we get the text message instead of having to stare at either Director or email. If we have work phones and security was not an issue - as it is just notifications on success/failure of loads, is...
- Wed Feb 28, 2018 6:03 pm
- Forum: General
- Topic: Monitoring ETL Loads
- Replies: 11
- Views: 4535
Yes, that was essentially what my option 2 in original email was - where email notifications are monitored, but this requires someone to keep monitoring those emails (for ABORTS or success notifications) instead of monitoring director. Is there a way to send other types of notifications like text al...
- Tue Feb 27, 2018 1:09 pm
- Forum: General
- Topic: Monitoring ETL Loads
- Replies: 11
- Views: 4535
Monitoring ETL Loads
Wanted to see what options are out there in terms of Monitoring Loads. I have seen the following at various implementations - are there any others that are more efficient? 1) Job Scheduling tools - like Appworx that will send an alert if a job fails or is delayed 2) Monitoring Staff - watching the e...
- Thu Jan 14, 2016 8:33 pm
- Forum: General
- Topic: Datastage jobs folder organization
- Replies: 4
- Views: 2937
Datastage jobs folder organization
This is more of an architecture question and am seeking different perspectives to see what the more popular choice is in various implementations. When a project has over 1500+ jobs and has data coming in from 5-10 sources all being transformed (together) to be loaded into an Enterprise Data warehous...
- Wed Jul 08, 2015 9:17 am
- Forum: General
- Topic: How to retrieve the RT_LOG file name for a given job
- Replies: 3
- Views: 3129
How to retrieve the RT_LOG file name for a given job
How can we retrieve the RT_LOG file name for a given job. There are jobs for a previously created project that do not have the AUTO-PURGE settings prior to development of those jobs. As these logs grow, there is a need to write a routine+job that can be invoked periodically to clean up or purge the ...
- Fri May 08, 2015 6:41 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Procedure calls using ODBC stage
- Replies: 0
- Views: 3916
Procedure calls using ODBC stage
We have one procedure calling a few procs within it and we are executing this procedure using an ODBC stage and the goal of this job is that even if some procs within it execute with warnings (raised exceptions) we should have the job finish with warnings but not abort.. currently what is happening ...
- Thu Oct 09, 2014 10:41 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Migrating 9.1 SDKSequences between environments
- Replies: 3
- Views: 4542
Just for the benefit of folks that might have same issue, am posting the resolution i found that seemed to work for me, in the case of this particular error message. All I did was run this first: CREATE.FILE SDKSequences 2 1 1 And then wrote a job to read the tables and get the max values of keys an...
- Thu Oct 09, 2014 9:59 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Migrating 9.1 SDKSequences between environments
- Replies: 3
- Views: 4542
Thanks Craig, thats exactly how we used to do it when it was a static hash file. Now, not sure what the issue is, but I did not see the SDKSequences folder in DEV in the first place, second - when i click on routine, cannot TEST it, cannot insert new rows in the TEST window.. to click Run or Run All...
- Thu Oct 09, 2014 7:37 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Migrating 9.1 SDKSequences between environments
- Replies: 3
- Views: 4542
Migrating 9.1 SDKSequences between environments
In V9.1, SDKSequences is not a file but a hash file (meaning it has a folder with OVER.30 and DATA.30 files) - how do we migrate this file across environments. For example when we have a production data refresh into development, then we will need to bring the SDKSequences from prod to dev as well. I...
- Tue Oct 08, 2013 10:04 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: KeyMgtGetNextValue returning duplicate surrogate keys
- Replies: 12
- Views: 8302