DSXchange

I need to write a maintenance job to clean up operational metadata, but the cleanup script is on the services tier, while the jobs are running from engine tier. This is a windows installation, so the xmetaAdmin.bat script is the one I want to call. When i write a job to execute the command \\#Servic...

Thank you Craig
Yes, we are having performance issues with the load jobs and hence we are looking into every possible way to tune it. The whole process up until the last stage where insert happens breezes through and then insert takes anywhere between 2 mins to 11 mins randomly ..

Thank you Craig.

Our DBA has pointed me to these 50k inserts getting issued 1 by 1 and has asked me to see if there is a way to group them for better efficiencies, so it doesn't hit the database that many times.. is that something we can do with a bulk load?

Looking for some guidance on how we can set/use the transaction handling options in ODBC Connector (or other SQL Server stages) to get the best performance when inserting/updating data to SQL Server Database. For a job that inserts 50K rows for example, I have set the Array Size and Record Count as ...

Thank you Ray, not sure I totally understand what a Subscription Center is - is that some sort of monitoring service we have to subscribe to (with vendors or vendor products) or is that something we have in our IBM suite of tools.. thanks

yes, being able to text would be the perfect solution, then it is more efficient as we can only look when we get the text message instead of having to stare at either Director or email. If we have work phones and security was not an issue - as it is just notifications on success/failure of loads, is...

Yes, that was essentially what my option 2 in original email was - where email notifications are monitored, but this requires someone to keep monitoring those emails (for ABORTS or success notifications) instead of monitoring director. Is there a way to send other types of notifications like text al...

Wanted to see what options are out there in terms of Monitoring Loads. I have seen the following at various implementations - are there any others that are more efficient? 1) Job Scheduling tools - like Appworx that will send an alert if a job fails or is delayed 2) Monitoring Staff - watching the e...

This is more of an architecture question and am seeking different perspectives to see what the more popular choice is in various implementations. When a project has over 1500+ jobs and has data coming in from 5-10 sources all being transformed (together) to be loaded into an Enterprise Data warehous...

How can we retrieve the RT_LOG file name for a given job. There are jobs for a previously created project that do not have the AUTO-PURGE settings prior to development of those jobs. As these logs grow, there is a need to write a routine+job that can be invoked periodically to clean up or purge the ...

We have one procedure calling a few procs within it and we are executing this procedure using an ODBC stage and the goal of this job is that even if some procs within it execute with warnings (raised exceptions) we should have the job finish with warnings but not abort.. currently what is happening ...

Just for the benefit of folks that might have same issue, am posting the resolution i found that seemed to work for me, in the case of this particular error message. All I did was run this first: CREATE.FILE SDKSequences 2 1 1 And then wrote a job to read the tables and get the max values of keys an...

Thanks Craig, thats exactly how we used to do it when it was a static hash file. Now, not sure what the issue is, but I did not see the SDKSequences folder in DEV in the first place, second - when i click on routine, cannot TEST it, cannot insert new rows in the TEST window.. to click Run or Run All...

In V9.1, SDKSequences is not a file but a hash file (meaning it has a folder with OVER.30 and DATA.30 files) - how do we migrate this file across environments. For example when we have a production data refresh into development, then we will need to bring the SDKSequences from prod to dev as well. I...

Thank you Ray, is it possible to get a code snippet on how to do what you suggested - thanks in advance