DSXchange

Hi, For DS to connect to SAS server, DS needs a "plugin" that acts as SAS client. Which does not exist, if I am not mistaken. However, if you have the SAS client software installed on the same host as the DS server, you can initiate a scripted telnet connection by editing the telnet "...

Hi All, I have been tasked with evolving best practices, standards, design patterns for an "ideal/desirable" data integration environment. I have experience with Datastage, SSIS, Data Manager and other custom ETL tools in a variety of data warehousing environments. Until now I have come up...

For some reason, a jar is being executed which is attempting to connect to a X server. You can diagnose this in a couple of ways - check to see if the DISPLAY environment variable is set in the shell that launches Datastage Director or Designer. Try running the job from the command line to see if th...

I don't see why not. istool is one more of those eclipse based plugins/jars. If you review istool.sh and setupenv.sh which is called from istool.sh and replicate the same execution path, class/jar load path, you should be able to execute istool from just about anywhere. Make sure you copy all the ja...

Thanks for the quick response and sharing your thoughts - I have noted your advice. I do have some additional questions for responders. What were the steps and tasks involved in generating job(s) without a template ? did you have specific DSX/XML code blocks for each stage type, the connecting links...

Hello, I have been experimenting with automated generation of DSX jobs using templates. I have also found a lot of information on Dsexchange and other forums for parsing DSX files, templates, scripts etc., Most of these scripts, descriptions generally discuss DSX job automation/generation using pre-...

Paul, skatha,
At our Datastage site, we are/have extracting required information from DS logs - however, we are not using splunk/ELK or other log parsers. We are using perl/awk and similar tools to do this.
Is there something specific that you are looking for ?

Thx

The sql inside the DM job can be extracted by querying the Cognos DM catalog metadata database. And it can be automated as well. Once the Cognos DM job sql is extracted, you can insert that sql into a Datastage job template to create a Datastage job. The above will work for jobs that follow a format...

Hi, I would like to let you know that I have attempted manual and automated migration of Cognos Data Manager 10.x jobs to Datastage 9/11 and have been successful in automating the same for simple jobs. I have not been able to use Cognos Data Manager Migration Assistant, however, was able to analyze ...

Hi All, Disclaimer: I am aware of Cognos Data Manager migration assistant that helps in the migration of Data Manager jobs to Datastage. For certain reasons we do not have access to this tool at our site. Also, the IBM Data Manager Migration assistant will only migrate jobs to Datastage and not to o...

Thanks everybody for pointing those links.
Yes, I have been reading up on lots of DS documentation, IBM Redbooks, general web searches and the like. Please do post if you think it is relevant.

Received some private messages as well.

Thanks

Hello, I have been asked to take on the task of evolving ETL architecture, design and development standards specifically using Datastage and the Infosphere suite of tools. I have started gathering and reviewing documents, presentations searching the web. I look towards this group for suggestions, co...

No worries. Yes, I did verify that - after the call to DSRunjob, the job handle is unloaded and not available anymore. And hence the need for calling DSAttach before every invocation of DSRunJob. Some workarounds may be to use a subroutine, function and/or to store the names of the list returned fro...

Ok - I think I recall why I was doing DSAttach/DSDetach in a loop - every time DSRunjob is called, the handle obtained from DSAttach is "unloaded". Therefore, I am forced to re-attach inside the loop - leads me back to my original code and back to square one, I guess. As per the DS 9.x pro...

Thanks chulett. Since I set the job parameters based on the values obtained in the loop, I need to use setparam and hence attach. But your suggestion could be the right method - I can give it a try and see what happens. As well, I discovered the root cause of the loop termination after first DSAttac...