Search found 16 matches
- Mon Aug 26, 2019 12:25 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to connect and read a SAS dataset in Datastage
- Replies: 1
- Views: 3173
- Fri Sep 07, 2018 8:23 am
- Forum: General
- Topic: Envisioning an ideal ETL environment
- Replies: 2
- Views: 2909
Envisioning an ideal ETL environment
Hi All, I have been tasked with evolving best practices, standards, design patterns for an "ideal/desirable" data integration environment. I have experience with Datastage, SSIS, Data Manager and other custom ETL tools in a variety of data warehousing environments. Until now I have come up...
- Tue Jan 24, 2017 2:44 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Unstructured Data Stage - X11 error
- Replies: 5
- Views: 8948
For some reason, a jar is being executed which is attempting to connect to a X server. You can diagnose this in a couple of ways - check to see if the DISPLAY environment variable is set in the shell that launches Datastage Director or Designer. Try running the job from the command line to see if th...
- Tue Jan 24, 2017 2:18 pm
- Forum: General
- Topic: istool command execution from non Client or Engine Tier.
- Replies: 2
- Views: 2874
I don't see why not. istool is one more of those eclipse based plugins/jars. If you review istool.sh and setupenv.sh which is called from istool.sh and replicate the same execution path, class/jar load path, you should be able to execute istool from just about anywhere. Make sure you copy all the ja...
- Fri Dec 16, 2016 2:05 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Automated/semi-automated generation of Datastage jobs
- Replies: 5
- Views: 5893
Thanks for the quick response and sharing your thoughts - I have noted your advice. I do have some additional questions for responders. What were the steps and tasks involved in generating job(s) without a template ? did you have specific DSX/XML code blocks for each stage type, the connecting links...
- Fri Dec 16, 2016 9:54 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Automated/semi-automated generation of Datastage jobs
- Replies: 5
- Views: 5893
Automated/semi-automated generation of Datastage jobs
Hello, I have been experimenting with automated generation of DSX jobs using templates. I have also found a lot of information on Dsexchange and other forums for parsing DSX files, templates, scripts etc., Most of these scripts, descriptions generally discuss DSX job automation/generation using pre-...
- Tue Nov 29, 2016 7:57 am
- Forum: General
- Topic: Anyone using Splunk to mine info from DataStage?
- Replies: 6
- Views: 5603
- Tue Nov 29, 2016 7:53 am
- Forum: Cognos (IBM BI)
- Topic: Automated analysis/migration of Cognos Data Manager jobs
- Replies: 3
- Views: 18488
The sql inside the DM job can be extracted by querying the Cognos DM catalog metadata database. And it can be automated as well. Once the Cognos DM job sql is extracted, you can insert that sql into a Datastage job template to create a Datastage job. The above will work for jobs that follow a format...
- Thu Nov 24, 2016 8:09 am
- Forum: Cognos (IBM BI)
- Topic: Migrate Cognos Decision stream and Data Manager to Datastage
- Replies: 2
- Views: 21487
Hi, I would like to let you know that I have attempted manual and automated migration of Cognos Data Manager 10.x jobs to Datastage 9/11 and have been successful in automating the same for simple jobs. I have not been able to use Cognos Data Manager Migration Assistant, however, was able to analyze ...
- Thu Nov 24, 2016 7:53 am
- Forum: Cognos (IBM BI)
- Topic: Automated analysis/migration of Cognos Data Manager jobs
- Replies: 3
- Views: 18488
Automated analysis/migration of Cognos Data Manager jobs
Hi All, Disclaimer: I am aware of Cognos Data Manager migration assistant that helps in the migration of Data Manager jobs to Datastage. For certain reasons we do not have access to this tool at our site. Also, the IBM Data Manager Migration assistant will only migrate jobs to Datastage and not to o...
- Wed Aug 24, 2016 12:22 pm
- Forum: General
- Topic: ETL Development standards, best practices, guidelines etc.,
- Replies: 6
- Views: 4741
- Sat Aug 20, 2016 8:39 am
- Forum: General
- Topic: ETL Development standards, best practices, guidelines etc.,
- Replies: 6
- Views: 4741
ETL Development standards, best practices, guidelines etc.,
Hello, I have been asked to take on the task of evolving ETL architecture, design and development standards specifically using Datastage and the Infosphere suite of tools. I have started gathering and reviewing documents, presentations searching the web. I look towards this group for suggestions, co...
- Wed Jul 13, 2016 12:11 pm
- Forum: General
- Topic: Calling DSAttachJob/DSDetachJob in a loop exits after first
- Replies: 5
- Views: 4389
No worries. Yes, I did verify that - after the call to DSRunjob, the job handle is unloaded and not available anymore. And hence the need for calling DSAttach before every invocation of DSRunJob. Some workarounds may be to use a subroutine, function and/or to store the names of the list returned fro...
- Tue Jul 12, 2016 10:37 am
- Forum: General
- Topic: Calling DSAttachJob/DSDetachJob in a loop exits after first
- Replies: 5
- Views: 4389
Re: Calling DSAttachJob/DSDetachJob in a loop exits after fi
Ok - I think I recall why I was doing DSAttach/DSDetach in a loop - every time DSRunjob is called, the handle obtained from DSAttach is "unloaded". Therefore, I am forced to re-attach inside the loop - leads me back to my original code and back to square one, I guess. As per the DS 9.x pro...
- Tue Jul 12, 2016 9:11 am
- Forum: General
- Topic: Calling DSAttachJob/DSDetachJob in a loop exits after first
- Replies: 5
- Views: 4389
Calling DSAttachJob/DSDetachJob in a loop exits after first
Thanks chulett. Since I set the job parameters based on the values obtained in the loop, I need to use setparam and hence attach. But your suggestion could be the right method - I can give it a try and see what happens. As well, I discovered the root cause of the loop termination after first DSAttac...