DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 16 matches
Author Message
 Topic: How to connect and read a SAS dataset in Datastage
anamika

Replies: 1
Views: 914

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Aug 26, 2019 12:25 pm   Subject: How to connect and read a SAS dataset in Datastage
Hi,
For DS to connect to SAS server, DS needs a "plugin" that acts as SAS client. Which does not exist, if I am not mistaken.
However, if you have the SAS client software installed on the same hos ...
 Topic: Envisioning an ideal ETL environment
anamika

Replies: 2
Views: 792

PostForum: General   Posted: Fri Sep 07, 2018 8:23 am   Subject: Envisioning an ideal ETL environment
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi All,
I have been tasked with evolving best practices, standards, design patterns for an "ideal/desirable" data integration environment.
I have experience with Datastage, SSIS, Data Manager and ...
 Topic: Unstructured Data Stage - X11 error
anamika

Replies: 5
Views: 5145

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Jan 24, 2017 2:44 pm   Subject: Unstructured Data Stage - X11 error
For some reason, a jar is being executed which is attempting to connect to a X server. You can diagnose this in a couple of ways - check to see if the DISPLAY environment variable is set in the shell ...
 Topic: istool command execution from non Client or Engine Tier.
anamika

Replies: 2
Views: 1461

PostForum: General   Posted: Tue Jan 24, 2017 2:18 pm   Subject: istool command execution from non Client or Engine Tier.
I don't see why not. istool is one more of those eclipse based plugins/jars.
If you review istool.sh and setupenv.sh which is called from istool.sh and replicate the same execution path, class/jar lo ...
 Topic: Automated/semi-automated generation of Datastage jobs
anamika

Replies: 5
Views: 3931

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Dec 16, 2016 2:05 pm   Subject: Automated/semi-automated generation of Datastage jobs
Thanks for the quick response and sharing your thoughts - I have noted your advice. I do have some additional questions for responders.
What were the steps and tasks involved in generating job(s) wit ...
 Topic: Automated/semi-automated generation of Datastage jobs
anamika

Replies: 5
Views: 3931

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Dec 16, 2016 9:54 am   Subject: Automated/semi-automated generation of Datastage jobs
DataStage® Release: 9x
Job Type: Parallel
OS: Windows
Hello,
I have been experimenting with automated generation of DSX jobs using templates. I have also found a lot of information on Dsexchange and other forums for parsing DSX files, templates, scr ...
 Topic: Anyone using Splunk to mine info from DataStage?
anamika

Replies: 6
Views: 3403

PostForum: General   Posted: Tue Nov 29, 2016 7:57 am   Subject: Anyone using Splunk to mine info from DataStage?
Paul, skatha,
At our Datastage site, we are/have extracting required information from DS logs - however, we are not using splunk/ELK or other log parsers. We are using perl/awk and similar tools to d ...
 Topic: Automated analysis/migration of Cognos Data Manager jobs
anamika

Replies: 3
Views: 5971

PostForum: Cognos (IBM BI)   Posted: Tue Nov 29, 2016 7:53 am   Subject: Automated analysis/migration of Cognos Data Manager jobs
The sql inside the DM job can be extracted by querying the Cognos DM catalog metadata database. And it can be automated as well.
Once the Cognos DM job sql is extracted, you can insert that sql into ...
 Topic: Migrate Cognos Decision stream and Data Manager to Datastage
anamika

Replies: 2
Views: 10107

PostForum: Cognos (IBM BI)   Posted: Thu Nov 24, 2016 8:09 am   Subject: Migrate Cognos Decision stream and Data Manager to Datastage
Hi,
I would like to let you know that I have attempted manual and automated migration of Cognos Data Manager 10.x jobs to Datastage 9/11 and have been successful in automating the same for simple ...
 Topic: Automated analysis/migration of Cognos Data Manager jobs
anamika

Replies: 3
Views: 5971

PostForum: Cognos (IBM BI)   Posted: Thu Nov 24, 2016 7:53 am   Subject: Automated analysis/migration of Cognos Data Manager jobs
DataStage® Release: 9x
Job Type: Parallel
OS: Windows
Hi All,
Disclaimer: I am aware of Cognos Data Manager migration assistant that helps in the migration of Data Manager jobs to Datastage. For certain reasons we do not have access to this tool at ...
 Topic: ETL Development standards, best practices, guidelines etc.,
anamika

Replies: 6
Views: 2482

PostForum: General   Posted: Wed Aug 24, 2016 12:22 pm   Subject: ETL Development standards, best practices, guidelines etc.,
Thanks everybody for pointing those links.
Yes, I have been reading up on lots of DS documentation, IBM Redbooks, general web searches and the like. Please do post if you think it is relevant.

Re ...
 Topic: ETL Development standards, best practices, guidelines etc.,
anamika

Replies: 6
Views: 2482

PostForum: General   Posted: Sat Aug 20, 2016 8:39 am   Subject: ETL Development standards, best practices, guidelines etc.,
DataStage® Release: 9x
Job Type: Parallel
OS: Windows
Hello,
I have been asked to take on the task of evolving ETL architecture, design and development standards specifically using Datastage and the Infosphere suite of tools.
I have started gathe ...
 Topic: Calling DSAttachJob/DSDetachJob in a loop exits after first
anamika

Replies: 5
Views: 2257

PostForum: General   Posted: Wed Jul 13, 2016 12:11 pm   Subject: Calling DSAttachJob/DSDetachJob in a loop exits after first
No worries.
Yes, I did verify that - after the call to DSRunjob, the job handle is unloaded and not available anymore. And hence the need for calling DSAttach before every invocation of DSRunJob.
So ...
 Topic: Calling DSAttachJob/DSDetachJob in a loop exits after first
anamika

Replies: 5
Views: 2257

PostForum: General   Posted: Tue Jul 12, 2016 10:37 am   Subject: Re: Calling DSAttachJob/DSDetachJob in a loop exits after fi
Ok - I think I recall why I was doing DSAttach/DSDetach in a loop - every time DSRunjob is called, the handle obtained from DSAttach is "unloaded". Therefore, I am forced to re-attach inside the loop ...
 Topic: Calling DSAttachJob/DSDetachJob in a loop exits after first
anamika

Replies: 5
Views: 2257

PostForum: General   Posted: Tue Jul 12, 2016 9:11 am   Subject: Calling DSAttachJob/DSDetachJob in a loop exits after first
Thanks chulett.
Since I set the job parameters based on the values obtained in the loop, I need to use setparam and hence attach. But your suggestion could be the right method - I can give it a try a ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours