Search found 130 matches

by DSFreddie
Mon Oct 22, 2018 6:49 pm
Forum: General
Topic: Best way to call a Shell Script
Replies: 5
Views: 3670

Best way to call a Shell Script

Hi All, I know there are multiple ways to call a Shell Script in Datastage such as, 1. Execute command activity 2. Before/After job Subroutine 3. Transformer stage ? etc... I am trying to figure out the best way in terms of overall performance. Can anyone shed some light on what is the ideal way to ...
by DSFreddie
Tue Oct 16, 2018 7:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: GMT conversion before loading to Oracle Exadata
Replies: 3
Views: 2624

Thanks for your reply Ray.

There is no specific format requirement, all we need to do is convert the current date to a valid GMT Timestamp format.

Pls let me know if TimestampOffsetByComponents() function will work in this case.

Thanks
Freddie
by DSFreddie
Tue Oct 16, 2018 12:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: GMT conversion before loading to Oracle Exadata
Replies: 3
Views: 2624

GMT conversion before loading to Oracle Exadata

Hi All,

Are there any ways to convert a current timestamp to GMT format using Datastage prior to loading to Oracle Exadata ? I couldn't find any specific functions in transformer nor arrive at a solution.

Any help/thoughts are appreciated.



Thanks
Freddie
by DSFreddie
Tue Sep 11, 2018 1:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage Bulk Load to Oracle DB - JSON data
Replies: 3
Views: 2637

Thanks for your reply Ray. One of the reason why it is BLOB is to bring in more flexibility in terms of what we would store in the future.

Are there any other ways in which we can perform a Bulk Load operation against Oracle Exadata table with BLOB fields in it.

Pls help.

Thanks
by DSFreddie
Tue Sep 04, 2018 1:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage Bulk Load to Oracle DB - JSON data
Replies: 3
Views: 2637

Datastage Bulk Load to Oracle DB - JSON data

Hi All - I am facing issue in one Datastage job that reads the data ( Has fields with JSON data, defined as BLOB datatype in the Oracle table) and performs BULK load to the Oracle table. Note that this table doesnt have any constraints defined, so ideally its supposed to perform the load run faster....
by DSFreddie
Tue Jul 11, 2017 12:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Rest API
Replies: 1
Views: 2549

Rest API

Hi All,

I am doing a PoC to check whether its possible to Read/Write to Marklogic NoSQL Database using Datastage. It looks like its possible using REST API.

Can anyone help me understand how to invoke Rest API using Datastage ?
Datastage version : 9.1.3

Thanks
Freddie
by DSFreddie
Fri Jul 07, 2017 2:24 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage with Marklogic
Replies: 1
Views: 2007

Datastage with Marklogic

Hi All,

Do anybody in this forum tried connecting to Marklogic NoSQL DB (Document based) using IIS Datastage ? Pls let me know whether its possible using any stages in Datastage.

Thanks
Freddie
by DSFreddie
Thu Mar 02, 2017 7:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Convert EST timestamp to GMT
Replies: 3
Views: 2975

Convert EST timestamp to GMT

Hi All, Good evening. Is there a function ( or set of functions) that can convert a timestamp value (which is in EST) to GMT timestamp value ? I am trying to convert a timestamp field coming from an input file & it goes to a output file. ( so running a Currentimestamp-current timezone in DB2(as ...
by DSFreddie
Tue Nov 08, 2016 12:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: IIS 9.1 with MEMSQL DB
Replies: 1
Views: 1960

IIS 9.1 with MEMSQL DB

Hi All, I searched the forum to find any posts related to the IIS Datastage connectivity with MEMSQL Database that is currently hot in the market. Can anybody shed some light on how do we establish connectivity between datastage & Memsql DB if you tried it in your projects. Any thoughts would be...
by DSFreddie
Tue Oct 25, 2016 8:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to Invoke DB2 connector alone in a Job
Replies: 2
Views: 2464

Thanks for your quick response Andy :) I will try this out & let you know. Meanwhile, is there a way I can invoke the DB2 load utility in the DB2 connector z/os without initiating the FTP transmission ( Transfer Type option in DB2 connector stage) to use a file present in the Mainframe system fo...
by DSFreddie
Mon Oct 24, 2016 7:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to Invoke DB2 connector alone in a Job
Replies: 2
Views: 2464

How to Invoke DB2 connector alone in a Job

Hi All, I have a requirement in my project to do a Bulk Load/Replace into the Mainframe DB2 tables using DataStage. The data files sit in the Mainframe system. I am trying to invoke the DB2 connector stage (alone) through a DataStage job that will in-turn invoke the DB2 utility to trigger the Load/R...
by DSFreddie
Tue Oct 04, 2016 1:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DB2 Connector Truncate & Bulk Load Option
Replies: 3
Views: 3271

Sorry for being unclear.

I need to delete all the existing records & load the new records into the table.
Hope it is clear now.

Thanks
Freddie
by DSFreddie
Tue Oct 04, 2016 10:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DB2 Connector Truncate & Bulk Load Option
Replies: 3
Views: 3271

DB2 Connector Truncate & Bulk Load Option

Hi All, I have a requirement in my project to refresh the data in 10 DB2 tables ( volume is around 80 million) and load the fresh records into it. I am planning to go with the following options in the DB2 connector stage, Write Mode : BulkLoad Table Action : Replace Record Count : 2000 Array Size : ...
by DSFreddie
Wed Sep 21, 2016 7:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ Stage to process Real time messages from Mainframe
Replies: 2
Views: 1925

Re: MQ Stage to process Real time messages from Mainframe

Hi All,

Can someone pls help me with some thoughts around this. Pls let me know if you have any questions.

Thanks
Freddie
by DSFreddie
Fri Sep 16, 2016 10:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ Stage to process Real time messages from Mainframe
Replies: 2
Views: 1925

MQ Stage to process Real time messages from Mainframe

Hi All, I am planning to use MQ Stage to read real time data from MF Message Queues. There are 2 data centers where the records would be transmitted. i.e. records from Mainframe Data Center A will be transmitted to Midrange server A as well as the Datacenter B (eventually to Midrange server B also )...