Search found 1028 matches

by PhilHibbs
Mon Sep 24, 2012 6:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Delete then insert to replace a set of records
Replies: 9
Views: 3414

Surely the "delete" statement will be based on the "key" columns, and thus all 10 records would be deleted? If it isn't based on the columns that have "key" checked, then what is the delete statement based on? It can't surely put every value in the row in the "wher...
by PhilHibbs
Mon Sep 24, 2012 4:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Delete then insert to replace a set of records
Replies: 9
Views: 3414

Delete then insert to replace a set of records

I have a requirement to replace a set of records in a table. The parent key is a bigint called DIN and I want to delete all the records for that DIN and then re-load the new set. Can I do this with a "Delete then Insert" operation, just setting the DIN as the key column? I thought that thi...
by PhilHibbs
Sun Sep 23, 2012 7:10 am
Forum: General
Topic: How to use different parameter sets at run time
Replies: 2
Views: 1941

If there is some concern about credentials in the value set files, make sure you use an encrypted password string. Encrypted values are trivial to decrypt, the only advantage that they give is that they are replaced by ***s in the job log and so can't be viewed in Director. Anyone who can access yo...
by PhilHibbs
Sun Sep 23, 2012 7:05 am
Forum: General
Topic: Running dsjob utility from Client workstation
Replies: 7
Views: 3598

He asked about running them on the workstation, not on the server. As far as I know the answer is no, you have to connect to the server and run it from there, using something like telnet, ssh, etc.
by PhilHibbs
Thu Sep 13, 2012 7:28 am
Forum: General
Topic: ETL vs ELT
Replies: 3
Views: 2265

And what does "ELT" mean in this context? I understand it to mean loading the source data into the database on which the target application is running and then transforming it using that database's native operations (typically stored procedures), e.g. if you're migrating or interfacing int...
by PhilHibbs
Thu Sep 13, 2012 7:20 am
Forum: General
Topic: value files
Replies: 2
Views: 5529

My suggestion - and I don't know if this is normal practice or not - is to always use value files. If you have a Parameter Set that is common to all your jobs, and you just want the values to be the same for all of them, then still make a value set file called "Default" or "Common&quo...
by PhilHibbs
Fri Sep 07, 2012 7:29 am
Forum: General
Topic: Parameter Set Changes
Replies: 2
Views: 1882

If you are using Sequence Jobs, and they invoke your jobs with "(As pre-defined)", then you will need to re-compile all your jobs. If your Sequence Jobs also have the Parameter Set as a parameter, but you are not passing anything in when you invoke the Sequence Job, and this parameter is p...
by PhilHibbs
Wed Sep 05, 2012 12:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: PadString is constrained to the input column length
Replies: 4
Views: 2472

What I've done is made a CHAR(40) stage variable for each address element and just mapped the inputs into those and then concatenated the stage variables into the output. No function calls necessary!
by PhilHibbs
Wed Sep 05, 2012 12:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: PadString is constrained to the input column length
Replies: 4
Views: 2472

What I've done is made a CHAR(40) stage variable for each address element and just mapped the inputs into those and then concatenated the stage variables into the output. No function calls necessary!
by PhilHibbs
Wed Sep 05, 2012 7:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: PadString is constrained to the input column length
Replies: 4
Views: 2472

PadString is constrained to the input column length

Input: HOUSE_NUM VarChar(10) FLAT VarChar(20) HOUSE_NAME VarChar(30) DISTRICT VarChar(30) STREET VarChar(30) POST_TOWN VarChar(30) COUNTY VarChar(30) POSTCODE Char(8) Output: ADDR_TX VarChar(440) Derivation: PadString( in.FLAT, ' ', 40 )[1,40] : PadString( in.HOUSE_NAME, ' ', 40 )[1,40] : PadString(...
by PhilHibbs
Wed Sep 05, 2012 4:27 am
Forum: General
Topic: Realistic uppper limit quantity of jobs in on Project
Replies: 7
Views: 2944

Which ever it is - one job with 8,000 instances or 16 jobs with 500 instances each - there will be a performance hit on Director retrieving the stats and displaying all 8,000 entries in the browse list. I think that that is what the OP is concerned about, that Director will retrieve the Status, Star...
by PhilHibbs
Wed Sep 05, 2012 4:19 am
Forum: General
Topic: shell script to call job logs showing the current job
Replies: 4
Views: 2184

Our shell scripts run the job with -wait and then once the dsjob command finishes the shell script then interrogates the log with another dsjob command. Are your jobs being run from a shell script like this, or does your log interrogation have to be done outside of the process that actually runs the...
by PhilHibbs
Tue Sep 04, 2012 4:00 am
Forum: General
Topic: DSExport non interactive and supress warnings
Replies: 8
Views: 4415

I don't think it's possible. Well, everything's possible given a broad definition of "possible", but you know what I mean. I remember trying to do this myself, and I gave up and went with DSX exports instead. And if I can't do it easily, it isn't possible. :P Perhaps you could try some sor...
by PhilHibbs
Mon Sep 03, 2012 11:27 am
Forum: General
Topic: Realistic uppper limit quantity of jobs in on Project
Replies: 7
Views: 2944

My suggestion is, don't use Director. Roll your own system that runs dsjob to query the job logs and statuses that you need to know about. I do this for my own purposes from an Excel spreadsheet using VBA code to generate a script that is then executed on the Unix server and then scrapes the results...
by PhilHibbs
Mon Sep 03, 2012 11:16 am
Forum: General
Topic: Parameter Set with Environment Variables in it
Replies: 0
Views: 1273

Parameter Set with Environment Variables in it

The project that I am working on has a convention whereby all jobs must have a Parameter Set which contains a few environment variables. There is one Value Set, "Standard", which is set up in every environment, and the shell script that invokes dsjob specifies this value set name, and the ...