DSXchange

Thank You ArndW, I ran a test as you suggested and observed that when i read from a view to a peek stage, the speeds are a little over 5k rows/sec more than what i had when i was writing to the oracle table. Is there anyway, we can improve the speeds at which we can read data or is it always sequent...

Hello, I need to load 23Mil rows from a view (from another DB on another box) to a table, that is partitioned on 2 columns and lies on yet another box. Am using Oracle bulk load (Write method LOAD on oracle enterprise stage) to truncate the table and insert data from the source view. And the perform...

Thanks Craig. The multiple job select seemed to be easiest way. I didnt know we could do that in manager.

Is there a way to rename a job category in Designer/Manager? I am having to organize the jobs already created into Separate categories with more meaningful job category names. Right now i am looking at creating new job categories and moving each individual job to a new destination category one by on...

Thanks Ray, I have used two job parameters one for rundate (timestamp) and another one for directory path and in the reject datasets, i have the names as #directoryPath#/Reject#Rundate#.ds but hte output ds file is named exactly the same way, with the '#' and all and without the job params being eva...

I am trying to name a dataset
as the String 'Reject' concatenated with the job parameter #RunDate#

I have done that with Sequential files, but with DataSets, the output file name does not have the translated value for the job parameter.

Any suggestions are appreciated.

Thanks

I have to implement a requirement where data from a source table has a lookup to a dimension table to get its sequence number and if i dont find something for that code, then instead i should be retrieving the sequence number of the default code (which is usually like a 'No Dimension' code) What i a...

Actually, what i did to get rid of duplicates was to set the option 'Allow duplicates' to False in the SORT stage and it all worked fine.

thanks for your advice Ray. Appreciate it

Thanks Ray, I extended the number of rows to 10000, because when i put 8000, i missed the last value 80.00, and i figured since i set the upper limit to 80.00, even it generated more rows, it wont be processed. I did get all the values from 0.01 to 80.00 but i am getting some duplicates for some val...

My requirement is to populate a dimension table with values 0.01 to 80.00 To implement this, my job has a column generator stage with column defined as decimal(4,2) and in the generator properties, i have set the following Initial value: 0.01 Increment: 0.01 Limit: 80.00 since the column generator s...

[quote="ray.wurlod"]What is your default date format string (set in Administrator, on Parallel tab)? The date format you specify in handle_null must match this string. ...[/quote] thanks much Ray, this worked.. the default timestamp was of format yyyy-mm-dd hh:mi:ss in administrator, so i ...

The column has been defined as Timestamp in both before and after tabs of Modify stage.. the source to the Modify stage is a Oracle Enterprise stage reading from an oracle table - which has this column defined as Date in Oracle DB - but when i imported the metadata into DataStage, i guess it got sta...

thanks Ray,

I tried this syntax

date1 = handle_null(date2, '1/1/1900')

i also tried 1-1-1900 and other date formats, but couldnt get it to work, so i was trying to find the function that would default a date

Nope, i dont think so. I do have the tips on the general suggestion on how to handle nullability and datatype converstion with just one specification.. not leads to what functions i might be able to use to achieve date conversions or setting default dates !

Can i do it in MODIFY stage? Am doing the null handling and datatype conversions on all other source columns in this stage, dont want to add a transformer extra just for the dates..