DSXchange

Hi guys, Is it possible to loop through the columns of a source and change the type and length of all columns of a particular type? Say for example I wanted to change all Character type columns to VarChar(256), is there an automated way to do that? Currently I have been doing this in a transform sta...

ray.wurlod wrote:MONTH.LAST and MONTH.FIRST are available as Transforms in server jobs. ...

That is good to know, and the only purpose of this particular job is to collect various date details and run some conditional logic on them so I might recreate the job as a server job. Thanks!

Hi again qt_ky! This is indeed for a parallel job, I found the functions necessary are not available in sequence jobs. I was able to take your direction there and get something working rather well! I had some other things I needed to do as well and was able to apply similar logic. What I have done s...

Hi guys, I am working on replicating some trending jobs from our old data warehouse system. Those jobs had to be run manually and the last day of the month manually entered as the trending date. The issue is that sometimes the trend was run before or after the actual last day of month depending on w...

Great News!!! Reordering the IF THEN ELSE logic to hit the columns defined date format first has resolved the performance issue. Its not as good as some jobs but its back up to 800+ Rows/sec and I will take that. Thank you guys a TON for the amazingly helpful input!

asorrell, I can and will absolutely do suggestion 1, I didnt think of that as I had my mind stuck on them having to be in that order, but that was before I was doing date within 100 years past/future checking. This SHOULD help a lot I think. I will definitely look into Suggestion 2, however I believ...

qt_key, Thank you for that suggestion! I did set a StageVar for the YearsInFuture/Past values but I did make the mistake of putting in the actual derivation to get that value both in the default value and the Derivation so yes that would make sense that it would be recalculating that every time. The...

Thanks chulett, this is interesting, so I have my new derivation as follows using IsValid(): VERSION 4 IF $1 <> 0 THEN ( IF (IsValid("date",StringToDate(Right("0":$1,8),"%mm%dd%yyyy")) AND (StringToDate(Right("0":$1,8),"%mm%dd%yyyy") > YearsInPast100...

chulett, I will give that a shot and see how that performs. Could you elaborate on what IsValidDate is doing that I am misunderstanding? based on the following KB, it seems that the only difference between IsValid() with date type specified and IsValidDate() is that IsValid does not log warnings, wh...

Hi everyone, new here. I am attempting to bring in dates to our datawarehouse, the issue that I have is that these dates are free form decimal of varying formats. Some may be %yyyy%ddd, others %mm%dd%yyyy, and still others are %mm%dd%yy. The biggest issue is that I can have multiple "formats&qu...