Search found 47 matches

by rmcclure
Fri Mar 02, 2018 7:55 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Server Jobs hanging while loading Hashed Files
Replies: 8
Views: 18965

Hi Ray, Thanks for the suggestion but I have tried that. Original post: "I have played with settings: Delete File before create vs clear file before writing and they both hang." There are two things stuck in my mind over this: 1) The fact that the records have been written to the Hashed fi...
by rmcclure
Wed Feb 28, 2018 11:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Server Jobs hanging while loading Hashed Files
Replies: 8
Views: 18965

After the job aborts, reset it (do not recompile it). Is there any additional information logged "from previous run"? This may signal whether there is a problem with the hashed file, for example. ... Thank-you for the response. Unfortunately my previous posting of "from previous run&...
by rmcclure
Fri Feb 23, 2018 12:17 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Server Jobs hanging while loading Hashed Files
Replies: 8
Views: 18965

-Hanging means it never finishes. Where normal run time is 6 seconds, it has "hung" for as long as 4 hours. -Minumum modulus is set to 1 (out of the box). We never changed it. -Size doesn't matter. The current job had 150k records. Strangely we have a job with 38 million records and it nev...
by rmcclure
Fri Feb 23, 2018 8:12 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Server Jobs hanging while loading Hashed Files
Replies: 8
Views: 18965

Server Jobs hanging while loading Hashed Files

A question for the old-timers: I am working with DataStage 7.5.2 on a Windows server 2003 machine. We are having an issue with daily server jobs intermittently hanging while loading hashed files. We don't believe the hanging is on the DB side because. We have many jobs that read from the DB to trans...
by rmcclure
Fri Mar 17, 2017 9:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: timestamp_from_string with microseconds in Modify Stage
Replies: 7
Views: 5750

Hi Mike, I tried the copy stage but get the same result. A little fix to my original post: I said I wrote to a dataset but I was writing to a sequential file. That being said I did a number of tests with sequential file and Dataset. -Writing to a sequential file turns the microseconds to .000000 -Wr...
by rmcclure
Thu Mar 16, 2017 3:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: timestamp_from_string with microseconds in Modify Stage
Replies: 7
Views: 5750

Hi Mike,

Thanks for the response.
The data is not getting truncated because my two tests are exactly the same except one uses modify and the other transformer.
by rmcclure
Thu Mar 16, 2017 8:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: timestamp_from_string with microseconds in Modify Stage
Replies: 7
Views: 5750

Hi Mike,

We have a version of 11.5 in development where I tested this and I have the same problem. You mentioned that it works for you. What format are you using for the microseconds
by rmcclure
Wed Mar 15, 2017 7:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: timestamp_from_string with microseconds in Modify Stage
Replies: 7
Views: 5750

timestamp_from_string with microseconds in Modify Stage

Hi, I have a job that reads from an Oracle table and writes to a Dataset doing transformation on one field. One of the fields (DATETIME_FIELD) has microseconds and it is stored in Oracle as a varchar Example: 20161231 11:35:12.123456 I am trying to convert it to a TIMESTAMP with a Modify Stage using...
by rmcclure
Mon Jul 27, 2015 1:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Ignore columns from a sequential file
Replies: 15
Views: 10714

The cut command did not work because the sequential file has descriptions in quotes and some of those description have commas. Others do not.

I ended up adding the generic columns. If they add more columns in the future I will need to modify my job.
by rmcclure
Tue Jul 21, 2015 1:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Ignore columns from a sequential file
Replies: 15
Views: 10714

Ignore columns from a sequential file

Hi, I am trying to read records from a sequential file to process and write to a table. The problem is the sequential file is a global company file that generated by a group to be used by multiple divisions. I only need the first 70 columns of about 90. When I try to run the job I get a warning that...
by rmcclure
Thu May 14, 2015 7:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup/join using something other than equal
Replies: 5
Views: 3592

I did find a work around...sort of. My lookup table contains the following fields: LKP_MIN_VALUE LKP_MAX_VALUE My source contains: SRC_VALUE3 I am trying to find were: LKP_MIN_VALUE<=SRC_VALUE3 AND LKP_MAX_VALUE>=SRC_VALUE3 With the range option in the lookup stage, the range is on the lookup field ...
by rmcclure
Tue May 12, 2015 11:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup/join using something other than equal
Replies: 5
Views: 3592

Yes, that is exactly what I am trying to do.
by rmcclure
Tue May 12, 2015 9:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup/join using something other than equal
Replies: 5
Views: 3592

Lookup/join using something other than equal

I am having a problem with doing a lookup where the value is <. I have searched the forum and found some suggestions but they do not apply to my situation. DataStage stream should look like: Source ======> Lookup1 DS========> transform =======> Lookup2 DS =======> Target Source: gets data by joining...
by rmcclure
Fri Oct 24, 2014 8:07 am
Forum: General
Topic: Multiple Wait for file stages not running simultaneously
Replies: 2
Views: 3493

Multiple Wait for file stages not running simultaneously

Hello, I am having a problem with running 3 separate Wait for file stages in the same sequencer. -I need to wait for 3 files -As soon as all 3 files arrive I need to run a job -If I don't have the three files in 60 minutes I need the job to timeout. I put 3 wait for file stages each with a 60 minute...
by rmcclure
Fri Jun 06, 2014 8:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Null Error checking for nulls
Replies: 4
Views: 2947

Thanks for the tips. The problem is solved: I noticed the input field was a nvarchar and the output field was a varchar. I changed the imput field to varchar and it works. Not sure why....but it works.