DSXchange

Auto-Generate give the Syntax error listed above saying issue near the ?. This is from the ODBC stage. When I use the DRS stage, Datastage says not enough columns, even when the SQL is auto-generated.

Thank you for the Suggestion Ray. I gave it a try and it inserted "?" in as values. So still searching for solution, right now I am trying building a 26mb SQL insert statement and will try reading that in as a parameter.

Hi, I have a requirement in which I have to pull data out of 1 oracle table and load into 1 MySQL Community edition table. MySQl Community is unsupported I have read, however I found an article here on how to setup the ODBC driver. This step is complete. I can connect via ./example program and was a...

Thank you all for the replies! I work in Higher Ed., and 8.5 came with PeopleSoft EPM. We no longer pay for Peoplesoft so we are now stuck to 8.5. So far the powers that be do not want to pay for a new separate DS license. As far as data crunching we have maybe 5 hashed files around the 2gb mark, pl...

Hi All, We are going to be setting up a new server for Datastage 8.5 Server Edition. This will be new Linux VM machines running REHL 6. It will have 4 cpus, and 12 gb RAM. This server will only be for Datastage no other users or processing. We have free reign to setup the file system any way we like...

So the mystery has been solved! It was not Datastage, not DB, not connectivity, not network speed. It was the priority setting for the scheduler! By default Windows 2008 R2 sets it to have a priority 7. The net result for any tasks running with priority 7 is that Windows will arbitrarily decide to d...

System folks just told me that it is ESXi 5.1 we are using. I am not sure what this is so will start researching.

Well I have re-opened this topic because the change did not work. Job run time was very low, and it would have taken hours to complete. So I killed, recompiled, and reran, and it completed in 10 minutes. However, this time i did check the monitor before killing, and I did not see anything. When I ch...

Thank you for the replies! So the HF was defined as 64bit to avoid any sizing issues. However I did run the calculation I found posted in other thread. I cannot find the calculator, I work at a University, and our datastage came as part of the Peoplesoft EPM and was installed before my time. When I ...

I am doing a clear file, so it is shrinking back. The HF is defined as 600,003 min grp sz, type 2. So when I run the analyze I get: 728 empty 6393 overflowed 58 badly Filesize is 2.8gb, with 1.7gb being unused. No large records Load Factors: 80% split, 50% merge, and 38% actual. I have read several ...

Thanks ArndW, The job runs at 3:30am so I have not checked it yet, but I am going to set the alarm clock early and take a look. Unfortunately this does not happen all the time so it will be hit or miss. The other thing I notice is high fragmentation on the disk due to large hashed files. I have pre-...

Thank you for the reply. From the look of the log it appears that the Hashed File creation was done, and that it was doing the 2 lookups, and it was running slowly. What I am not sure of is it due to the DB extract, or the actual lookup. What I could do I guess is write the source down to a file fir...

Hi, I have a server job which will take 17 minutes give or take a few minutes to fully complete. However there are times it can take hours. If I see that it is running long I can kill it, and restart, and it will complete in the normal 17 minute window. During these long runs there is no extra volum...

Thank you Andy for the reply. Looks like I will need to time the defrag with the full re-create of these HF. I did read that article and it was a huge help in my understanding. It drives me crazy that I cannot get the OVER.30 smaller. If I allocated an un-godly amount of space I was able to get it d...

Hi All, Got a question regarding Hashed Files. I have been reading alot of posts here on creating them, and tuning and sadly it does not work to well in my case due to architecture of these Peoplesoft provided jobs. However here is what I do not get. I have several hashed files that are around 1.6gb...