DSXchange

chulett wrote:Have you had your DBA monitor it during the job?

Yes, he was a lot of help. He looks at the logs sees nothing and says it is a Datastage problem not a database problem.

What about the first question - is this behaviour repeatable? I wonder if the delay is space management / allocation going on in the database... It happens every time I run the job. I have run SQL activity monitor while this job is running and once it stalls there doesn't seem to be any activity ag...

This is repeatable or it only happened once? What stage are you using for the target? What update action? Are you doing anything 'after SQL' in the stage? The source is a transaction table and the job picks up any new transactions since the last run time. The stage for the target is Dynamic_RDBMS. ...

DSguru2B wrote:What is your target transaction size and array size?

Array size and transaction size are both 20

We have a strange problem with one of our datastage jobs. We have a job that stages a table with an incremental load. We use ODBC to pull from an AS/400 source DB to a SQL server target DW. This job is very simple it has 1 source, 1 transformer, and 1 target. Nothing else. I ran this job while monit...

All it takes is a trailing space (for example) for one field to not equal another, something we can't tell from here. What is the dash supposed to represent? Problem solved..It must have been spaces. The original job had records updating a table and then the hashed file being completely rebuilt fro...

No such thing as duplicate keys in a hashed file. Honest. You need to check your data / process a little closer it seems to me. ... Here is what I get for the 6 columns that make up the key in the Hash file: 1807839 143208 A1 P - JDEPD 1807839 143208 A1 P - JDEPD 1807839 143208 A2 P - JDEPD 1807839...

Clear file before writing is NOT checked. The same 6 fields make up the unique key in both the source table and the hash file. I checked and all the properties are the same for each field (type, length, display...) in both the DB table and the hash file. Have you chosen to "Clear file before wr...

I have a simple staging job that pulls data from a source and puts it in a target table. The job then deletes and crates a Hash file for look ups. There are 20K records each day to pull but 9 million total in the table. It takes about 10 minutes to update the table and about 20 minutes to re-create ...

I set up an Oracle Wire Protocol ODBC connection to a data source. When I test the connection from ODBC Data Source Administrator it connects succesfully. When I try to import a table from that ODBC connection in Designer. I see all the tables in the Oracle DB and I am able to import it. When I crea...

I have a sequencer job that calls a routine to return the last updated date time. If I go into edit routine and test it, it will retunr the correct datetime value. But when I complie and run the job it returns the following error: FIELD_SEQ_J_Fact_PS_F_INV_LDGR_E1..JobControl (@GetLastUpdDateTime): ...

After a little trial and error testing we are sure that the problem lies with the source and not the target. When we try even just a view data is Designer on the source table, it takes forever to display the results. the select statement contains the following where clause: Where (Createdate > #GetL...

We are running a simple ETL server job that takes data from the source DB2 table using ODBC and puts it in a target SQLserver 2005 table. The ETL job runs very slow processing less than 100 rows per second for a job that needs to process about 300K rows. Working with our DB administrator we found th...

Newbie question: I am looking itno a process where anytime a file appears in a directory a server job is kicked off. In the ideal world: A file appears -> Job 1 runs, kicks of Job 2 and job 1 ends -> Job 2 waits for a file runs a process, restarts Job 1 to start the waiting process all over. I can't...

NLS was installed and both machines are set the same.

Convert Binary is set.