Use "Update else insert new rows" option to insert new rows and update exiting rows.
If you want to delete the records which are already present in the table, then while updating mark a flag to those records. In the after job SQL you can delete those records with that flag.
Search found 21 matches
- Wed Mar 16, 2005 5:02 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Removing Duplicate records from a flat file
- Replies: 5
- Views: 2506
- Tue Mar 15, 2005 1:01 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: ODBC Stage on Sybase
- Replies: 6
- Views: 2700
- Wed Feb 23, 2005 5:21 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: ODBC Stage on Sybase
- Replies: 6
- Views: 2700
ODBC Stage on Sybase
We have difficulty in accessing sybase server using ODBC stage, whereas We were able to connect thru SYBASE stage.
DSN in working fine from datastore administrator. But when conenct through the DS for importing table definitions, it just hangs. Any idea on what is the problem?
Thanks.
DSN in working fine from datastore administrator. But when conenct through the DS for importing table definitions, it just hangs. Any idea on what is the problem?
Thanks.
- Wed Feb 09, 2005 11:32 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: inputs required on the design...
- Replies: 8
- Views: 3760
The design will work fine w.r.t performance provided the tabels referenced in both the streams are different. You can try using a IPC stage between the ODBC and seq. stage. I have heard using IPC explicitly is mroe powerful than implicitly defining it in the project properties. Also if the o/p seq.f...
- Tue Feb 01, 2005 1:01 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Datastage TX Vs DataStage Server Edition
- Replies: 0
- Views: 812
Datastage TX Vs DataStage Server Edition
Can someone let me know if datastage TX is a data integration tool or just an application intergration tool. Heard from one of my colleague that TX jobs used for DI purpose are performing very pathetically when compared to DS server jobs. Just curious to know if there is some restriction in using th...
- Tue Feb 01, 2005 12:15 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Insert/Update IMS DB
- Replies: 4
- Views: 4043
If we have Enterprise MVS edition on Unix, can we not execute the cobol program from the External Target Stage? Update on IMS is required for a feedback mechanism in ODS system. Should I have a batch file to trigger a DS job to dump the data into a file and then trigger a cobol program to update a I...
- Mon Jan 31, 2005 7:28 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Insert/Update IMS DB
- Replies: 4
- Views: 4043
Insert/Update IMS DB
Hi,
I'm aware that we can access data from IMS database using IMS stage in MVS edition. Is there a way to insert/update data into IMS database from DS? This is a urgent requirement. any help is highly appreciated. Can the same be done on a DS390 on unix platform?
Thanks.
I'm aware that we can access data from IMS database using IMS stage in MVS edition. Is there a way to insert/update data into IMS database from DS? This is a urgent requirement. any help is highly appreciated. Can the same be done on a DS390 on unix platform?
Thanks.
- Thu Jan 27, 2005 3:49 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Validating records using Key Expression in transformer
- Replies: 4
- Views: 2565
- Mon Jan 24, 2005 4:27 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Issue with sort and group by
- Replies: 4
- Views: 2246
If your input can be sorted in the desc order of the year, then you can do the same thing which the routine does in the transformer stage itself. declare three stage variables as below Derivation Stage Variable rowproccomparewithpreviousvalue(key) keychg if keychg then 1 else count+1 count (initial ...
- Mon Jan 24, 2005 1:17 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Error in Aggregator Stage
- Replies: 4
- Views: 2438
I agree with Rasi on avoiding aggregator stage for huge data. As sugessted you can dump the data into a temp table and do a group by query on the table to find the min value. Another alternative is that u can dump the data into a hash file with a transofmer in between. Let the key for your target ha...
- Fri Jan 07, 2005 3:36 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Performance Issue
- Replies: 5
- Views: 2794
- Mon Dec 27, 2004 12:13 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Partitoned Table in server jobs
- Replies: 4
- Views: 2218
Partitoned Table in server jobs
Hi, From the search I did on this forum on partition table, I understand that PX jobs can talk to partitioned table concurrently. But what will be the case with the server job. I guess server jobs cannot talk to different partiotions concurrently from a server job. If so, what is the use of having a...
- Fri Dec 17, 2004 2:42 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Regression Testing
- Replies: 2
- Views: 2590
Regression Testing
Hi,
Is there any regression testing tool available for data stage. If not. what will be the approach for doing regression testing in data stage?
Thanks.
Is there any regression testing tool available for data stage. If not. what will be the approach for doing regression testing in data stage?
Thanks.
- Thu Oct 28, 2004 12:48 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Multiple hash files in a single stage
- Replies: 3
- Views: 1850
Siva, I feel wht u have told will be a case when you access the same hash file using multiple links from the same stage. But when you try to access multiple different hash files using the same stage, it will try to load the data of all the hash files in the same memory. Also the connection made will...
- Thu Oct 28, 2004 12:38 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Multiple hash files in a single stage
- Replies: 3
- Views: 1850
Multiple hash files in a single stage
Hi,
How will this work? Trying to access multiple hash files from the same stage using different links. Preload to memory is enabled.
My doubt is
1. Will the performance degrade?
2. Since the same memory will be used by all the four hash files, will there be any data leakage?
Thanks.
Uma
How will this work? Trying to access multiple hash files from the same stage using different links. Preload to memory is enabled.
My doubt is
1. Will the performance degrade?
2. Since the same memory will be used by all the four hash files, will there be any data leakage?
Thanks.
Uma