Search found 14 matches
- Sat Mar 17, 2018 9:34 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: BigIntegrate in Hadoop - Dataset stage vs BDFS stage
- Replies: 2
- Views: 3148
BigIntegrate in Hadoop - Dataset stage vs BDFS stage
Hi, We are currently using dataset stage for creating intermediate files in HDFS. The descriptor file is created on the edge node (Linux) and data files resides on the data nodes (HDFS). My questions are: 1) Do we have any I/O performance overhead since descriptor is not in HDFS and data files are i...
- Mon Sep 08, 2008 7:07 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: A scenario in lookup stage
- Replies: 4
- Views: 2224
RE:
Thanks to all....
Prasson...i think when we put it as numeric type,it wont take leading zeros..i tried that solution..its working... r u sure prasson...??
Prasson...i think when we put it as numeric type,it wont take leading zeros..i tried that solution..its working... r u sure prasson...??
- Mon Sep 08, 2008 3:26 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: A scenario in lookup stage
- Replies: 4
- Views: 2224
A scenario in lookup stage
Hi, In lookup stage,i used varchar column - MEM_ID as key column. The values of this column MEM_ID in main file and ref file is as follows. MEM_ID - varchar2(5) Main File: ======= MEM_ID MEM_NAME 1 prem 2 surendar Ref File ===== MEM_ID COV_ID 01 100 02 200 What would be the result..?? does the key c...
- Tue May 13, 2008 6:39 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Lookup - different scenario
- Replies: 7
- Views: 2815
Lookup - different scenario
Hi, i need solution for the following scenario: i am having one main file and reference file. I need to lookup data based on specific value which may be in any column, not based on specific column... ie in lookup stage what happens is we give a key column with which matched records w.r.t that column...
- Wed Apr 09, 2008 7:11 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: User inserted sort...
- Replies: 5
- Views: 4146
Still having one doubt
Hi,
Thanks for your response.
But same job when i tried running with config referring 4 nodes, it hasa run successfully. But the problem araised only when we tried running with config file pointing to 8 nodes.
The prevailing problem is anyway related to that...??
Thanks for your response.
But same job when i tried running with config referring 4 nodes, it hasa run successfully. But the problem araised only when we tried running with config file pointing to 8 nodes.
The prevailing problem is anyway related to that...??
- Wed Apr 09, 2008 4:31 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: User inserted sort...
- Replies: 5
- Views: 4146
User inserted sort...
I used a sort stage with hash partionning and after sorting the data , i used remove duplicates stage with same partition. I am encountering the error as "User inserted sort "LabResultMem_srt" does not fulfill the sort requirements of the downstream operator "LabResultMem_rdup&qu...
- Wed Mar 19, 2008 3:14 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: main_program: The section leader on apsp8507 died
- Replies: 2
- Views: 3718
main_program: The section leader on apsp8507 died
When itry to run a job which loads data into DB2 database from sequential file, i encountered the following error :
"main_program: The section leader on apsp8507 died"
what is this...? any solutions...??
"main_program: The section leader on apsp8507 died"
what is this...? any solutions...??
- Fri Feb 29, 2008 6:34 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Stopped but status is showing as running
- Replies: 1
- Views: 1109
Stopped but status is showing as running
In the director it is showing job status as "Running" for a particular job. But when i tried to monitor that job,it is showing as 'stopped' status in monitor window.... why does this happens....??? if someone have stopped that job...?? it should show aborted status... also chked that job.....
- Fri Feb 29, 2008 6:15 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Stage type BBB being accessed by another user
- Replies: 3
- Views: 1651
- Fri Feb 29, 2008 5:39 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Stage type BBB being accessed by another user
- Replies: 3
- Views: 1651
Stage type BBB being accessed by another user
Following error is coming when trying to view log for a particular job in Datastage director
"Stage Type BBB is being accessed by another user"
When and why does this error comes...??
"Stage Type BBB is being accessed by another user"
When and why does this error comes...??
- Thu Dec 20, 2007 5:07 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DSLinkRowcount
- Replies: 1
- Views: 3238
DSLinkRowcount
Hi,
What is the functionality of DSLinkRowcount...?
plz provide the equivalent of DSLinkRowcount macro in parallel..??
What is the functionality of DSLinkRowcount...?
plz provide the equivalent of DSLinkRowcount macro in parallel..??
- Wed Dec 19, 2007 5:55 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: difference between lookup, join and merge in datastage
- Replies: 2
- Views: 5716
difference between lookup, join and merge in datastage
Hi,
What is the difference between lookup, join and merge in datastage...??...which is more efficient....??
What is the difference between lookup, join and merge in datastage...??...which is more efficient....??
- Mon Dec 17, 2007 1:41 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Alternative to @INROWNUM system variable
- Replies: 3
- Views: 2501
Alternative to @INROWNUM system variable
Hi,
Is bthere any altertnative to @INROWNUM system variable in parallel extender..bcoz it is not working in parallel.. what is the use of @PARTITIONNUM..?/
Is bthere any altertnative to @INROWNUM system variable in parallel extender..bcoz it is not working in parallel.. what is the use of @PARTITIONNUM..?/
- Fri Dec 14, 2007 4:40 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Which is beeter ? Lookup File set or Dataset or Fileset
- Replies: 1
- Views: 1175
Which is beeter ? Lookup File set or Dataset or Fileset
Hi,
Which file is better.....Lookup File set or Dataset or Fileset and when these each one is getting used to get efficient result ...??
Which file is better.....Lookup File set or Dataset or Fileset and when these each one is getting used to get efficient result ...??