thats good.
i have 1 dataset of 9 billion and have to break this dataset into 1 thousand records 1 dataset only rest we have to ignore so we have smaller dataset for testing it.
And is there any other way by without running any job and using any unix command we can do so?
Search found 177 matches
- Thu Dec 18, 2008 9:46 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Extracting smaller dataset from Bigger Dataset
- Replies: 12
- Views: 5777
- Thu Dec 18, 2008 6:51 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Compile and run c++ program on linux
- Replies: 6
- Views: 1857
- Thu Dec 18, 2008 6:44 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Scramble the data
- Replies: 3
- Views: 1153
Re: Scramble the data
I dont know the best way but i think this can work. if i am wrong please correct.
try partitioning means while reading use diffrent partitioning do transformation on diffrent partition type. It will scramble.
try partitioning means while reading use diffrent partitioning do transformation on diffrent partition type. It will scramble.
- Thu Dec 18, 2008 4:03 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Extracting smaller dataset from Bigger Dataset
- Replies: 12
- Views: 5777
- Thu Dec 18, 2008 2:02 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Number of records
- Replies: 7
- Views: 2324
Re: Number of records
do u have to calculate records from dataset? or its in other format.
- Wed Dec 17, 2008 11:55 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Extracting smaller dataset from Bigger Dataset
- Replies: 12
- Views: 5777
Yes i want to break 1 big dataset ino multiple or just 1 dataset. Becuase my all source dataset are very big mean they contains billions of records. So while executing job it takes hours to read from dataset and then it executes job so if any error orccurs lots of time is wasted. i tried orchadmin c...
- Wed Dec 17, 2008 7:34 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Extracting smaller dataset from Bigger Dataset
- Replies: 12
- Views: 5777
Extracting smaller dataset from Bigger Dataset
Hi,
I want to extract Dataset from Bigger Datasets so my job can be completed Quickly.
So is there any way or commands to make this smaller datasets?
Thanks
I want to extract Dataset from Bigger Datasets so my job can be completed Quickly.
So is there any way or commands to make this smaller datasets?
Thanks
- Sat Dec 13, 2008 3:45 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Error while writing data to the Table
- Replies: 2
- Views: 1145
Re: Error while writing data to the Table
Hi try using a function to convert string to decimal in the transformer stage: StringToDecimal()
- Thu Aug 21, 2008 11:10 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Compile and run c++ program on linux
- Replies: 6
- Views: 1857
- Thu Aug 21, 2008 11:06 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Compile and run c++ program on linux
- Replies: 6
- Views: 1857
- Thu Aug 21, 2008 3:06 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Compile and run c++ program on linux
- Replies: 6
- Views: 1857
Re: Compile and run c++ program on linux
"Relpy soon"
- Wed Aug 13, 2008 1:27 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Compile and run c++ program on linux
- Replies: 6
- Views: 1857
Compile and run c++ program on linux
Hi, I am trying to run following programm. #include </opt/IBM/InformationServer/Server/DSEngine/include/dsapi.h> #include <iostream.h> #include <string.h> int main() { char SrvName[]={"DEV\0"}; char Username[]={"Kl\0"}; char Pswd[]={"kl\0"}; char name[]={"DataTest\...