Difference between Dataset stage and Sequential File stage

kvenkatareddy · Post by **kvenkatareddy** » Tue Dec 07, 2004 6:19 am

Could anybody describe what is the basic difference between the Data set stage and Sequential File stage and which circumstance these stages will be used?

Thx

lakshmipriya · Post by **lakshmipriya** » Tue Dec 07, 2004 10:24 pm

Data set can be partioned as of the required number of nodes and thus it can be run in parallel. You can defines as many number of nodes as you can.

But incase of sequential file, it extracts and writes through sequential.

l_homme_de_rio · Post by **l_homme_de_rio** » Wed Dec 08, 2004 11:52 am

Hi,
Datasets are the most important thing to understand to start anything within PX, you should attend a PX training before.
The Datasets are the "magic key" to handle scalability. in addition all the partionning stuff is based on them.
Don't forget that Flat files aren't so "popular" in PX comparing to "classical" DS and should be used only to read a source or generate an output. In the intermediate phase, forget them.
All the best