Search found 27 matches

by vzoubov
Wed Apr 07, 2004 7:05 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Comparing 2 datasets
Replies: 7
Views: 4641

kduke wrote:Raj

The diff command would work great for this. Try it.
Raj,

The change capture stage also would work just fine for comparing two datasets.

Vitali.
by vzoubov
Wed Feb 11, 2004 12:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Buildop stage .....
Replies: 4
Views: 5017

Ok, so i have to write my own string functions to do all the manipulations. No, you don't have to. You just have to spend some time learning how to use the existing ones. like in a regular c compiler i cannot use any of the library functions? i thought they are functions that i can use. The functio...
by vzoubov
Tue Feb 10, 2004 5:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Buildop stage .....
Replies: 4
Views: 5017

Re: Buildop stage .....

Hi Every one, I'm trying to build a BuildOp stage to be used in paralle jobs. i have incoming data that is 150 character long i have to parse the record and send it to many fileds. i'm trying to use the macros to get the string length and substring. so far i'm not sucessful in doing that. I tried t...
by vzoubov
Wed Jan 28, 2004 6:52 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Importing of a Orchestrate schema into a DS inRec: *;
Replies: 7
Views: 4687

How can I define the inRec :*; in Data stage schema Ram, Schema variables cannot be used in the Data Stage table definitions. They are used in Orchestrate operators. Here's an example of using schema variables in an Orchestrate custom operator (buildop): $operator schema_var $class schema_var_op $i...
by vzoubov
Tue Jan 27, 2004 10:47 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Handling database rejects for db2 api stage
Replies: 10
Views: 6626

I would be wanting to do insert / updates and which to capture database related errors like unique constraint violated, not null error etc. In the upsert mode (try to insert first, if unique constraint is violated try to update) the db2 stage will log a summary that looks like: DB2_3.DSLink4,0: DB2...
by vzoubov
Tue Jan 27, 2004 8:03 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Importing of a Orchestrate schema into a DS inRec: *;
Replies: 7
Views: 4687

Re: Importing of a Orchestrate schema into a DS inRec: *;

So in summary, it is a way to declare Orchestrate Propagated columns? -T.J. Yes. According to the Orchestrate documentation: Operators use schema variables to transfer an entire record of an input data set to the output data set. Operators that do not use schema variables drop unused fields from th...
by vzoubov
Tue Jan 27, 2004 1:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Handling database rejects for db2 api stage
Replies: 10
Views: 6626

Re: Handling database rejects for db2 api stage

What method to load a table are you using: load, write or upsert? What type of rejects do you need to handle?

Vitali.
by vzoubov
Tue Jan 27, 2004 1:04 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Importing of a Orchestrate schema into a DS inRec: *;
Replies: 7
Views: 4687

Re: Importing of a Orchestrate schema into a DS inRec: *;

Hi, I have a question.... I have to import a Orchestrate schema definition to Data Stage Example : record ( npa : string; nxx : string; tel_ln_no : string; inrec : *; ) In the above example How can I handle the inRec: *; portion while importing it to Datastage ?????.... Thanks in advance Ram inrec:...
by vzoubov
Fri Jan 23, 2004 11:31 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: PX job re-run abort
Replies: 3
Views: 2341

Re: PX job re-run abort

praj wrote:Iit gives is "Sort_101,0: Fork failed: Not enough space"
Not a Unix expert but sounds to me like there's not enough virtual memory to start a new process.

Vitali.
by vzoubov
Thu Jan 22, 2004 6:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Nullable to Non-Nullable
Replies: 6
Views: 5185

Re: Nullable to Non-Nullable

Hello folks -- The one method I am aware of is using the Transform stage, and the following routine: If IsNull([link].[field]) Then [default value] Else [link].[field] Is there any other methods you use to handle this? I know there is a Modify stage for 7.x, but what are the other options? You can ...
by vzoubov
Thu Jan 15, 2004 12:45 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unable to map file Error
Replies: 13
Views: 8309

johnman wrote: Or is there any limit on the size of a data file of dataset?
Any pointers???
ulimit -f

will give you the file size limit on your unix system.

Vitali.
by vzoubov
Wed Jan 14, 2004 10:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sort in PX Version 7
Replies: 5
Views: 3549

Thanks a Lot Vitali. One more point I wud like to clarify: Right now I am setting the input partitioning to Hash and checking "Perform Sort" to get the desired result. Is the any better and efficient method to do the same. Which partitioning is better when we want same key values to land ...
by vzoubov
Wed Jan 14, 2004 6:38 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sort in PX Version 7
Replies: 5
Views: 3549

Re: Sort in PX Version 7

John, Please see my notes below... Hi All, I have real concerns about the parallelism in Data Stage. The general problems coming is Join Stage not joining the Data, Aggregator stage not aggregating the data, Sort stage not doing the Sort. Then after setting the Input Partitioning to Hash and perform...
by vzoubov
Sun Jan 11, 2004 1:00 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Communication Resources problem
Replies: 2
Views: 1933

Re: Communication Resources problem

Hi All, While running a job, i'm getting the following error. ##F TFIO 000153 17:11:02(002) <APT_PeekOperator,2> Fatal Error: Unable to allocate communication resources ##E TFPM 000192 17:11:02(000) <node_node3> Player 1 terminated unexpectedly. ##E TFPM 000338 17:11:05(004) <main_program> Unexpect...
by vzoubov
Sat Dec 20, 2003 12:37 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: irreconcilable constraints
Replies: 6
Views: 11846

Hi, I got some info on the problem I'm facing. I have two jobs that are creating Data Sets as the output. After that one job merges these two data sets to create the final sequential file output. When I run the jobs with One Node configuration, everything works fine. But when I run the jobs with 4 ...