Hi All,
We are on the process of migrating 4.2 to DS6.
While going through the design guide for DS6.. on
improving the performance using inter-process row
buffering, a note is given as follows:
You cannot use inter-process row-buffering if your job
uses COMMON blocks in transform functions to pass data
between stages. This is not recommended practice, and
it is advisable to redesign your job to use row
buffering rather than COMMON blocks.
What is a Common Block? Is it a Stage Variable?
Also want to know the experiences after enabling Inter
process Row Buffering.
with thanks,
Bruce
__________________________________
Do you Yahoo!?
New Yahoo! Photos - easier uploading and sharing.
http://photos.yahoo.com/
Inter process row buffering & Common Block
Inter process row buffering & Common Block
<b>PLEASE READ</b>
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
Inter process row buffering & Common Block
A common block is a way to share data between DataStage Routines without the
need for passing the data as parameters.
Common/common_name/var [,var_2] [...var_n]
Each unique common block would need to have a unique name. Additionally, if
wanted, but deftly not recommended by me, you could have different variable
names used for the same common block in multiple routines. But, you MUST
retain the order.
What I have done in the past is to create a file that contains all the
common block definitions and include this file in the Routine(s). This
allows you to make changes in one file and then recompile all the Routines
as needed. It also ensures that you are using the same variable name, thus
ensuring some semblance of consistency.
Thanks,
Lester
Lester F. Callif | Manager | BearingPoint, Inc. | Denver, Colorado
Mobile 303.596.8422 | Fax 707.988.0160
-----Original Message-----
From: Bruce William [mailto:bwilliam_ds@yahoo.com]
Sent: Friday, December 12, 2003 2:14 AM
To: datastage-users@oliver.com
Subject: Inter process row buffering & Common Block
Hi All,
We are on the process of migrating 4.2 to DS6.
While going through the design guide for DS6.. on
improving the performance using inter-process row
buffering, a note is given as follows:
You cannot use inter-process row-buffering if your job
uses COMMON blocks in transform functions to pass data
between stages. This is not recommended practice, and
it is advisable to redesign your job to use row
buffering rather than COMMON blocks.
What is a Common Block? Is it a Stage Variable?
Also want to know the experiences after enabling Inter
process Row Buffering.
with thanks,
Bruce
__________________________________
Do you Yahoo!?
New Yahoo! Photos - easier uploading and sharing.
http://photos.yahoo.com/
******************************************************************************
The information in this email is confidential and may be legally
privileged. Access to this email by anyone other than the
intended addressee is unauthorized. If you are not the intended
recipient of this message, any review, disclosure, copying,
distribution, retention, or any action taken or omitted to be taken
in reliance on it is prohibited and may be unlawful. If you are not
the intended recipient, please reply to or forward a copy of this
message to the sender and delete the message, any attachments,
and any copies thereof from your system.
******************************************************************************
need for passing the data as parameters.
Common/common_name/var [,var_2] [...var_n]
Each unique common block would need to have a unique name. Additionally, if
wanted, but deftly not recommended by me, you could have different variable
names used for the same common block in multiple routines. But, you MUST
retain the order.
What I have done in the past is to create a file that contains all the
common block definitions and include this file in the Routine(s). This
allows you to make changes in one file and then recompile all the Routines
as needed. It also ensures that you are using the same variable name, thus
ensuring some semblance of consistency.
Thanks,
Lester
Lester F. Callif | Manager | BearingPoint, Inc. | Denver, Colorado
Mobile 303.596.8422 | Fax 707.988.0160
-----Original Message-----
From: Bruce William [mailto:bwilliam_ds@yahoo.com]
Sent: Friday, December 12, 2003 2:14 AM
To: datastage-users@oliver.com
Subject: Inter process row buffering & Common Block
Hi All,
We are on the process of migrating 4.2 to DS6.
While going through the design guide for DS6.. on
improving the performance using inter-process row
buffering, a note is given as follows:
You cannot use inter-process row-buffering if your job
uses COMMON blocks in transform functions to pass data
between stages. This is not recommended practice, and
it is advisable to redesign your job to use row
buffering rather than COMMON blocks.
What is a Common Block? Is it a Stage Variable?
Also want to know the experiences after enabling Inter
process Row Buffering.
with thanks,
Bruce
__________________________________
Do you Yahoo!?
New Yahoo! Photos - easier uploading and sharing.
http://photos.yahoo.com/
******************************************************************************
The information in this email is confidential and may be legally
privileged. Access to this email by anyone other than the
intended addressee is unauthorized. If you are not the intended
recipient of this message, any review, disclosure, copying,
distribution, retention, or any action taken or omitted to be taken
in reliance on it is prohibited and may be unlawful. If you are not
the intended recipient, please reply to or forward a copy of this
message to the sender and delete the message, any attachments,
and any copies thereof from your system.
******************************************************************************
<b>PLEASE READ</b>
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
Inter process row buffering & Common Block
Thanks for the prompt responses.
There are no COMMON blocks in our routines.
with thanks,
Bruce
--- chris.thornton@ascentialsoftware.com wrote:
> Hi Bruce,
>
> You should be fine with stage variables. A COMMON
> block is a way of sharing
> Basic variables between two or more DS Basic
> routines running in the same OS
> process, and of persisting variables between routine
> calls. You can check
> out the COMMON statement in the Basic manual if you
> want the full gory
> details.
>
> The reason we put the warning into the design guide
> was that some people
> were coding transformer routines which stored row
> and other data into a
> COMMON block as a backdoor way of passing data
> between two or more
> transformers. The row buffering enhancements changed
> the way that the
> DataStage internals worked, so that this technique
> was no longer valid. So
> if you are still worried, you need to check your
> called transformer routines
> for COMMON usage.
>
> Hope this helps
>
> - Chris Thornton
>
>
>
> -----Original Message-----
> From: Bruce William [mailto:bwilliam_ds@yahoo.com]
> Sent: 12 December 2003 09:14
> To: datastage-users@oliver.com
> Subject: Inter process row buffering & Common Block
>
>
> Hi All,
> We are on the process of migrating 4.2 to DS6.
>
> While going through the design guide for DS6.. on
> improving the performance using inter-process row
> buffering, a note is given as follows:
> You cannot use inter-process row-buffering if your
> job
> uses COMMON blocks in transform functions to pass
> data
> between stages. This is not recommended practice,
> and
> it is advisable to redesign your job to use row
> buffering rather than COMMON blocks.
>
> What is a Common Block? Is it a Stage Variable?
>
> Also want to know the experiences after enabling
> Inter
> process Row Buffering.
>
> with thanks,
> Bruce
>
>
> __________________________________
> Do you Yahoo!?
> New Yahoo! Photos - easier uploading and sharing.
> http://photos.yahoo.com/
>
__________________________________
Do you Yahoo!?
New Yahoo! Photos - easier uploading and sharing.
http://photos.yahoo.com/
There are no COMMON blocks in our routines.
with thanks,
Bruce
--- chris.thornton@ascentialsoftware.com wrote:
> Hi Bruce,
>
> You should be fine with stage variables. A COMMON
> block is a way of sharing
> Basic variables between two or more DS Basic
> routines running in the same OS
> process, and of persisting variables between routine
> calls. You can check
> out the COMMON statement in the Basic manual if you
> want the full gory
> details.
>
> The reason we put the warning into the design guide
> was that some people
> were coding transformer routines which stored row
> and other data into a
> COMMON block as a backdoor way of passing data
> between two or more
> transformers. The row buffering enhancements changed
> the way that the
> DataStage internals worked, so that this technique
> was no longer valid. So
> if you are still worried, you need to check your
> called transformer routines
> for COMMON usage.
>
> Hope this helps
>
> - Chris Thornton
>
>
>
> -----Original Message-----
> From: Bruce William [mailto:bwilliam_ds@yahoo.com]
> Sent: 12 December 2003 09:14
> To: datastage-users@oliver.com
> Subject: Inter process row buffering & Common Block
>
>
> Hi All,
> We are on the process of migrating 4.2 to DS6.
>
> While going through the design guide for DS6.. on
> improving the performance using inter-process row
> buffering, a note is given as follows:
> You cannot use inter-process row-buffering if your
> job
> uses COMMON blocks in transform functions to pass
> data
> between stages. This is not recommended practice,
> and
> it is advisable to redesign your job to use row
> buffering rather than COMMON blocks.
>
> What is a Common Block? Is it a Stage Variable?
>
> Also want to know the experiences after enabling
> Inter
> process Row Buffering.
>
> with thanks,
> Bruce
>
>
> __________________________________
> Do you Yahoo!?
> New Yahoo! Photos - easier uploading and sharing.
> http://photos.yahoo.com/
>
__________________________________
Do you Yahoo!?
New Yahoo! Photos - easier uploading and sharing.
http://photos.yahoo.com/
<b>PLEASE READ</b>
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.
Do not contact admin unless you have technical support or account questions. Do not send email or Private Messages about discussion topics to ADMIN. Contact the webmaster concerning abusive or offensive posts.