Decimal value gives "Input buffer overrun at field"

ady · Post by **ady** » Thu Feb 08, 2007 1:03 pm

I am trying to import a seqential file created in a server job with Fixed width columns to a parallel job. I have specified its a fixed width file and used the same metadata.

The file created in the server job has 17 columns where 4 of them are "DECIMAL(17,3)" fields (Length 17, Scale 3). when I try to view the data in parallel i get the error :

##I TFCN 000001 13:58:43(000) <main_program>
DataStage XE Parallel Extender V7.0.0
Copyright (C) 2003, 1997 - 2002 Ascential Software, Inc.
All Rights Reserved

##I TOSH 000002 13:58:43(001) <main_program> orchgeneral: loaded
##I TOSH 000002 13:58:43(002) <main_program> orchsort: loaded
##I TOSH 000002 13:58:43(003) <main_program> orchstats: loaded
##I TFSC 000001 13:58:43(004) <main_program> APT configuration file: /ascential/datastage/70/UND/Ascential/DataStage/Configurations/default.apt
##W TCOS 000049 13:58:44(000) <main_program> Parameter specified but not used in flow: _OSH_PRINT_SCHEMAS
##W TCOS 000049 13:58:44(001) <main_program> Parameter specified but not used in flow: _MSAFilePath
##W TCOS 000049 13:58:44(002) <main_program> Parameter specified but not used in flow: _DataSetPath
##W TCOS 000049 13:58:44(003) <main_program> Parameter specified but not used in flow: _APT_CONFIG_FILE
##W TCOS 000049 13:58:44(004) <main_program> Parameter specified but not used in flow: DSProjectMapName
>##E TOIX 000139 13:58:44(006) <Sequential_File_16> Import validation failed:
>##E TFIG 000000 13:58:44(007) <Sequential_File_16> At field "ZEPBPLQTY": When validating import/export function: APT_GFIX_Decimal::validateParameters: Decimal "text" format is variable length and no external length is specified. Possibly you should specify an appropriate "width" property? External format: {text, padchar=32, nofix_zero, precision=17, scale=3, round=trunc_zero, ascii}
>##E TFIG 000000 13:58:44(008) <Sequential_File_16> At field "ZEPBPLQTY": Error validating import/export function
>##E TFIG 000000 13:58:44(009) <Sequential_File_16> At field "ZEPBORQTY": When validating import/export function: APT_GFIX_Decimal::validateParameters: Decimal "text" format is variable length and no external length is specified. Possibly you should specify an appropriate "width" property? External format: {text, padchar=32, nofix_zero, precision=17, scale=3, round=trunc_zero, ascii}
>##E TFIG 000000 13:58:44(010) <Sequential_File_16> At field "ZEPBORQTY": Error validating import/export function
>##E TFIG 000000 13:58:44(011) <Sequential_File_16> At field "ZEPBBAQTY": When validating import/export function: APT_GFIX_Decimal::validateParameters: Decimal "text" format is variable length and no external length is specified. Possibly you should specify an appropriate "width" property? External format: {text, padchar=32, nofix_zero, precision=17, scale=3, round=trunc_zero, ascii}
>##E TFIG 000000 13:58:44(012) <Sequential_File_16> At field "ZEPBBAQTY": Error validating import/export function
>##E TFIG 000000 13:58:44(013) <Sequential_File_16> At field "ZEPBFNQTY": When validating import/export function: APT_GFIX_Decimal::validateParameters: Decimal "text" format is variable length and no external length is specified. Possibly you should specify an appropriate "width" property? External format: {text, padchar=32, nofix_zero, precision=17, scale=3, round=trunc_zero, ascii}
>##E TFIG 000000 13:58:44(014) <Sequential_File_16> At field "ZEPBFNQTY": Error validating import/export function
>##E TOPK 000000 13:58:44(017) <_PEEK_IDENT_> Input dataset does not have field: "ZPROMID"
>##E TOPK 000000 13:58:44(018) <_PEEK_IDENT_> Input dataset does not have field: "ZOFFERID"
>##E TOPK 000000 13:58:44(019) <_PEEK_IDENT_> Input dataset does not have field: "ZSKITID"
>##E TOPK 000000 13:58:44(020) <_PEEK_IDENT_> Input dataset does not have field: "ZCUSTOMER"
>##E TOPK 000000 13:58:44(021) <_PEEK_IDENT_> Input dataset does not have field: "ZSHIP_TO"
>##E TOPK 000000 13:58:44(022) <_PEEK_IDENT_> Input dataset does not have field: "MATERIAL"
>##E TOPK 000000 13:58:44(023) <_PEEK_IDENT_> Input dataset does not have field: "ZMATERIAL"
>##E TOPK 000000 13:58:44(024) <_PEEK_IDENT_> Input dataset does not have field: "ZZKITUPC"
>##E TOPK 000000 13:58:44(025) <_PEEK_IDENT_> Input dataset does not have field: "ZDEALCODE"
>##E TOPK 000000 13:58:44(026) <_PEEK_IDENT_> Input dataset does not have field: "DOC_TYPE"
>##E TOPK 000000 13:58:44(027) <_PEEK_IDENT_> Input dataset does not have field: "ZEPBPLQTY"
>##E TOPK 000000 13:58:44(028) <_PEEK_IDENT_> Input dataset does not have field: "ZEPBORQTY"
>##E TOPK 000000 13:58:44(029) <_PEEK_IDENT_> Input dataset does not have field: "ZEPBBAQTY"
>##E TOPK 000000 13:58:44(030) <_PEEK_IDENT_> Input dataset does not have field: "ZEPBFNQTY"
>##E TOPK 000000 13:58:44(031) <_PEEK_IDENT_> Input dataset does not have field: "ZDS_DATE"
>##E TOPK 000000 13:58:44(032) <_PEEK_IDENT_> Input dataset does not have field: "ZDS_TIME"
>##E TOPK 000000 13:58:44(033) <_PEEK_IDENT_> Input dataset does not have field: "RECORDMODE"
>##E TFSR 000019 13:58:44(035) <main_program> Could not check all operators because of previous error(s)

Please help me sort out what I am missing here ?

I_Server_Whale · Post by **I_Server_Whale** » Thu Feb 08, 2007 1:30 pm

Check if POST1 helps.

DSguru2B · Post by **DSguru2B** » Thu Feb 08, 2007 1:33 pm

>##E TFIG 000000 13:58:44(009) <Sequential_File_16> At field "ZEPBORQTY": When validating import/export function: APT_GFIX_Decimal::validateParameters: Decimal "text" format is variable length and no external length is specified. Possibly you should specify an appropriate "width" property? External format: {text, padchar=32, nofix_zero, precision=17, scale=3, round=trunc_zero, ascii}

You sure you have specified it as Fixed width. THe error message is saying that its a variable length

michaeld · Post by **michaeld** » Tue Mar 06, 2007 9:22 am

I've seen this question posted many times and there were no complete answers. So I'm writing this for the sake of closure:

Importing fixed width decimal columns

Set these properties in the sequential file stage:

in the Format tab:

1)right click
2)select "Format as"
3)select "fixed-width records"

in the Columns tab:

For each Decimal column you need to set the expected field width.
To do this you double click on the gray button that indicates the
column number and it will bring up the "edit column meta data window".

In the properties section under the Decimal type branch, add the "Field width"
property and set it to the size of your decimal meta data. Example: If your decimal
is length:5 scale:2 then the width will be 7.

5 for whole number part
2 for decimal part
1 for the decimal (.)
1 for the sign (+/-)

I hope that helps.

DSguru2B · Post by **DSguru2B** » Tue Mar 06, 2007 9:35 am

Thanks Mike.