Filter Condition failed in Sequential File
Moderators: chulett, rschirm, roy
Filter Condition failed in Sequential File
Hi All,
one of my job read data using sequential file stage from .csv file which contains a header record followed by actual data.
so we are using
grep -v -e "^01" command in the "filter" options of the sequential file
now my job failed due to no rows(data) in my input file except the header record.
so,Jobs aborts with message
Filter status 256
Filter process failed: 1
Import error at record 0
any suggestions to overcome this?
Thanks in advance
Edi
one of my job read data using sequential file stage from .csv file which contains a header record followed by actual data.
so we are using
grep -v -e "^01" command in the "filter" options of the sequential file
now my job failed due to no rows(data) in my input file except the header record.
so,Jobs aborts with message
Filter status 256
Filter process failed: 1
Import error at record 0
any suggestions to overcome this?
Thanks in advance
Edi
Hello Edi,
instead of doing a UNIX filter, just define the sequential file details as "First line is column names" and DS will ignore the first one.
instead of doing a UNIX filter, just define the sequential file details as "First line is column names" and DS will ignore the first one.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
dsedi,
the first line is not used for column names in Px jobs, it is just a flag you can specify in the Sequential file stage, Properties -> Options -> First Line is Column Names; this basically tell Ds to ignore the first line. It doesn't really matter what the contents are.
the first line is not used for column names in Px jobs, it is just a flag you can specify in the Sequential file stage, Properties -> Options -> First Line is Column Names; this basically tell Ds to ignore the first line. It doesn't really matter what the contents are.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
Edi,
In sequential file stage, click on "Outputs", then "Format" and click the box (left hand side)- "first line is column names".
In sequential file stage, click on "Outputs", then "Format" and click the box (left hand side)- "first line is column names".
dsedi wrote:Thanks ArndW !
but first line in data file doesn't have column names
it have some metadata information about the file (anyway it was not used in the particular job).
and where do i need to specify the option "First line is column names" while reading?
Edi
Thanks....
but this is Parallel Extender/PX) JOb
Not the server Job!
i am able to find "first line is column names" option in Dsserver JOb sequential stage..not in PX sequential file stage..
well ..is there any way to instruct my job to continue even if my greb command output is null..(i.e no data)..
Dsedi
but this is Parallel Extender/PX) JOb
Not the server Job!
i am able to find "first line is column names" option in Dsserver JOb sequential stage..not in PX sequential file stage..
well ..is there any way to instruct my job to continue even if my greb command output is null..(i.e no data)..
Dsedi
dsedi
look carefully at your Parallel Job Sequential file stage. It is there, just as I described. The Server sequential file stage has a click-box, the Px stage has a textual description on the left, and then lets you change on the right when you activate it.
look carefully at your Parallel Job Sequential file stage. It is there, just as I described. The Server sequential file stage has a click-box, the Px stage has a textual description on the left, and then lets you change on the right when you activate it.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>