XML Hierarchical Stage Produces No Rows
Posted: Fri Jun 22, 2018 10:02 am
I have successfully read on 4 XSD files
I have 1 xml source test file to read in.
The source xml file has really 2 parts, one called AcademicRecordBatch which has basic Sender/Destination info that does not change; I can read in that. it produces rows in a seperate job. I
The second part has high school transcript data, called HighSchoolTranscript. I have problems with this part. This is in a separate job.
I am using 2 jobs because I couldn't get the union parser stage to work without hanging the system.
My job is simple to start; it goes from a Hierarchical stage right to a peek stage just to get things going. Problem is that the highschool job compiles but produces no rows. To start it is only mapping firstname, lastname.
Sometimes I run into a scalar error like this:
com.ibm.e2.core.exceptions.E2IllegalStateException: CDIER0835E: In step XML_Parser, the Hierarchical Data stage tried to assign the value true to the {http://www.ibm.com/e2/reserved}@@isPresent scalar element, but the element already has the value true. Possible mapping error involving ListToGroup. The parent list element for the scalar element is AcademicSummary.
Test completed
Not sure if warnings prevent the rows from being read; but I am getting a successful compiles but no rows simple or complex; I know it is rather vague but any thoughts on where to debug/start? I have tried chunking with successful compilations but still no rows.
Thanks for the help in advance.
This is the source xml file
I have 1 xml source test file to read in.
The source xml file has really 2 parts, one called AcademicRecordBatch which has basic Sender/Destination info that does not change; I can read in that. it produces rows in a seperate job. I
The second part has high school transcript data, called HighSchoolTranscript. I have problems with this part. This is in a separate job.
I am using 2 jobs because I couldn't get the union parser stage to work without hanging the system.
My job is simple to start; it goes from a Hierarchical stage right to a peek stage just to get things going. Problem is that the highschool job compiles but produces no rows. To start it is only mapping firstname, lastname.
Sometimes I run into a scalar error like this:
com.ibm.e2.core.exceptions.E2IllegalStateException: CDIER0835E: In step XML_Parser, the Hierarchical Data stage tried to assign the value true to the {http://www.ibm.com/e2/reserved}@@isPresent scalar element, but the element already has the value true. Possible mapping error involving ListToGroup. The parent list element for the scalar element is AcademicSummary.
Test completed
Not sure if warnings prevent the rows from being read; but I am getting a successful compiles but no rows simple or complex; I know it is rather vague but any thoughts on where to debug/start? I have tried chunking with successful compilations but still no rows.
Thanks for the help in advance.
This is the source xml file
Code: Select all
<?xml version="1.0" encoding="UTF-8"?>
<AcRecBat:AcademicRecordBatch xmlns:AcRecBat="urn:org:pesc:message:AcademicRecordBatch:v2.1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:org:pesc:message:AcademicRecordBatch:v2.1.0 AcademicRecordBatch_v2.1.xsd">
<BatchEnvelope>
<BatchID>00000001</BatchID>
<BatchDateTime>2018-01-31T11:06:35-07:00</BatchDateTime>
<BatchDeliveryMethod>DeliverWhole</BatchDeliveryMethod>
<SourceAgency>
<Organization>
<APAS>SK00000000</APAS>
<LocalOrganizationID>
<LocalOrganizationIDCode>SK00000000</LocalOrganizationIDCode>
<LocalOrganizationIDQualifier>SK</LocalOrganizationIDQualifier>
</LocalOrganizationID>
<OrganizationName>Saskatchewan Ministry of Education</OrganizationName>
<Contacts>
<Phone>
<AreaCityCode>306</AreaCityCode>
<PhoneNumber>7876012</PhoneNumber>
</Phone>
<Email>
<EmailAddress>student.records@gov.sk.ca</EmailAddress>
</Email>
</Contacts>
</Organization>
</SourceAgency>
<DestinationAgency>
<Organization>
<PSIS>47004000</PSIS>
<LocalOrganizationID>
<LocalOrganizationIDCode>47004000</LocalOrganizationIDCode>
<LocalOrganizationIDQualifier>SK</LocalOrganizationIDQualifier>
</LocalOrganizationID>
<OrganizationName>University of Regina</OrganizationName>
</Organization>
</DestinationAgency>
</BatchEnvelope>
<BatchContent>
<HSTrn:HighSchoolTranscript xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:n1="http://www.altova.com/samplexml/other-namespace" xmlns:HSTrn="urn:org:pesc:message:HighSchoolTranscript:v1.5.0" xsi:schemaLocation="urn:org:pesc:message:HighSchoolTranscript:v1.5.0 HighSchoolTranscript_v1.5.0.xsd">
<TransmissionData>
<DocumentID>2018-01-3111061</DocumentID>
<CreatedDateTime>2018-01-31T11:06:35-07:00</CreatedDateTime>
<DocumentTypeCode>StudentRequest</DocumentTypeCode>
<TransmissionType>Original</TransmissionType>
<Source>
<Organization>
<APAS>SK00000000</APAS>
<LocalOrganizationID>
<LocalOrganizationIDCode>SK00000000</LocalOrganizationIDCode>
<LocalOrganizationIDQualifier>SK</LocalOrganizationIDQualifier>
</LocalOrganizationID>
<OrganizationName>Saskatchewan Ministry of Education</OrganizationName>
<Contacts>
<Phone>
<AreaCityCode>306</AreaCityCode>
<PhoneNumber>7876012</PhoneNumber>
</Phone>
<Email
