Incomplete record schema when using OSH_PRINT_SCHEMAS
Posted: Sun May 20, 2018 10:57 pm
Hi,
I need to print record schema for each operator in the job, mainly the record schema of the final target (sequential file).
Job Design:
CFF Stage (Source) --> Transformer --> Seq File (Target)
But the source file record has more than 10000 columns and when I am using OSH_PRINT_SCHEMAS in job, I do not get complete schema and for source stage itself record schema gets truncated after 256000 characters. It was supposed to give schema for each stage/operator.
Is there any way I can increase this limit (I may need to print up to 3 million characters) or print schema for target stage only?
Thanks,
I need to print record schema for each operator in the job, mainly the record schema of the final target (sequential file).
Job Design:
CFF Stage (Source) --> Transformer --> Seq File (Target)
But the source file record has more than 10000 columns and when I am using OSH_PRINT_SCHEMAS in job, I do not get complete schema and for source stage itself record schema gets truncated after 256000 characters. It was supposed to give schema for each stage/operator.
Is there any way I can increase this limit (I may need to print up to 3 million characters) or print schema for target stage only?
Thanks,