DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 614 matches
Author Message
 Topic: FTP to a Mainframe system
FranklinE

Replies: 1
Views: 44

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Oct 18, 2017 10:26 am   Subject: FTP to a Mainframe system
Most likely cause is extra control characters (CR or LF) at the end of the 80-byte record. View the mainframe file in hexadecimal mode, and if they are there you'll see them.

Another possible but l ...
Resolved
 Topic: Remove the First and Last Record of File in FTP
FranklinE

Replies: 6
Views: 110

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Oct 17, 2017 10:36 am   Subject: Remove the First and Last Record of File in FTP
Do the records have a unique identifier, which tells you what kind of record? If so, the transformer constraint can passively drop the header and trailer.

In the mainframe/COBOL world, record type ...
Resolved
 Topic: Remove the First and Last Record of File in FTP
FranklinE

Replies: 6
Views: 110

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Oct 17, 2017 8:27 am   Subject: Remove the First and Last Record of File in FTP
What's the next function after the FTP? If you're landing the file on the server, it's easier to edit the file with a script or with the file stage you are using.

If you are streaming the data dire ...
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 392

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 09, 2017 8:29 am   Subject: XML Error Handling on incomplete file
Marking this resolved, as it isn't an open issue here at this point. I just need to be prepared for future repeats of the incident.

Thanks to all who responded.
Workaround Reported
 Topic: How to validate a string of code
FranklinE

Replies: 11
Views: 4222

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 09, 2017 8:26 am   Subject: How to validate a string of code
Ditto to what UCDI posted, but there's an implied issue here that seems odd to me.

I get that transformer stages have large footprints. I get that there may be more efficient ways of doing things i ...
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 392

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 02, 2017 11:46 am   Subject: XML Error Handling on incomplete file
Transformation error mappings current settings:
Fatal -- reject
Error -- reject
Warning -- warning

Looks like it was right in front of me, the usual place for things to successfully hide from me ...
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 392

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 02, 2017 11:41 am   Subject: XML Error Handling on incomplete file
The job was migrated 8.7 to 11.5. I paid it no further attention after the successful compile and regression testing. After be careful what you wish for is be careful what you don't know. Wink
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 392

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 02, 2017 8:31 am   Subject: XML Error Handling on incomplete file
Thanks, Ernie. I'd hoped to get away with minimal coding changes, but the hierarchical stage, being new to our design, looks like a promising approach.
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 392

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Sep 29, 2017 9:24 am   Subject: XML Error Handling on incomplete file
Thanks for the tips on moving files, but that is not my question. We've corrected the cause of the incomplete file, I'm looking for advice on how to handle incomplete xml files in DataStage.

Murphy ...
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 392

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Sep 29, 2017 8:06 am   Subject: XML Error Handling on incomplete file
Yes, Paul, that's what we did. The file watcher was finding the file handle before the FTP completed. We fixed that.

I'm looking at this from a "generic" point of view. Every other file process I u ...
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 392

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Sep 29, 2017 7:27 am   Subject: XML Error Handling on incomplete file
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Additional info: Ernie is my hero :)
We have a situation which we solved on the file transfer side, but the behavior of the parallel job which processes the xml file leaves me confused. I've checked the manual, and the wording of the des ...
Workaround Reported
 Topic: How to validate a string of code
FranklinE

Replies: 11
Views: 4222

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Sep 27, 2017 11:14 am   Subject: How to validate a string of code
Much depends on what you do next when one of your tests is failed by the data being examined.

The simplest approach is to do each test separately. For example (pseudo-code expression):
If inChar&# ...
Resolved
 Topic: Grasping at straws: Unix-mainframe FTP performance
FranklinE

Replies: 9
Views: 300

PostForum: General   Posted: Mon Sep 25, 2017 12:42 pm   Subject: Grasping at straws: Unix-mainframe FTP performance
Final Update:

The performance changed 4 months after our migration from 8.7 to 11.5. This points to an internal "change" not associated with DataStage.

Sniffer trace on the Linux side of the FTP ...
Resolved
 Topic: Grasping at straws: Unix-mainframe FTP performance
FranklinE

Replies: 9
Views: 300

PostForum: General   Posted: Mon Sep 18, 2017 10:28 am   Subject: Grasping at straws: Unix-mainframe FTP performance
Andy,

We use FTP Enterprise exclusively. One clarifying item not posted previously is that all transfers are binary with undefined length Binary single column for the table definition on input and ...
Resolved
 Topic: COBOL CFD table import fails on character string format
FranklinE

Replies: 4
Views: 255

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Sep 18, 2017 9:01 am   Subject: COBOL CFD table import fails on character string format
I'm an East Coast COBOL dinosaur, ff. Started in 1990, and about 80% of my ETL development is for MF data dependencies.

I keep forgetting that the using MF data FAQ is linked in my post signature. ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours