DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 618 matches
Author Message
 Topic: Preview Webinar for new DS release
FranklinE

Replies: 0
Views: 14

PostForum: General   Posted: Fri Nov 17, 2017 1:44 pm   Subject: Preview Webinar for new DS release
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Additional info: Let's discuss it here
I want to encourage everyone who attends the webinar to discuss the new release here. Mostly, it's so I have a chance to see myself write (hear myself speak).
Laughing
Resolved
 Topic: Dynamically export files based on Config table
FranklinE

Replies: 14
Views: 129

PostForum: General   Posted: Thu Nov 16, 2017 12:19 pm   Subject: Dynamically export files based on Config table
I have a loop that uses a list file with parameters, an index (increasing integer, controls the number of loops) and a file name. Each instance of the loop calls a parallel job to FTP get the named fi ...
 Topic: Remove multiple special characters from leading and trailing
FranklinE

Replies: 16
Views: 321

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Nov 15, 2017 8:56 am   Subject: Remove multiple special characters from leading and trailing
You have a logical paradox in your requirements: certain characters are to be removed, except when they are not to be removed. The difference is positional, which is why it's a paradox.

Why must yo ...
 Topic: execute ds job through command line with env file
FranklinE

Replies: 5
Views: 116

PostForum: General   Posted: Wed Nov 01, 2017 1:17 pm   Subject: execute ds job through command line with env file
You should be using a Unix script. If you are trying to manually create the command line, it will not work as you desire.

Sorry, but I won't do your scripting work for you, so no syntax provided.
...
 Topic: FTP to a Mainframe system
FranklinE

Replies: 1
Views: 150

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Oct 18, 2017 10:26 am   Subject: FTP to a Mainframe system
Most likely cause is extra control characters (CR or LF) at the end of the 80-byte record. View the mainframe file in hexadecimal mode, and if they are there you'll see them.

Another possible but l ...
Resolved
 Topic: Remove the First and Last Record of File in FTP
FranklinE

Replies: 6
Views: 291

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Oct 17, 2017 10:36 am   Subject: Remove the First and Last Record of File in FTP
Do the records have a unique identifier, which tells you what kind of record? If so, the transformer constraint can passively drop the header and trailer.

In the mainframe/COBOL world, record type ...
Resolved
 Topic: Remove the First and Last Record of File in FTP
FranklinE

Replies: 6
Views: 291

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Oct 17, 2017 8:27 am   Subject: Remove the First and Last Record of File in FTP
What's the next function after the FTP? If you're landing the file on the server, it's easier to edit the file with a script or with the file stage you are using.

If you are streaming the data dire ...
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 653

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 09, 2017 8:29 am   Subject: XML Error Handling on incomplete file
Marking this resolved, as it isn't an open issue here at this point. I just need to be prepared for future repeats of the incident.

Thanks to all who responded.
Workaround Reported
 Topic: How to validate a string of code
FranklinE

Replies: 11
Views: 11763

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 09, 2017 8:26 am   Subject: How to validate a string of code
Ditto to what UCDI posted, but there's an implied issue here that seems odd to me.

I get that transformer stages have large footprints. I get that there may be more efficient ways of doing things i ...
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 653

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 02, 2017 11:46 am   Subject: XML Error Handling on incomplete file
Transformation error mappings current settings:
Fatal -- reject
Error -- reject
Warning -- warning

Looks like it was right in front of me, the usual place for things to successfully hide from me ...
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 653

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 02, 2017 11:41 am   Subject: XML Error Handling on incomplete file
The job was migrated 8.7 to 11.5. I paid it no further attention after the successful compile and regression testing. After be careful what you wish for is be careful what you don't know. Wink
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 653

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 02, 2017 8:31 am   Subject: XML Error Handling on incomplete file
Thanks, Ernie. I'd hoped to get away with minimal coding changes, but the hierarchical stage, being new to our design, looks like a promising approach.
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 653

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Sep 29, 2017 9:24 am   Subject: XML Error Handling on incomplete file
Thanks for the tips on moving files, but that is not my question. We've corrected the cause of the incomplete file, I'm looking for advice on how to handle incomplete xml files in DataStage.

Murphy ...
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 653

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Sep 29, 2017 8:06 am   Subject: XML Error Handling on incomplete file
Yes, Paul, that's what we did. The file watcher was finding the file handle before the FTP completed. We fixed that.

I'm looking at this from a "generic" point of view. Every other file process I u ...
Resolved
 Topic: XML Error Handling on incomplete file
FranklinE

Replies: 11
Views: 653

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Sep 29, 2017 7:27 am   Subject: XML Error Handling on incomplete file
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Additional info: Ernie is my hero :)
We have a situation which we solved on the file transfer side, but the behavior of the parallel job which processes the xml file leaves me confused. I've checked the manual, and the wording of the des ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours