DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 272 matches
Author Message
 Topic: Custom Routine Issues
UCDI

Replies: 5
Views: 152

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Dec 11, 2017 9:38 am   Subject: Custom Routine Issues
datastage seems to prefer C-strings (null terminated char *)

you could use std::string here, (not APT_string whatever that is, looks like datastage extension but I don't know why it exists or what ...
 Topic: Using Parameters in the File in User defined SQL
UCDI

Replies: 4
Views: 119

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Dec 07, 2017 8:57 am   Subject: Using Parameters in the File in User defined SQL
our team routinely generates sql this way:
a user variable stage contains the parameterized sql
a flat file stage writes a 'this run' version of populated sql to a file on the server
the connector ...
 Topic: Batch ID in Datastage
UCDI

Replies: 19
Views: 338

PostForum: General   Posted: Tue Dec 05, 2017 2:19 pm   Subject: Batch ID in Datastage
you can parse the current timestamp or job start timestamp out (remove : chars) and put it into the invocation id field which you can then see in the debugging tools and if you want you can store that ...
 Topic: How to remove the empty tags in Hierarchical Stage
UCDI

Replies: 5
Views: 195

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Dec 05, 2017 2:14 pm   Subject: How to remove the empty tags in Hierarchical Stage
there is a checkbox in the stage somewhere to eliminate empty tags.
I can't recall exactly where.
 Topic: Can DataStage create Basic graphs and visualizations?
UCDI

Replies: 5
Views: 273

PostForum: General   Posted: Wed Nov 15, 2017 12:20 pm   Subject: Can DataStage create Basic graphs and visualizations?
you can dump an excel file which has a lot of built-in charting technology.
but that is sort of backwards because excel can tap a database directly, reusing the same file with fresh data.

you ...
 Topic: Schema reconciliation detected a size mismatch for column
UCDI

Replies: 14
Views: 683

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Nov 15, 2017 12:15 pm   Subject: Schema reconciliation detected a size mismatch for column
similar but saying it explicitly:
4) you can cast it in the extract sql to match the target format
 Topic: Remove multiple special characters from leading and trailing
UCDI

Replies: 16
Views: 725

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Nov 15, 2017 12:09 pm   Subject: Remove multiple special characters from leading and trailing
I'm with him ^^^

but if it turns out that you need some awful convoluted logic to do this, write a C or basic routine. Trying to drop a 15+ deep nested replace with if-thens in the middle is goi ...
Resolved
 Topic: Problem in reading .csv file
UCDI

Replies: 5
Views: 305

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Nov 10, 2017 10:01 am   Subject: Problem in reading .csv file
several things you may be able to do...

- you could not use numeric commas (123456 is written 123456 not 123,456)
- you could use something other than , for the fields (tab, |, #, whatever)
- yo ...
 Topic: Loading a full file into a field?
UCDI

Replies: 10
Views: 669

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Nov 01, 2017 9:12 am   Subject: Loading a full file into a field?
This may be a silly question, but your file seems very much like structured data to me... why do you want to load the FILE into the database when the DATA into a TABLE would be best?

You could add ...
 Topic: Loading a full file into a field?
UCDI

Replies: 10
Views: 669

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Oct 26, 2017 12:12 pm   Subject: Loading a full file into a field?
this is not as easy as I thought it would be.

Can you pipe the output of cat (unix) or type (windows) into it?
 Topic: Automate loading flat files
UCDI

Replies: 8
Views: 458

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Oct 11, 2017 11:53 am   Subject: Automate loading flat files
I think IA can do this sort of, and I think IA can read files instead of databases, but not 100% sure as I don't use IA.

It would be fairly trivial to do this in an external program.
I mean, th ...
 Topic: Automate loading flat files
UCDI

Replies: 8
Views: 458

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Oct 11, 2017 8:42 am   Subject: Automate loading flat files
what DO you have? Does the flat file schema match a target or other database that has meta-data you could import?

if it matches the target you can export the target table def and use your perl or ...
 Topic: Decimal value is out of range
UCDI

Replies: 6
Views: 1051

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 09, 2017 12:08 pm   Subject: Decimal value is out of range
just bits ...
-1, if dumped without any logic into unsigned int, will give the maximum value of that int.

That is if you put -1 into an unsigned byte without any error checks you get 255, and if ...
Workaround Reported
 Topic: How to validate a string of code
UCDI

Replies: 11
Views: 13257

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 09, 2017 11:28 am   Subject: How to validate a string of code
I think what it comes down to is that 'rapid' is subjective. I can write a C++ or basic routine to do advanced string processing in a couple of min and have it debugged and delivered inside an hour ( ...
Resolved
 Topic: manage lookup table by datastage
UCDI

Replies: 9
Views: 468

PostForum: General   Posted: Thu Oct 05, 2017 9:17 am   Subject: manage lookup table by datastage
or directly from a dataset / file. But you don't need both, either a file or a table.
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours