DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 332 matches
Author Message
 Topic: Handling Junk Characters
UCDI

Replies: 3
Views: 117

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Jul 13, 2018 2:15 pm   Subject: Handling Junk Characters
to just remove the records entirely you can do it with a single convert, or possibly even more efficiently with 'alpha' if that fits the data need? A single convert, you convert all the valid chars ...
 Topic: Edit / Combine DSX with same target table?
UCDI

Replies: 9
Views: 369

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Jul 13, 2018 2:07 pm   Subject: Edit / Combine DSX with same target table?
if you do anything manually more than 2 or 3 times, its time to automate it. If none of the datastage ideas works for you, write something that will do the surgery for you.

And its not always t ...
 Topic: Best way to handle password parameters
UCDI

Replies: 9
Views: 86

PostForum: General   Posted: Mon Jul 02, 2018 9:19 am   Subject: Best way to handle password parameters
We do it that way. I can't comment if its the most secure way or not.

I just checked 11.5 and you can extract the password with the simplest imaginable attack. Nothing even interesting, just pu ...
 Topic: Edit / Combine DSX with same target table?
UCDI

Replies: 9
Views: 369

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Jun 27, 2018 10:38 am   Subject: Edit / Combine DSX with same target table?
dsx hacking is really only useful for very simple things like copying job parameters from one job to another ( a feature that is sadly lacking), or the occasional overarching search and replace of 1 w ...
Workaround Reported
 Topic: Recursive Fold ! Tricky
UCDI

Replies: 2
Views: 257

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Jun 08, 2018 1:00 pm   Subject: Recursive Fold ! Tricky
do you need to handle leap years?

that aside, transformer loops create a record per loop, and are handy but you already have all your records as you want them (right?) and are just grouping them s ...
 Topic: Job seqencer killing of other process.
UCDI

Replies: 3
Views: 178

PostForum: General   Posted: Thu Jun 07, 2018 11:01 am   Subject: Job seqencer killing of other process.
so you split to two, one of those goes into another seq, that one is set to any (?) and the outer one is set to all? This would mean that the any one can finish one thing, pass that to the all oute ...
 Topic: Convert Issue - Non printable characters ˙ and ›
UCDI

Replies: 9
Views: 588

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jun 07, 2018 8:17 am   Subject: Convert Issue - Non printable characters ˙ and ›
Heh... about that...

Look in your repository under stage types. There are a number of stages in there that are not in the palette. Its under Parallel/Processing/BasicTransformer

Be careful wit ...
 Topic: how to pass filename to sequential file stage in runtime
UCDI

Replies: 9
Views: 397

PostForum: General   Posted: Tue Jun 05, 2018 8:32 am   Subject: how to pass filename to sequential file stage in runtime
you can do it in a parallel job too if you use vb transformer or one of the others, I think there is a java one etc?

most of the time this sounds like a parallel job (with a parameter) invoked fro ...
 Topic: Would like to not create an empty csv file
UCDI

Replies: 48
Views: 10074

PostForum: General   Posted: Mon Jun 04, 2018 8:15 am   Subject: Would like to not create an empty csv file
it should be easy enough to know if you wrote any data and if not, delete the file?
 Topic: Convert Issue - Non printable characters ˙ and ›
UCDI

Replies: 9
Views: 588

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jun 04, 2018 8:11 am   Subject: Convert Issue - Non printable characters ˙ and ›
validate it with a Visual basic transformer, just convert each byte of the string to its numeric format with | between.
Resolved
 Topic: Remove multiple Ascii characters from input data
UCDI

Replies: 12
Views: 2210

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed May 30, 2018 11:17 am   Subject: Re: Remove multiple Ascii (>256) characters from input da
Char and convert are not supporting for the characters whose ASCII is greater than 256. What to do in this case?
not sure about datastage but 'most' software if told a 'text' file is in 1-byte code ( ...
Workaround Reported
 Topic: ETL Modeling suggestions
UCDI

Replies: 11
Views: 506

PostForum: General   Posted: Thu May 24, 2018 11:15 am   Subject: ETL Modeling suggestions
I shamefully do not know what tool generates our HTML models. I can find out. Its *probably* an IBM tool, since we are heavily invested there, but it could be something else entire.

Unrelated.. ...
 Topic: non-database sparse lookup alternative options
UCDI

Replies: 18
Views: 922

PostForum: General   Posted: Thu May 24, 2018 11:13 am   Subject: non-database sparse lookup alternative options
SSD was me thinking of dumping the file into ram as fast as possible. I think the lookup stage is doing something more beyond just a grab --- it may not be the disk read time, but the tool, if it too ...
 Topic: Parameterized password in Stored Procedure stage
UCDI

Replies: 12
Views: 566

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu May 24, 2018 11:01 am   Subject: Parameterized password in Stored Procedure stage
NICE, I looked but did not find this list.
Looks like the one I was using had at least 5 offending characters in it..

Also seems like login to the tool does not matter what you have, but inside ...
 Topic: non-database sparse lookup alternative options
UCDI

Replies: 18
Views: 922

PostForum: General   Posted: Wed May 23, 2018 2:25 pm   Subject: non-database sparse lookup alternative options
ok, that is what I understood also. If you are OK going outside of datastage and databases, sure, its very simple to make a C program do this, again looking at a memory mapped file, or eating up a bu ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours