DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 328 matches
Author Message
Workaround Reported
 Topic: Recursive Fold ! Tricky
UCDI

Replies: 2
Views: 176

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Jun 08, 2018 1:00 pm   Subject: Recursive Fold ! Tricky
do you need to handle leap years?

that aside, transformer loops create a record per loop, and are handy but you already have all your records as you want them (right?) and are just grouping them s ...
 Topic: Job seqencer killing of other process.
UCDI

Replies: 3
Views: 127

PostForum: General   Posted: Thu Jun 07, 2018 11:01 am   Subject: Job seqencer killing of other process.
so you split to two, one of those goes into another seq, that one is set to any (?) and the outer one is set to all? This would mean that the any one can finish one thing, pass that to the all oute ...
 Topic: Convert Issue - Non printable characters ˙ and ›
UCDI

Replies: 9
Views: 387

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jun 07, 2018 8:17 am   Subject: Convert Issue - Non printable characters ˙ and ›
Heh... about that...

Look in your repository under stage types. There are a number of stages in there that are not in the palette. Its under Parallel/Processing/BasicTransformer

Be careful wit ...
 Topic: how to pass filename to sequential file stage in runtime
UCDI

Replies: 9
Views: 263

PostForum: General   Posted: Tue Jun 05, 2018 8:32 am   Subject: how to pass filename to sequential file stage in runtime
you can do it in a parallel job too if you use vb transformer or one of the others, I think there is a java one etc?

most of the time this sounds like a parallel job (with a parameter) invoked fro ...
 Topic: Would like to not create an empty csv file
UCDI

Replies: 48
Views: 9599

PostForum: General   Posted: Mon Jun 04, 2018 8:15 am   Subject: Would like to not create an empty csv file
it should be easy enough to know if you wrote any data and if not, delete the file?
 Topic: Convert Issue - Non printable characters ˙ and ›
UCDI

Replies: 9
Views: 387

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jun 04, 2018 8:11 am   Subject: Convert Issue - Non printable characters ˙ and ›
validate it with a Visual basic transformer, just convert each byte of the string to its numeric format with | between.
Resolved
 Topic: Remove multiple Ascii characters from input data
UCDI

Replies: 12
Views: 2028

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed May 30, 2018 11:17 am   Subject: Re: Remove multiple Ascii (>256) characters from input da
Char and convert are not supporting for the characters whose ASCII is greater than 256. What to do in this case?
not sure about datastage but 'most' software if told a 'text' file is in 1-byte code ( ...
Workaround Reported
 Topic: ETL Modeling suggestions
UCDI

Replies: 11
Views: 434

PostForum: General   Posted: Thu May 24, 2018 11:15 am   Subject: ETL Modeling suggestions
I shamefully do not know what tool generates our HTML models. I can find out. Its *probably* an IBM tool, since we are heavily invested there, but it could be something else entire.

Unrelated.. ...
 Topic: non-database sparse lookup alternative options
UCDI

Replies: 18
Views: 650

PostForum: General   Posted: Thu May 24, 2018 11:13 am   Subject: non-database sparse lookup alternative options
SSD was me thinking of dumping the file into ram as fast as possible. I think the lookup stage is doing something more beyond just a grab --- it may not be the disk read time, but the tool, if it too ...
 Topic: Parameterized password in Stored Procedure stage
UCDI

Replies: 12
Views: 438

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu May 24, 2018 11:01 am   Subject: Parameterized password in Stored Procedure stage
NICE, I looked but did not find this list.
Looks like the one I was using had at least 5 offending characters in it..

Also seems like login to the tool does not matter what you have, but inside ...
 Topic: non-database sparse lookup alternative options
UCDI

Replies: 18
Views: 650

PostForum: General   Posted: Wed May 23, 2018 2:25 pm   Subject: non-database sparse lookup alternative options
ok, that is what I understood also. If you are OK going outside of datastage and databases, sure, its very simple to make a C program do this, again looking at a memory mapped file, or eating up a bu ...
Workaround Reported
 Topic: ETL Modeling suggestions
UCDI

Replies: 11
Views: 434

PostForum: General   Posted: Wed May 23, 2018 2:11 pm   Subject: ETL Modeling suggestions
We use FastTrack for mapping columns and the rules that define the mapping. Nothing else, but its been great for just that one task of keeping the mapping public, up to date, centralized, etc. The ...
 Topic: Parameterized password in Stored Procedure stage
UCDI

Replies: 12
Views: 438

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed May 23, 2018 2:05 pm   Subject: Parameterized password in Stored Procedure stage
this could be TOTALLY unrelated and off the wall, but let me describe a recent issue I was having...

I was having my password constantly rejected for a teradata system. My password was rather leng ...
 Topic: non-database sparse lookup alternative options
UCDI

Replies: 18
Views: 650

PostForum: General   Posted: Tue May 22, 2018 8:14 am   Subject: non-database sparse lookup alternative options
what does non-database mean?

you can do a lookup in a 'binary' fixed-width file with a hashing algorithm.
If it will fit, you can do that in memory even faster, or a memory mapped file.

but ...
Resolved
 Topic: set default value on look up failure
UCDI

Replies: 4
Views: 344

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu May 17, 2018 11:05 am   Subject: set default value on look up failure
if dealing with 'very' large volumes and few failed lookups you may find it more efficient to reject them and only transform the reject link, then funnel back. But generally, the above is the best wa ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours