Search found 79 matches

by jcthornton
Mon Oct 18, 2010 2:14 pm
Forum: General
Topic: Link Naming Standard
Replies: 11
Views: 7553

I'll echo what has been said above: there are many, many, many different naming standards that can be used for links and stages. The best ones are internally consistent, easy to read (on the canvas, in the log, and in reports), and forbid duplicate link names within a single job. I've seen a wide va...
by jcthornton
Mon Oct 18, 2010 2:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC taking longtime to unload the data
Replies: 6
Views: 9705

I'd check the version with just the copy stage against the original version. Replacing a transformer with a copy (when the copy has no output links) won't cause any new errors. If you are not getting that error in the original, then something has to be different that is causing the error in the test...
by jcthornton
Mon Oct 18, 2010 1:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join
Replies: 4
Views: 3376

Hi Rajesh, Your issue is that all the columns are set to Not Null. Thus, there will never be a null value - even when the outer join is missing one of the inputs. What you want to be checking for instead of Null is the default value for the column. The other way to get around that is to set your out...
by jcthornton
Mon Oct 18, 2010 1:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Adding rows to a single column
Replies: 8
Views: 5428

With the definition of the input given, I hope the correct order is guaranteed on the input, otherwise the addresses could get a bit jumbled. On a second note, is there a reason for recommending just one node? It should work just fine as long as your partitioning (I would probably use Hash partition...
by jcthornton
Sat Oct 16, 2010 10:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Substract Business Days
Replies: 5
Views: 3581

I don't know the structure of your business-day table, but if it has a surrogate key - and you can have that key created as a monotonically increasing number by day, then your lookup becomes an easy one. Just grab the date with a SK that is 3 less than the SK for the input date. This can be faked in...
by jcthornton
Fri Oct 15, 2010 11:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: self join
Replies: 4
Views: 2858

dsa,

Those options are each a different way to perform the same task. You only need 1 of the 3, not all 3.
by jcthornton
Fri Oct 15, 2010 10:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: self join
Replies: 4
Views: 2858

I am curious if this is an interview question or if something in particular has prompted this??? Looking at your other posts it is hard to tell since it looks like you have some knowledge of the tool, but with curious gaps. I am hoping that this means you are working at a licensed client and are bei...
by jcthornton
Fri Oct 15, 2010 10:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC taking longtime to unload the data
Replies: 6
Views: 9705

How fast does the ODBC stage run if you connect it to a copy (and nothing else)?

Are you sure it is the transformer that is the problem?
by jcthornton
Wed Oct 13, 2010 12:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: HOW can i perform FULL OUTER JOIN in DataStage
Replies: 4
Views: 9149

What you are seeing is expected behavior. If you don't need to identify what source your data came from (source 1, source 2, or both) then you just use a transformer after the join. In the transformer, your key derivations become: chat_id: if IsNull(1chat_id) then 2chat_id else 1chat_id contact_id: ...
by jcthornton
Sat Oct 09, 2010 5:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: FTP PX Stage - UTF conversion
Replies: 5
Views: 4428

Would it be possible to switch your FTP mode to binary? It sounds like the problems are due to trying to send a non-ascii file as ascii. chowdary_kish, you would be better served starting your own thread if a search doesn't give you the answer you need. Your problem is not identical to the original ...
by jcthornton
Sat Oct 09, 2010 4:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Regarding Bulk loading into SAP through BAPI stage
Replies: 1
Views: 1223

There are way too many factors that play into the performance of any job for a general question to receive a truly meaningful and helpful answer. The more information you can supply, the better. What the environment is, what version of R/3, which BAPI is being called, how many nodes, etc., etc., etc...
by jcthornton
Wed Oct 06, 2010 1:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Split one row in multiple based on identifier
Replies: 6
Views: 3508

Still doable, although it complicates things a bit more. Any other missing bits of information or requirements? My first thought is to build the job as: Input->Transformer->Funnel->Switch->Datasets The transformer would have 10 outputs so it can handle any combination of A and B identifiers in a sin...
by jcthornton
Sun Jun 27, 2010 8:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Do you use best practices in DataStage?
Replies: 4
Views: 3132

I'll be a little bit surprised if you get any significant numbers who say they don't use best practices. That said, best practices will cover a wide range of tasks - from development, to change management, to deployment, to administration and more. I would expect that best practices that most people...
by jcthornton
Fri Jun 25, 2010 4:46 pm
Forum: Enhancement Wish List
Topic: Debugging: Add Peek without redoing links
Replies: 3
Views: 17477

Thanks Ray. That is useful. My original thinking was about working on a monstrosity (100+ stages and constrained not to split it into smaller jobs) only want a peek on a small subset of the links - maybe even just 1 or 2. A second scenario came into my head where this idea would also be useful: Deal...
by jcthornton
Fri Jun 25, 2010 3:56 pm
Forum: Enhancement Wish List
Topic: Debugging: Add Peek without redoing links
Replies: 3
Views: 17477

Debugging: Add Peek without redoing links

One of the frustrations that I encounter when doing debugging/troubleshooting is adding Peeks onto existing links. Depending on what stages are on the end of a link that you want to add a peek to - especially if you make changes in a less than optimal order - it can require redoing a lot of work [an...