DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 65 matches
Author Message
 Topic: Profile all Jobs end-to-end
djm

Replies: 16
Views: 10281

PostForum: IBM® Infosphere DataStage Server Edition   Posted: Sat Nov 25, 2006 8:28 pm   Subject: Profile all Jobs end-to-end
Rod,

you are correct, the purpose of single_row_sc is to generate a single row. You have two choices:
(a) In the zip file there are three objects beginning with the name "singlerow". By default, " ...
 Topic: Recursive Row Split and Append
djm

Replies: 10
Views: 3398

PostForum: IBM® Infosphere DataStage Server Edition   Posted: Tue Mar 28, 2006 4:00 pm   Subject: Recursive Row Split and Append
Probably a dopey question, given you have flagged that your server is Windows, but just in case you have flagged your DataStage Client as Windows but your DataStage server is UNIX, there is a simple s ...
 Topic: Horizontal Pivot
djm

Replies: 10
Views: 2739

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Mar 23, 2006 11:31 pm   Subject: Horizontal Pivot
Ahh, but my programming layout style would have laid out your "core" code like so:
{
gsub(/|/, "\n" $1 OFS);
print $0;
}
for maintainability reasons.

I don't kn ...
 Topic: Horizontal Pivot
djm

Replies: 10
Views: 2739

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Mar 23, 2006 7:04 pm   Subject: Horizontal Pivot
A much simpler awk script that that listed above would achieve what you need. Have a look at [url=http://www.dsxchange.com/viewtopic.php?t=98948]this thread. There is a reply that I contributed that i ...
 Topic: Data Manipulation in a Flat file
djm

Replies: 15
Views: 4274

PostForum: IBM® Infosphere DataStage Server Edition   Posted: Wed Mar 08, 2006 1:33 pm   Subject: Data Manipulation in a Flat file
An awk script is one way. e.g.

awk -F, '
{
for ( i = 1; ( i <= NF ); i++ )
{
print $0 "$" $i
}
}' yourfile > new file

Testing ...
 Topic: How can perform incremental loading without using key
djm

Replies: 2
Views: 979

PostForum: IBM® Infosphere DataStage Server Edition   Posted: Tue Mar 07, 2006 3:11 am   Subject: How can perform incremental loading without using key
Satish,

The solution I am suggesting is on the basis that the following understanding is correct. Namely, that you have two files:
A: The "master" which represents the current state and
B: Th ...
 Topic: Lookup from delimited sequential file
djm

Replies: 9
Views: 2267

PostForum: IBM® Infosphere DataStage Server Edition   Posted: Mon Mar 06, 2006 11:49 pm   Subject: Lookup from delimited sequential file
An alternative approach may be to preprocess the file using UNIX commands, deriving a commonly formatted record per line in the file. The target would be to have each row in the file with two columns; ...
 Topic: Job Log - get the entire content using DS job
djm

Replies: 12
Views: 11941

PostForum: IBM® Infosphere DataStage Server Edition   Posted: Sat Mar 04, 2006 3:36 am   Subject: Correction to JobLogGet
Update to JobLogGet routine to resolved issue identified by vaby in the original code. Thank to vladimir for persevering while I found the time to correct the problem.

The complete code in this pos ...
 Topic: Select First Record only
djm

Replies: 12
Views: 3072

PostForum: IBM® Infosphere DataStage Server Edition   Posted: Wed Mar 01, 2006 2:08 am   Subject: Select First Record only
And if your flavour of unix does not have "-s" for stable sorting, you may be able to use "sort -k1,1 -u" instead. According to the man pages I have seen, this will suppress duplicates based solely on ...
 Topic: Select First Record only
djm

Replies: 12
Views: 3072

PostForum: IBM® Infosphere DataStage Server Edition   Posted: Wed Mar 01, 2006 12:00 am   Subject: Select First Record only
Belatedly throwing in an approach using UNIX ...


sort -s -k1,1 yourfile |
awk '
BEGIN \
{
prev_key = "";
}
( $1 != prev_key ) \
...
 Topic: how to execute unix sleep function in datastage
djm

Replies: 3
Views: 2009

PostForum: IBM® Infosphere DataStage Server Edition   Posted: Wed Feb 22, 2006 2:11 am   Subject: how to execute unix sleep function in datastage
If all you are looking to do is pause for 60 seconds, the after job sub-routine command simply needs to be:

sleep 60

i.e. there is no need to write your own shell script wrapper to the sleep com ...
 Topic: Tricky Requirement
djm

Replies: 4
Views: 1654

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Feb 13, 2006 4:03 am   Subject: Tricky Requirement
If you end up having to write a UNIX shell script as part of your solution, one command that you are likely to find useful is "find" ("man find" for more details). Although this can be a tricky comman ...
 Topic: reconciliation of source data and target data
djm

Replies: 13
Views: 7084

PostForum: IBM® Infosphere DataStage Server Edition   Posted: Thu Jan 19, 2006 3:24 pm   Subject: reconciliation of source data and target data
I was trying not to presume about any flavour of UNIX tools on a Windows server since that is not necessarily a standard scenario. But suggest away I will ...

There could be a fairly straight forwa ...
 Topic: reconciliation of source data and target data
djm

Replies: 13
Views: 7084

PostForum: IBM® Infosphere DataStage Server Edition   Posted: Thu Jan 19, 2006 4:14 am   Subject: reconciliation of source data and target data
Yui,

can you just confirm for me that, as per your message description, your DataStage server is a Windows server and not a UNIX server. If it is a Windows server I don't have an alternative to off ...
 Topic: Job status for running
djm

Replies: 15
Views: 7247

PostForum: IBM® Infosphere DataStage Server Edition   Posted: Thu Jan 12, 2006 1:34 pm   Subject: Job status for running
Indrani,

My suggestion depends on which of the following you are trying to achieve:

1) Get information about a particular job.
A) Try looking at the documentation on the "dsjob" command in ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours