DSXchange

edit: corrected sample code to show actual DSSetServerParams( ) I was using. I'm running datastage + client on a virtual machine: ds 8.5 fixpack 1, Windows Server 2008 (64 bit). Summary: Using C++ I can call connect with DSGetProjectList( ) provided I don't use DSSetServerParams( ); I'd very much li...

Jobs are quite complex in terms of functional requirements, thus it leads to complex jobs with a lot of aggregations, sorts, lookups... That is an interesting problem; please post what you end up doing. Suggestion: job start up times took a hit with version 8 when using dsjob or dsapi to do it; it ...

Hi, first time i want to run this job using script or manually . After that, regardless of the result of the run(it may return 1,2,or 3), the job has to run again and this loop should be repeated. Is it possible to achieve this in datastage without using any schedulers like crontab or TWS? Have you...

After updating 8.5 fixpack1 on InfoServer ( fixpack_FP1_IS85_windows_8500.ispkg ) and Blueprint Director Client fixpack (BLUEPRINT.ispkg ) it still failed to connect. On a whim, just before trying a standalone vm to see if that connects, I tried re-installing Blueprint Director. It wanted a differen...

Another data point: I just upgraded to 8.5 fixpack 1 and was able to connect to metadata workbench 8.5, but not the datastage engine 8.5. I haven't tried connecting to other datastage versions yet. note: All of tiers and clients are running on the same machine (just a test vm: win2008 64-bit, sqlser...

If the statements don't need to be ordered, you could use a copy stage to feed the same data to multiple db-connectors: e.g. 1 statement per connector. By the way, how many sql statements is "many"? 10? 500? 1,000? More? And what kinds of statements... Lots of insert statements? Or conditi...

hi...well its simple job with one to one mapping with over 56k records...the source and target are both sql server...with only one source table and one target table Over 56K records? So more than 56,000 records but less than what... 57,000 records? At 10/second, that gives you 5,600 seconds; so it ...

I'd suggest starting with telling us how your host-computer doing. If you're already running at 100% CPU utilization, it may be time for a hardware upgrade (I see you're on windows, so I suggest that you start with googling "task manager"). Next, I suggest you say a little about your job d...

"the only thing we have to consider" Sounds like you have it solved already :-) Your example reminds me of an in-order tree traversal. Here's the original data, reformatted a little - it was kind of noisy (I stripped zeros & the ABC XYZ parts, which may not be relevant). Anyway, I find...

Thank you!
Those are some pretty good reasons that I didn't know about.
Connectors sound more robust and more productive for DataStage developers to work with.
John

note: Job Type actually for both Server & Parallel jobs. note: OS Type actually for Windows & Unix. ("All Of The Above" not an option in the Job Type & OS Type lists :-) ) So I was RTFM'ing about Connectors (excerpt below) and I started wondering why IBM claims that Connectors ...

So far the only ideas I have had are: 1) Maybe put an arbitrary limit of 60 days on "find first log entry" Well, adding a 60 day limit doesn't seem to makes no discernable difference. I've noticed I will get a flurry of output for 5 or 10 jobs, then it will freeze again (sometimes for 3 m...

So I want to write a log activity scraper. *Seems* easy enough... Step 1: put together some C code that eventually does a loop like this: ... DSOpenJob() result = DSFindFirstLogEntry() while( result == DSJE_NO_ERROR ) { write info from logevent result = DSFindNextLogEntry() } ... DSCloseJob() Step 2...

anbu wrote:Unix solution

Code: Select all

awk ' { print > $1 } ' file

nice example, anbu

Also a Windows solution, since DataStage includes MKS, which also has an awk.

ray.wurlod wrote:An ETL design with no elephants is irrelephant.

"with no elephants..."? *groan*
That was especially bad

Hmm... so if something is irrelephant, does that make it off-tropic?