DSXchange

The files were sorted correctly according to the right keys. But what did the magic was the dummy sort stages before the join, A-M-A-Z-I-N-G :D , thank you so much for the tip! I would not have figured out this workaround on my own (BTW, still, it makes me wonder isn't there a "proper" way...

I would appreciate your opinion on a join that I need to do but it's taking way too much time. I must be missing some important point here. File 1: 118 rows (eventually should be 8,000,000+) Dataset hash partitioned, sorted by key (not unique) File 2: 21,000,000 rows Dataset hash partitioned, sorted...

Did you find a solution for this connection issue?

We are are getting the same error on a new DS 9.1.2 installation while old DS 8.7 connecting to the same HDFS can connects fine.

We are on 8.7 and just activated the Operations Console. The jobs are launched from a script after arrival of a new file is detected.

We'll query the console DB from Nagios, thanks for your help.

I would like to hear solutions and your experiences with monitoring DataStage jobs from Nagios or from any other external tool.

The requirement is to raise alerts on all jobs that finish with status <> OK, preferably real time or to run a scan every 10 minutes.

I had the same warning ("Missing record delimiter "", saw EOF instead") while reading from HDFS with BDFS stage. Changing the "Final delimiter =none" or "=end" didn't help. When I converted the files from DOS format to UNIX format I stopped getting this error ...

hi
did anyone find an explanation to this problem ?
is it a know issue ?

Thanks for your reply. Unfortunately there is no http edition. I've tried http service I found in internet: http://www.restfulwebservices.net/wcf/WeatherForecastService.svc and it works fine. According to sysadmin who's responsible for the requred https - there is no need in user/password or certifi...

In DataStage 8.5 I'm using Web_Services_Transformer to invoke a Web Server. I've loaded the WSDL file and the port address starts with "https". I checked the WS via soapUI and it does not requires token (user/password) or certification. But if in Web_Services_Transformer in the Secutiry ta...

Hi, Did anyone noticed a collision between DataStage Designer (8.1) and QTP installed on the same client machine? For some reason, QTP will stop working after installation of Designer. On the other hand, when QTP is installed after Designer, all Connector stages will not show the properties page... ...

Thank you! I actually looked at this thread, and as noted in my original post, the DS project is not marked as "Generate operational metadata". Am I missing something here? I found some post outside of the DSXchange forum, suggesting to "set DS_NO_PROCESS_METADATA to 1". I'll giv...

It makes me wonder why would one bother to answer, while providing no answer at all... :shock: Isn't it a waste of his time? No, I did not find a solution in the DSXchange forum (but did search it). My believe is that sharing knowledge makes you a greater man. Hiding it, makes you ...?!. Think of th...

Hi Everyone, DBAs reported this recurring Oracle error (942): a select from non existing table METASTAGE_LOC_INFO. This faulty select statement is generated and called from DataStage jobs, but error is not reported in the DS log. It is found when a DB trace is activated by DBAs. From reading earlier...

Hi I need to move 2.5 million records per day from one oracle DB to another oracle DB. The source and target table are the same The tables have 3 CLOB fields all of them must move to the targent After reading the forum and IBM docs I defined a parallel job with 2 oracle connectors. The only way I ca...

Hi
Does any one know if it's possible to change default values of attribute in datastage stage -> I want to change the default value of the sql before statement in oracle stage
In the client when I logged in with admin - the stage open in read-only mode
Thanks