DSXchange

Thank you both. Craig, you've reminded me of how simple this can be. We can't have Toad but I have checked quickly with SSMS and can do similar (need to resolve character set defaults). The scope, roughly, is that about 10 users would load about 2 files per month, and doing so without involving us (...

Hi experts, Looking for a good idea on how to load any flat file to SQLServer DB. We have plenty of flat files and some of them can be pretty large. The owners of these files would like test loading them into DB on an ad-hoc basis for exploratory purposes. The database would give them better perform...

Hi guys, I have not explained this well. The focus is on the automated deployment tools, ie. Jenkins, Mamboo or TFS in our case. What are some of the best practices these days. An option could be to have IIS objects: 1) compiled 2) exported 3) stored into version control 4) tagged with the relevant ...

Hi experts, Would you please be able to share your experiences with setting up automated deployment of DataStage, Information Analyzer and ISD jobs? What is the best approach these days? We will have 2 release Microsoft TFS Servers to support our non-Prod and Prod ETL servers. Looking to avoid insta...

Definitely strange if wrong hash result is produced for bigger number of columns. We have used about 5 columns in our own testing. Had to revert to using custom written MD5 hash stage because the built in checksum stage is appending '|' to the last input column. I wish that was not there but it is v...

Hi gents, Many thanks for your opinions on this one. With IBM not being able to move away from the official stance of not providing typical support for custom written code (understandable) the explanations from senior experts helped in convincing powers to be that custom written C++ routines pose no...

Thanks a lot guys. We will almost definitely upgrade to 64-bit on Linux and hopefully within couple of months. This is the second time I am running IA on Windows and it is painful to say the least. Not just because of this failure, but the overall end user response times. Until then, and on advice f...

Hi all, I have come across a custom built parallel stage within our environment that does a better job at MD5 hashing that the built-in Checksum stage because it does not use the trailing pipe character. The latter happens to be a problem for us because there are existing hashed values (produced by ...

Hi Craig,

It is 32bit.

Hi experts, Running on Windows system with 32 GB RAM, 8 CPUs and 4 node file. We have a flat file with 96 columns needing to be analyzed. When running on a sample of 20 records it runs incredibly slow, with only a few columns analyzed before eventually failing with " java.lang.OutOfMemoryError:...

Hi All, Would somebody have an idea as to why is that the when attempting to run data quality rule from IA thin client, it is looking for file with the following pattern D:\SourceData.FileName2018Oct04 , instead of D:\SourceData \ FileName2018Oct04 So, it is separating the directory from a file name...

This will very likely be due to buffering. Was trying to avoid changing too much of a job in production but prior to this there were two lookup stages linked one to each other. In dev and sit, they tell me it was never an issue, but it was never tested with large volumes. After changing from lookup ...

Hi all, We have a parallel job that needs some improvements but is by no means complex. The last transformer in a job is preceeded by lookup stage that drops un-matched records. The transformer writes to dataset with some simple derivations. The job was running fine in non-prod environments, but sta...

Hi Ray, Different project and still the same issue and I finally found a solution. Installing the certificate by following what used to be sufficient does not suffice anymore. So, our fix was: 1. Upon certificate warning click on 'View Certficate' button 2. Click on 'Certification Path' tab 3. You w...

Hi Ray,

You probably did, but just do double check...Did you install the certificate into the default path offered or did you choose the 'Trusted Root Certification Authorities' certificate store? The first option hardly ever works.