DataStage SFDC Pack - Experiences and pointers

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
rkashyap
Premium Member
Premium Member
Posts: 532
Joined: Fri Dec 02, 2011 12:02 pm
Location: Richmond VA

DataStage SFDC Pack - Experiences and pointers

Post by rkashyap »

We have recently installed SFDC stage/pack (Version 1.5.0.2) with IBM's help.

Some of the things that we have noticed post-installation are:
1. In case of failure in SFDC stage, director log states "No message available"
  • Message Id: IIS-CONN-DAAPI-00000
    Message: Salesforce_6,0: <No message available>
2. No entry was created in Version.xml for SFDC pack.
3. On clicking 'Help' in SFDC stage the message is "Topic not found".
4. On selecting a field from a SFDC table in metedata browser, all the related referenced field are always selected (one has to manually unselect them, which takes multiple clicks).

Are above mentioned things normal for SFDC stage? Please share your experience and pointers regarding SFDC stage.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I don't think it's SalesForce per se; it would appear that the resource file that contains error and other messages (for example DS_RESENU for English US) has become inaccessible - or was not installed in the first place.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

I can comment on two of the items, also about salesforce pack 1.5.0.2, but with IS 11.3.1 on AIX.

2. No entry was created in Version.xml for SFDC pack. "CONFIRMED"
- The salesforce pack has its own installer which calls the "dscompinst" program.
- I had also noticed there was no trace of the install in the Version.xml file.
- There are salesforce install logs left under /opt/IBM/InformationServer/Server/eainstlogs
- One of the two log files contains the isadm ID and password logged in plain text!

3. On clicking 'Help' in SFDC stage the message is "Topic not found". "BUSTED"
- When I click 'Help' in the stage, it opens my default browser to a correct location on the IBM Knowledge Center site.
Choose a job you love, and you will never have to work a day in your life. - Confucius
rkashyap
Premium Member
Premium Member
Posts: 532
Joined: Fri Dec 02, 2011 12:02 pm
Location: Richmond VA

Post by rkashyap »

Thanks for the information. How is your overall experience with SFDC pack?

Biggest challenge for us in adapting SFDC pack is lack of meaningful error messages. Another issue that we have seen is that the default API version appears to be 27.0 but SFDC is currently at 33.0. We will be discussing these issues with IBM next week.
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

Our experience with this stage is just beginning. We have it installed and are currently waiting on credentials in order to use it.
Choose a job you love, and you will never have to work a day in your life. - Confucius
Developer9
Premium Member
Premium Member
Posts: 187
Joined: Thu Apr 14, 2011 5:10 pm

Post by Developer9 »

Recently we installed Version 1.5 for 11.3 in Unix

While Testing our jobs we found that In Director log ,there is no information about the record counts (for successful runs also)

Code: Select all

SFDC_Test,0: <No message available>
@rkashyap ,

Were you able to figure out the issue while discussing with IBM support ?

Please share us the resolution or findings


Thank you
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

We have the same version combo installed and running fine. Job log has the usual entries. For the SF Connector, the detailed job log entry looks like this:

Code: Select all

Total number of records retrieved: 10,000
Total number of records retrieved: 20,000
Total number of records retrieved: 30,000
Total number of records retrieved: 40,000
Total number of records retrieved: 50,000
Total number of records retrieved: 60,000
Total number of records retrieved: 62,174
Choose a job you love, and you will never have to work a day in your life. - Confucius
Developer9
Premium Member
Premium Member
Posts: 187
Joined: Thu Apr 14, 2011 5:10 pm

Post by Developer9 »

In Current version 8.5 ,we selected Batch size "10000"

Below is the log

Code: Select all

SFDC_Test,0: Sent 10,000 records to Salesforce
SFDC_Test,0: Information: Wait for: 30 seconds
SFDC_Test,0: This batch 1 completed
SFDC_Test,0: This batch 2 completed
SFDC_Test,0: Loading finished. 212,233 rows are loaded into Salesforce.com
SFDC_Test,0: Loading finished. 0 rows are rejected
So By default, were you able to see the log for above entries ?or any work around to get ?

Also I observed in Latest version of Pack they have included another tabs "Input/Output " similar to other processing stages.

Can you please share additional information or any documentation related to current pack using
Thank you
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Seems to me you should be continuing to get IBM's help with this.
-craig

"You can never have too many knives" -- Logan Nine Fingers
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

It's not the best comparison. It looks like you are sending records to SF, whereas we are only extracting records from SF.

Also if I recall correctly, in the SF Pack download, when you or your admin unzipped everything to install it, there should be a User's Guide PDF in that package. Please look there for the docs.
Choose a job you love, and you will never have to work a day in your life. - Confucius
Post Reply