Search found 1419 matches
- Mon Apr 02, 2018 9:36 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Memory usage by lookup stage
- Replies: 1
- Views: 2375
Memory usage by lookup stage
So, I informed a developer that the lookup stage (non-sparse) should typically be used when referencing data in smaller tables, which allows the structure to fit into memory. He asked two very good questions for which I didn't have an answer. 1) Does it use standard virtual memory to buffer the look...
- Mon Mar 26, 2018 4:40 pm
- Forum: Site/Forum
- Topic: Spambot
- Replies: 28
- Views: 68607
- Wed Feb 14, 2018 12:26 pm
- Forum: General
- Topic: IIS on Hadoop Recommendations
- Replies: 1
- Views: 2444
If you are going to move to Big Integrate on Yarn, the Hadoop environment needs to be configured to support BI from the start. The Hadoop team will probably not like some of the changes that need to be made to support BI, and they'll like it even less if they have to retrofit those changes and disru...
- Fri Feb 02, 2018 12:43 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Error connecting to Big SQL
- Replies: 2
- Views: 3971
- Fri Feb 02, 2018 12:23 pm
- Forum: General
- Topic: Any limit on XML Schema Library size?
- Replies: 2
- Views: 2376
Any limit on XML Schema Library size?
I am assisting a client with loading some highly qualified XML schemas that came from a vendor. The schemas contain import statements to load other "sub"-schemas. And of course, the sub-schemas have numerous imports that nest down even further. It's a poor design in that the included sub-s...
- Mon Jan 29, 2018 9:45 am
- Forum: General
- Topic: Capturing CDC logs into a table
- Replies: 3
- Views: 2613
What you are being asked to do is already performed by an IBM product that is integrated in DataStage: InfoSphere Change Data Capture https://www.ibm.com/support/knowledgecenter/en/SSX3HK_6.5.2/com.ibm.cdcdoc.mcadminguide.doc/concepts/overview_of_cdc.html A good example of usage on DeveloperWorks is...
- Mon Jan 29, 2018 9:28 am
- Forum: General
- Topic: DataStage 8.7 and Oracle 12.1
- Replies: 3
- Views: 2635
- Mon Jan 29, 2018 9:02 am
- Forum: Site/Forum
- Topic: Spambot
- Replies: 28
- Views: 68607
- Tue Jan 23, 2018 3:18 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Stored Procedure stage with Longvarchar (CLOB)
- Replies: 16
- Views: 11469
Yes - you might have to establish some sort of key structure / row count in order to reassemble the chunks. Just realize - if the resulting data record including the re-assembled CLOB exceeds 128K, then it can't be done in DataStage. On the release you are on, 131,072 bytes is the hard limit on reco...
- Thu Jan 18, 2018 5:36 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Stored Procedure stage with Longvarchar (CLOB)
- Replies: 16
- Views: 11469
It isn't supported. I heard they are adding better support for CLOB in 11.7 (mainly for Hadoop), but don't know if it would apply in this case. Customer services should be able to confirm if its in 11.7 or not. However, that doesn't really fix your current issue. I encountered this once and had to s...
- Thu Jan 18, 2018 5:25 pm
- Forum: General
- Topic: Separating Services and Repository tiers from Engine
- Replies: 2
- Views: 3011
Splitting it up later is not trivial and is time consuming. You did mention they are VM's. Virtual Machines are usually very cheap, and as you say, there's no licensing issue for splitting out the Services and Repository tiers. I'd recommend doing it up front. You can always start out with smaller V...
- Tue Jan 16, 2018 10:09 am
- Forum: Site/Forum
- Topic: Spambot
- Replies: 28
- Views: 68607
- Tue Jan 16, 2018 9:32 am
- Forum: Site/Forum
- Topic: Spambot
- Replies: 28
- Views: 68607
- Wed Jan 10, 2018 9:27 am
- Forum: General
- Topic: Intel Kernel design flaw / bug
- Replies: 6
- Views: 4288
- Fri Dec 22, 2017 11:08 am
- Forum: Site/Forum
- Topic: Spambot
- Replies: 28
- Views: 68607