Search found 429 matches
- Tue Oct 07, 2014 7:38 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Balanced Optimizer & Operations Console
- Replies: 2
- Views: 2367
Rows per link in a BO job that completely pushes the work down to the database would be pretty meaningless. Look at the example you are giving for performance tuning in another post: Row Generator --> Neteeza There is 1 link and the number of rows across the link is 1. Depending upon the database st...
- Tue Oct 07, 2014 7:17 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: NULL Handling in Runtime Column Propagation
- Replies: 10
- Views: 8664
Oracle treats empty strings as null. http://docs.oracle.com/cd/B19306_01/server.102/b14200/sql_elements005.htm http://docs.oracle.com/cd/B28359_01/server.111/b28286/sql_elements005.htm You can work around this by providing a default value in the Oracle DDL. Understand that other loads where the colu...
- Tue Nov 12, 2013 7:53 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Performance issue reading data from Oracle connector
- Replies: 16
- Views: 9612
ROWID is Oracle row identifier and is unique for every single row in your table. Without knowing more specifics of your job, there are only two reasons that I can think of that you would have duplicates: 1. As Ray said you have duplicates in your source table 2. You are not partitioning and/or sorti...
- Mon Nov 11, 2013 7:56 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Performance issue reading data from Oracle connector
- Replies: 16
- Views: 9612
Re: Performance issue reading data from Oracle connector
Have you tried enabling partitioned reads? If the table is a partitioned table you can have it read from each Oracle partition. If the table is not partitioned you can still read in parallel: 1. Enable partitioned reads = Yes 2. Partitioned reads method = Rowid round robin 3. table name for partitio...
- Mon Nov 11, 2013 9:57 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: datastage sort best performance
- Replies: 9
- Views: 10826
- Wed Oct 30, 2013 5:47 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Balanced Optimizer - Transform Stage
- Replies: 8
- Views: 4997
- Mon Oct 14, 2013 11:04 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Oracle connector Update then Insert mode not working for RCP
- Replies: 8
- Views: 11584
Has there been a change to allow schema files to identify keys? We had this discussion last year:chulett wrote:... unless you specify the key(s) in your schema file.
viewtopic.php?t=147155&highlight=
If a key specification now exists it would definitely provide more flexibility.
- Mon Oct 14, 2013 7:15 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Oracle connector Update then Insert mode not working for RCP
- Replies: 8
- Views: 11584
Re: Oracle connector Update then Insert mode not working for
With RCP the best way to update/insert is to write the sql statements in a file, then reference the file for your sql statements. Having DataStage generate your sql statement won't work because it doesn't know the key for your data.
- Fri May 31, 2013 10:13 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Poor performance - Extracting Oracle Table
- Replies: 9
- Views: 6111
How many bytes are in each row? A wide 10 billion row table is going to take quite some time to extract. A fairly skinnty 10 billion row table should be manageable. Have you tried to perform a parallel read? In the connector, enable parallel read and then set rowid hash and the table name equal to y...
- Wed May 22, 2013 12:58 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: RCP with sort/join stages
- Replies: 2
- Views: 2818
Re: RCP with sort/join stages
Your sql can alias a column or a concatenation of columns as 'keycolumn' and then you can sort and partition based upon that column. It will also be helpful to have the key column extracted under its own column name so it can be used to insert into any target using drop unused coumn (which would dro...
- Tue May 14, 2013 8:48 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Unable to load the Latin Tilde characters into Teradata
- Replies: 2
- Views: 4098
The name field should be set to Unicode in Teradata and not Latin. And the SQL Server NLS is not ISO-8859-1, it is likely windows-1252. Windows 1252 was developed before the Latin-1 and is a superset of Latin-1. Once you have the column set to Unicode and the NLS MAP set to windows-1252, and then cl...
- Tue Apr 30, 2013 12:16 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: [Microsoft][ODBC SQL Server Driver][DBNETLIB]ConnectionWrite
- Replies: 22
- Views: 28353
- Tue Apr 30, 2013 10:08 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ORA-02291 Error in Oracle conector stage
- Replies: 3
- Views: 2687
- Tue Apr 30, 2013 10:01 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: [Microsoft][ODBC SQL Server Driver][DBNETLIB]ConnectionWrite
- Replies: 22
- Views: 28353
Just happened to look out here and see this question this morning. You can have a DSN entry as simple as this work. Driver=/opt/IBM/InformationServer/Server/branded_odbc/lib/VMsqls24.so Description=DataDirect 6.0 SQL Server Native Wire Protocol Database= LogonID= Password= Address=ipaddr, portno Quo...
- Thu Apr 11, 2013 6:34 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Merge Statement SQL Server ODBC Connector
- Replies: 8
- Views: 12748
1. First deadlocking the database is more complicated than just running somethign on one node. At a mininmum you can decrease the array and transaction size to decrease the number of records effected by each node performing an upsert. The SQl Server table itself can be tuned by your DBA. 2. If you d...